Data Observability

Real-time monitoring of data quality, pipeline health, and source freshness across 637,000+ funds

ETL Pipeline

Sources
--
Processing
--
Database
--
API Layer
--
Live Data Pipeline
SOURCES Regulators / Exchanges Macro / Market Data EXTRACT API Fetch / Scrape PDF Parse / FTP TRANSFORM Normalize / Validate Deduplicate / Enrich LOAD Cloud SQL / GCS 639K+ Fund Records SERVE Flask APIs + Cache Cloud Run (max 2) 44 GitHub Actions workflows • Daily/Weekly/Monthly cadence • 28 countries • 77K+ macro observations
--
Total Funds
--
Countries
--
Active Pipelines
--
Quality Score
--
Data Freshness
--
Macro Observations
--
Star Ratings
--
ESG Coverage
--
Avg NAV Age
--
Holdings Coverage

Statistical Anomaly Monitor

Loading statistical health bands…

Fund Data Sources

Loading fund data sources…

Macro Economic Sources

Loading macro data sources…
Source Freshness
Source Region Last Updated Status
SEC EDGAR (N-PORT) USA Weekly Live
AMFI (India NAV) India Daily Live
IMF Data API Global Weekly Live
US Macro Data USA Weekly Live
European Macro Data Eurozone Weekly Live
Market Price Data (NAV) Global Daily Live
Global Development Data Global Weekly Live
CVM Brazil LatAm Manual (GCS warm) Manual
Morningstar MCP Global On-demand Limited

Country Coverage

Country Funds Managers Holdings AUM (USD) Name Coverage
Loading country data…
Data Quality Dimensions
Completeness
Accuracy
Freshness
Consistency
Coverage

Quality Dimensions

Loading quality dimensions…

Data Completeness

Loading…
--
Avg Score
--
High ≥80%
--
Medium ≥50%
--
Low <50%
--
Unscored

Score by Dimension

Loading…

Country × Dimension Heatmap

Lowest Completeness Funds (top 20)

Fund Ticker Country Type Score

Nightly Enrichment Pipelines