Data2025
Atlas Health
Backfills went from 9 hours to 22 minutes.
- Stack
- Python · dbt · BigQuery
- Duration
- 9 weeks
- Year
- 2025
- Sector
- Data
The problem
Every ingest reprocessed the full window, so a one-row fix cost a night.
What we built
Incremental ingestion with watermarking and idempotent upserts.
What it measured
Backfills went from 9 hours to 22 minutes.