Section 23

Runbooks

What to do when things break — or when you need to redo history.

Run a pipeline manually

bash
# from project root
python -m pipelines.ingest_claims
python -m pipelines.transform_silver --table claims
python -m pipelines.build_gold --process claims_summary

Debug a failure

Backfill

bash
# Re-run the full pipeline for a date range
python -m pipelines.backfill \
  --job ingest_claims \
  --from 2024-01-01 \
  --to   2024-12-31 \
  --batch-days 7
Tip
Backfills should write to the same tables — if your pipeline isn't idempotent, backfills will duplicate rows. Use MERGE / INSERT … ON CONFLICT.

Recover from corruption