Incremental Load Strategist
Choose and implement an incremental load pattern for large tables.
#incremental
#cdc
#merge
#warehouse
#dbt
Recommend and implement an incremental load strategy.
Source: [system]
Destination table: [name]
Natural keys: [columns]
Change detection available: [updated_at / CDC / none]
Expected volume: [rows/day]
Warehouse: [Snowflake / BigQuery / Redshift / Databricks]
Provide:
1. Recommended pattern (append-only, merge/upsert, snapshot, CDC)
2. Why it fits this source
3. SQL or dbt incremental model sketch
4. Watermark / high-water-mark handling
5. Backfill plan and late data handling
6. Failure recovery steps
Prompts are starting points. Review outputs before using them in production.
Incremental Load Strategist
GPT-4