SaaS API Ingestion Reliability Designer
Data Engineering
Design a restartable SaaS API extractor that survives pagination, rate limits, partial pages, and vendor cursor resets without duplicating or skipping records.
Curated AI prompts for data engineering, software engineering, and AI engineering.
Data Engineering
Design a restartable SaaS API extractor that survives pagination, rate limits, partial pages, and vendor cursor resets without duplicating or skipping records.
Data Engineering
Audit a change-data-capture pipeline for gaps, duplicates, reordering, and recovery risks.
Data Engineering
Plan a backward-compatible schema change across producers, pipelines, and consumers, with an expand-migrate-contract order and a rollback path.
Data Engineering
Turn vague data reliability expectations into measurable SLOs, error budgets, and burn-rate alerts consumers can use.
Data Engineering
Review an Airflow DAG for idempotency, scheduler pressure, backfills, and safe recovery.
Data Engineering
Run a structured root-cause analysis for broken pipelines or bad dashboards, with checks, mitigations, and what not to guess.
Software Engineering
Turn incident evidence into a blameless RCA with a causal chain, contributing factors, and corrective actions that owners can actually execute.