Data integration and pipelines
Collect data from APIs, operational databases and files using Python, SQL and cloud ingestion services. The implementation covers incremental loads, historical backfills, duplicate handling and recovery when a source changes or a run fails.