Airbyte + Prefect
Airbyte is an open-source data ingestion platform that allows you to build or use prebuilt connectors to sync your source systems with a custom destination such as your data warehouse or data lake.
Save time building data integration pipelines
Whether you need to schedule a full-refresh or just incremental data ingestion, Airbyte syncs data across all your configured destinations.
Automate schema changes and Change Data Capture
Airbyte supports log-based change data capture and can ingest only rows that changed since the last sync job. The replication can be adjusted when the schema of a source system changes.
Build your own open-source connectors
Even when your custom source system is not supported by Airbyte, you can contribute it to the open-source project and use it as part of Airbyte's cloud offering. Together with Prefect, you can orchestrate all of your data integration needs.