Apr. 21, 2022
A Brief History of Dataflow Automation
How did we get to modern dataflow automation? Bill Palombi takes us down memory lane, starting with cron.
Blog Post
Spark
Airflow
Oozie
cron
Hadoop
Redshift
GCP
AWS
Snowflake
Azure
Caching
Debugging
Dynamic DAGs
Error Handling
Logging
Mapping
Notifications
Retries
Scheduling
Integrations
Monitoring
Other
DevOps & CI/CD