Great Expectations + Prefect
Great Expectations provides APIs for validating, documenting and profiling data in ETL pipelines. Prefect can trigger Great Expecations checkpoints as part of a broader dataflow, saving time for data teams as well as increasing confidence in their data.
Integrate data quality tests into your flow
With this integration, you can run data validation as a task in any of your flows.
Bring automated testing to your data
Your code deserves to be thoroughly tested, but so does your data. Adding data tests into your data pipelines can bring more visibility into the health of your data platform.
Visualize validation results in Prefect Cloud UI
Prefect's artifacts API allows you to visualize your data testing results. This way, your data tests are visible from the same place from where you schedule and orchestrate your flows.
"By adding Great Expectations quality checks into a Prefect workflow, data teams can increase overall data reliability and confidence. We’re super excited to be partnering with Prefect to solve all of the problems data engineering teams face."
Ben Castleton / Co-Founder and Head of Partnerships at Great Expectations