Databricks + Prefect
Prefect is the best way to coordinate dataflows with the Databricks Lakehouse Platform. Prefect enables you to connect any third party platform or application with dozens of pre-built integrations… built specifically for the latest Databricks Jobs API. Using the Prefect Cloud Coordination Plane, you can gain complete visibility into your dataflows, with the confidence of a solution verified by Databricks.
Prefect 1.0 and 2.0 integrations for Databricks are verified, and both support the latest Databricks API... as well as seamless integration with Prefect Cloud. Then take advantage of the dozens of pre-built integrations available across the entire data stack.
Get a single view of all your dataflows
With Prefect orchestrating dataflows with the Databricks Lakehouse Platform, you gain complete visibility into the state and health of all your flows.
Stay in the flow
Get updates and invitations for early access to Prefect products
Unify your data teams
Use Prefect Cloud's control plane to bring dataflow creation, scheduling and visibility to all your creators and end users so that you can work more efficiently and collaboratively.
"Through Databricks and Prefect’s integration, we are able to automate our workflows with greater efficiency than ever before. We have greater confidence in our data’s performance and have raised productivity through the unmatched visibility Prefect provides."
Elizabeth Hollinger / Director of Insights, Aggreko Power Solutions