Databricks + Prefect
Prefect is the best way to coordinate dataflows with the Databricks Lakehouse Platform. Schedule, monitor and orchestrate Databricks Jobs or connect to Delta Lake as a part of your data pipeline across multiple tools.
Integrate quickly
Prefect 1.0 and 2.0 integrations for Databricks are verified, and both support the latest Databricks API... as well as seamless integration with Prefect Cloud. Then take advantage of the dozens of pre-built integrations available across the entire data stack.
Get a single view of all your dataflows
With Prefect orchestrating dataflows with the Databricks Lakehouse Platform, you gain complete visibility into the state and health of all your flows.
Stay in the flow
Get updates and invitations for early access to Prefect products
Unify your data teams
Use Prefect Cloud's control plane to bring dataflow creation, scheduling and visibility to all your creators and end users so that you can work more efficiently and collaboratively.
"Through Databricks and Prefect’s integration, we are able to automate our workflows with greater efficiency than ever before. We have greater confidence in our data’s performance and have raised productivity through the unmatched visibility Prefect provides."
Elizabeth Hollinger / Director of Insights, Aggreko Power Solutions