Blog

How to Cut Data Pipeline Costs by 75% with Kubernetes Spot Instances

Kraft Analytics Group Platform Evolution with Prefect

How to Roll Back Deployments in Prefect with Deployment Versioning

Building Better Data Platforms with CI/CD

Introducing Two New Self-Serve Plans for Prefect Cloud

Introducing Prefect Serverless

How WHOOP Cut Incidents by 75% with Prefect

How an Enterprise Engineering Team Reduced Deployment Times from Hours to 20 Minutes with Prefect

Managing Prefect Deployments with Terraform

Beyond Loops: How Prefect's Task Mapping Scales to Thousands of Parallel Tasks

How AnyIO Powers Prefect's Async Architecture

Switching a Big Python Library from setup.py to pyproject.toml

What Data Professionals Need to Know about uv

Airflow to Prefect: Your Migration Playbook

Airflow to Prefect: Why Modern Teams Choose Prefect

Why We Went All In on Type Completeness

Building Real-Time Data Pipelines: A Guide to Event-Driven Workflows in Prefect

How LiveEO Harnesses Petabytes of Satellite Data with Prefect

Prefect's Observability Suite

Stop Making Your Data Team Learn Kubernetes

Don’t Buy a Fancy Cron Tool

Supercharging dbt: 3 Ways Prefect Enhances Your Data Workflows

Experimenting with Remote First: Humans Shouldn't Be Your Only Strategic Hires

Push and Pull Architecture: Event Triggers Vs. Sensors in Data Pipelines

Four Infrastructure Trends Reshaping Modern Systems

Modern Orchestration: Endpoint’s evolution from Airflow to Prefect

Orchestrating Fashion's Data Runway: Inside Rent the Runway's Data Stack with Prefect and dbt

The Importance of Idempotent Data Pipelines for Resilience

Building a Modular Data Architecture

From Chaos to Clarity: Managing Data Lakes with Prefect

Built to Fail: Design Patterns for Resilient Data Pipelines

Microservices Orchestration: What It Is, How to Use It

The Hidden Factory of Long Tail Data Work

dbt Coalesce 2024 Takeways

Every Company is a Data Processing Company

Break It, Fix It, Reverse It: Transactional ML Pipelines with Prefect 3.0

Prefect on the lakehouse: write-audit-publish pattern with Bauplan

Prefect's Commitment to Open Source: Launching Our Sponsorship Initiative

ControlFlow 0.9: Take Control of your Agents

What I Talk About When I Talk About Orchestration

How One Education Travel Company Unblocks Data Science Teams With Prefect

Prefect 3.0: Now Generally Available

Orchestration Tools: Choose the Right Tool for the Job

Cox Automotive Meets Dynamic Demands with Workforce Analytics Solutions Powered by Prefect

When That Adhoc Script Turns Into a Production Data Pipeline

Background Tasks: Why They Matter in Prefect

Cash App Gains Flexibility in Machine Learning Workflows with Prefect

Managing Efficient Technical and Data Teams

Introducing Prefect 3.0

Introducing ControlFlow

Work Pools and Workers: Deploy Python Securely

5 Reasons You Can't Miss Prefect Summit 2024

The Hidden Costs of Running Apache Airflow

The Role of Infrastructure Cleanup Jobs

Dockerizing Your Python Applications: How To

Data Validation with Pydantic

Glue Code: How to Implement & Manage at Scale

Observability Metrics: Put Your Log Data to Use

Data Pipeline Monitoring: Best Practices for Full Observability

Pydantic Enums: An Introduction

Orchestrating dbt on Snowflake with Prefect

Workflow Observability: Finding and Resolving Failures Fast

What is Pydantic? Validating Data in Python

Event-Driven Versus Scheduled Data Pipelines

How Jeremiah Lowin Turned a Life-Long Question Into an Industry-Leading Startup Based in D.C.

Unveiling Interactive Workflows

Scalable Microservices Orchestration with Prefect and Docker

Product updates: incident management, managed compute, and much more

Schedule Python Scripts

Reducing the Workflow Hangover in 2023

Orchestrating Event Driven Serverless Data Pipelines

Why You Need an Observability Platform

Successfully Deploying a Task Queue

Building an Application with Hashboard and Prefect

A platform approach to workflow orchestration

Building a HIPAA compliant self-serve data platform

Monitoring Serverless Functions: A Tutorial

Introducing access controls and team management

Database Partitioning Best Practices

Building resilient data pipelines in minutes

When to Run Python on Serverless Architecture

dbt and Prefect: A quick tutorial

Austin FC Scores Big with Data: A Strategic Play with Prefect

Introducing Error Summaries by Marvin AI

Rec Room: From Workflow Chaos to Orchestrated Bliss

The Implications of Scaling Airflow

Data is Mail, Not Water

Schedule your Python code quickly with .serve()

Automatically Respond to GitHub Issues with Prefect and Marvin

What is a Data Pipeline?

No Flow is an Island

Glue it all together with Prefect

You Probably Don’t Need a DAG

An Introduction to Workflow Orchestration

Crumbl and Prefect: A Five Star Recipe

Beyond Scheduling

More Memory, More Problems

Introducing Prefect Workers and Projects

Keeping Your Eyes On AI Tools

Freezing Legacy Prefect Cloud 1 Accounts

Workflow Design Patterns

Expect the Unexpected

Why Not Cron?

The Workflow Coordination Spectrum

If You Give a Data Engineer a Job

Why Dyvenia Adopted Prefect

(Re)Introducing Prefect

RTR Struts the Data Runway with Prefect

A Brief History of Workflow Orchestration

Washington Nationals and Prefect

Our Second-Generation Workflow Engine

Actium Health Produces Breakthrough Machine Learning Models with Prefect

Don't Panic: The Prefect Guide to Building a High Performance Team

Clearcover Accelerates Data Insights With Prefect

Why Not Airflow?

The Golden Spike