Blog

Building a Modular Data Architecture

From Chaos to Clarity: Managing Data Lakes with Prefect

Built to Fail: Design Patterns for Resilient Data Pipelines

Microservices Orchestration: What It Is, How to Use It

The Hidden Factory of Long Tail Data Work

dbt Coalesce 2024 Takeways

Every Company is a Data Processing Company

Break It, Fix It, Reverse It: Transactional ML Pipelines with Prefect 3.0

Prefect on the lakehouse: write-audit-publish pattern with Bauplan

Prefect's Commitment to Open Source: Launching Our Sponsorship Initiative

ControlFlow 0.9: Take Control of your Agents

What I Talk About When I Talk About Orchestration

How One Education Travel Company Unblocks Data Science Teams With Prefect

Orchestration Tools: Choose the Right Tool for the Job

Cox Automotive Meets Dynamic Demands with Workforce Analytics Solutions Powered by Prefect

When That Adhoc Script Turns Into a Production Data Pipeline

Background Tasks: Why They Matter in Prefect

Cash App Gains Flexibility in Machine Learning Workflows with Prefect

Managing Efficient Technical and Data Teams

Introducing Prefect 3.0

Introducing ControlFlow

Work Pools and Workers: Deploy Python Securely

5 Reasons You Can't Miss Prefect Summit 2024

The Role of Infrastructure Cleanup Jobs

Dockerizing Your Python Applications: How To

Data Validation with Pydantic

Glue Code: How to Implement & Manage at Scale

Observability Metrics: Put Your Log Data to Use

Data Pipeline Monitoring: Best Practices for Full Observability

Pydantic Enums: An Introduction

Orchestrating dbt on Snowflake with Prefect

Workflow Observability: Finding and Resolving Failures Fast

What is Pydantic? Validating Data in Python

Event-Driven Versus Scheduled Data Pipelines

How Jeremiah Lowin Turned a Life-Long Question Into an Industry-Leading Startup Based in D.C.

Unveiling Interactive Workflows

Scalable Microservices Orchestration with Prefect and Docker

Product updates: incident management, managed compute, and much more

Schedule Python Scripts

Reducing the Workflow Hangover in 2023

Orchestrating Event Driven Serverless Data Pipelines

Why You Need an Observability Platform

Successfully Deploying a Task Queue

Building an Application with Hashboard and Prefect

A platform approach to workflow orchestration

Building a HIPAA compliant self-serve data platform

Monitoring Serverless Functions: A Tutorial

Introducing access controls and team management

Database Partitioning Best Practices

Building resilient data pipelines in minutes

When to Run Python on Serverless Architecture

dbt and Prefect: A quick tutorial

Austin FC Scores Big with Data: A Strategic Play with Prefect

Introducing Error Summaries by Marvin AI

Rec Room: From Workflow Chaos to Orchestrated Bliss

The Implications of Scaling Airflow

Data is Mail, Not Water

Schedule your Python code quickly with .serve()

Automatically Respond to GitHub Issues with Prefect and Marvin

What is a Data Pipeline?

No Flow is an Island

Glue it all together with Prefect

You Probably Don’t Need a DAG

An Introduction to Workflow Orchestration

Crumbl and Prefect: A Five Star Recipe

Beyond Scheduling

More Memory, More Problems

Introducing Prefect Workers and Projects

Keeping Your Eyes On AI Tools

Freezing Legacy Prefect Cloud 1 Accounts

Workflow Design Patterns

Expect the Unexpected

Anaconda and Prefect

Why Not Cron?

The Workflow Coordination Spectrum

If You Give a Data Engineer a Job

Why Dyvenia Adopted Prefect

(Re)Introducing Prefect

RTR Struts the Data Runway with Prefect

A Brief History of Workflow Orchestration

Washington Nationals and Prefect

Our Second-Generation Workflow Engine

Don't Panic: The Prefect Guide to Building a High Performance Team

Why Not Airflow?

The Golden Spike