Orchestrating Data Validation Workflows with Prefect

As data pipelines become increasingly complex and interconnected, workflow management systems are being used to schedule and monitor tasks. Prefect is an open source workflow management system designed for large-scale data processes.In this talk, we’ll show how to get started with Prefect to orchestrate data validation workflows to preserve data integrity before it’s used in downstream processes.