Webinars

Data Lineage with Apache Airflow

With Airflow now ubiquitous for DAG orchestration, organizations increasingly depend on Airflow to manage complex inter-DAG dependencies and provide up-to-date runtime visibility into DAG execution. But what effects (if any) would upstream DAGs have on downstream DAGs if dataset consumption was delayed? In this talk we introduce Marquez, an open source metadata service for the collection, aggregation, and visualization of a data ecosystem’s metadata. We will demonstrate how metadata management with Marquez helps maintain inter-DAG dependencies, catalog historical runs of DAGs, and minimize data quality issues.

Topics Covered

Marquez

Ready to Get Started? Here Are Some Resources to Help

Whitepaper

2024 State of the Data Lakehouse

Benchmark your organization with Dremio's State of the Data Lakehouse Survey Report!

read more

Expert Panel Discussion – Data Integration Trends and Best Practices Webinar

TDWI senior research director James Kobielus will engage data industry experts in an in-depth discussion of data integration trends and best practices

read more
OctotronicDremio Smart Data Smart Factory 1

Webinars

Smart Data – Smart Factory with Octotronic and Dremio

Wie bringt ein Data Lake House die Smart Factory auf ein neues Level?

read more
get started

Get Started Free

No time limit - totally free - just the way you like it.

Sign Up Now
demo on demand

See Dremio in Action

Not ready to get started today? See the platform in action.

Watch Demo
talk expert

Talk to an Expert

Not sure where to start? Get your questions answered fast.

Contact Us