Gnarly Data Waves

Episode 21

|

June 13, 2023

Data as Code with Dremio Arctic: ML Experimentation & Reproducibility on the Lakehouse

In this episode of Gnarly Data Waves, we will discuss how Dremio Arctic and data as code enable data science use cases like Machine learning experimentation and reproducibility on a consistent view of your data in a no-copy architecture.

As more data consumers require access to critical customer and operational data in the data lake, data teams need solutions that enable multiple users to leverage the same view of the data for a wide range of use cases without impacting each other. In this episode of Gnarly Data Waves, we will discuss how the data as code capabilities in Dremio Arctic enable data scientists to:

    • Create a data science branch of the production branch for experimentation without creating expensive data copies or impacting production workloads

    • Easily work and collaborate cross-functionally with other data consumers and line of business experts

    • Quickly reproduce models and results by returning to previous branch states with tags and commit history

Topics Covered

Data lakehouse

Watch or listen on your favorite platform

Register to view episode

Ready to Get Started? Here Are Some Resources to Help

What is Apache Polaris?

Guides

What is Apache Polaris

Apache Polaris is an open-source catalog service purpose-built for managing Apache Iceberg tables in a distributed, multi-engine environment. At its core, Polaris implements the Iceberg REST Catalog API, providing a standardized, cloud-native method for connecting query engines with Iceberg metadata, without requiring tight coupling to storage systems.

read more
Whitepaper Thumb

Whitepaper

Accelerate AI and Analytics with Dremio

read more
Webinars Thumb

Webinars

Delivering Data Products with a Lakehouse Architecture: Insights from BARC & Dremio

Learn how the data lakehouse powers scalable, reusable data products. Join BARC and Dremio for strategies and best practices.

read more
get started

Get Started Free

No time limit - totally free - just the way you like it.

Sign Up Now
demo on demand

See Dremio in Action

Not ready to get started today? See the platform in action.

Watch Demo
talk expert

Talk to an Expert

Not sure where to start? Get your questions answered fast.

Contact Us

Ready to Get Started?

Enable the business to accelerate AI and analytics with AI-ready data products – driven by unified data and autonomous performance.