Gnarly Data Waves

Episode 20

|

June 6, 2023

What’s New in the Apache Iceberg Project: Version 1.2.0 Updates, PyIceberg, Compute Engines

In this episode of Gnarly Data Waves, Dremio’s Developer Advocate, Dipankar will highlight some of the key new capabilities that have been added to the Apache Iceberg project in the version 1.2.0 along with discussions around compute engines & the PyIceberg Python library.

The Apache Iceberg project has made tremendous strides, evolving on various fronts such as usage, ecosystem adoption, community growth, and capabilities. In the past few months, the project has introduced many exciting new features and performance improvements around the core library, compute engines and standalone libraries (such as PyIceberg) that makes this lakehouse technology robust & valuable for organizations. In this episode of Gnarly Data Waves, we will go over some of the notable new capabilities of Apache Iceberg.

Specifically, we will discuss about:

    • Version 1.2.0 release

    • Features such as : Branching/Tagging, New write-distribution-mode, Change Data Capture, Catalog Migrator Tool, Delta to Iceberg migration

    • PyIceberg (What’s happening in the Python library)

    • Compute Engine-specific features: Dremio, Apache Spark, Flink

Topics Covered

Data lakehouse
Unlocking Potential with Apache Iceberg

Watch or listen on your favorite platform

Ready to Get Started? Here Are Some Resources to Help

Guides

What is Apache Polaris

Apache Polaris is an open-source catalog service purpose-built for managing Apache Iceberg tables in a distributed, multi-engine environment. At its core, Polaris implements the Iceberg REST Catalog API, providing a standardized, cloud-native method for connecting query engines with Iceberg metadata, without requiring tight coupling to storage systems.

read more
Whitepaper Thumb

Whitepaper

Accelerate AI and Analytics with Dremio

read more
Webinars Thumb

Webinars

Delivering Data Products with a Lakehouse Architecture: Insights from BARC & Dremio

read more
get started

Get Started Free

No time limit - totally free - just the way you like it.

Sign Up Now
demo on demand

See Dremio in Action

Not ready to get started today? See the platform in action.

Watch Demo
talk expert

Talk to an Expert

Not sure where to start? Get your questions answered fast.

Contact Us

Ready to Get Started?

Enable the business to accelerate AI and analytics with AI-ready data products – driven by unified data and autonomous performance.