Dremio Offers New Ingestion Automation, Optimization Features for Apache Iceberg Data Lakehouse

April 10, 2024

Dremio, the unified lakehouse platform for self-service analytics and AI, has unveiled new capabilities that simplify the process of building and managing an Apache Iceberg data lakehouse. Available immediately, the latest version reduces tedious, manual tasks critical to data management with new capabilities that include ingestion, processing, and migration. By automating Iceberg management processes, Dremio reduces total cost of ownership (TCO) and enhances data team productivity and improves overall time-to-insight.

Dremio has expanded the functionality and capability of its solution in three key areas:

  • Ingestion. With support for high-speed streaming from Kafka into Iceberg, organizations can now effortlessly ingest data in real time and enable near-real-time analytics on the data lakehouse.
  • Migration. New streamlined migration from legacy data lake formats such as Apache Parquet to Apache Iceberg makes it easier for companies to transition from a traditional data lake to a modern lakehouse. The platform can seamlessly convert raw data from data lakes, data warehouses, relational databases, and NoSQL databases into Apache Iceberg, both in the cloud and on premises, making Iceberg adoption rapid, easy, and error-free.
  • Optimization. Dremio’s query acceleration technology (called Reflections) now allows users to achieve sub-second BI performance on Iceberg tables of any size without managing BI extracts/imports or aggregation tables in the lakehouse/warehouse. Reflections are updated incrementally and transactionally based on the updates to the Iceberg tables, thereby drastically reducing the time and cost to update Reflections with new data.

Read more, via TDWI.

get started

Get Started Free

No time limit - totally free - just the way you like it.

Sign Up Now
demo on demand

See Dremio in Action

Not ready to get started today? See the platform in action.

Watch Demo
talk expert

Talk to an Expert

Not sure where to start? Get your questions answered fast.

Contact Us

Ready to Get Started?

Bring your users closer to the data with organization-wide self-service analytics and lakehouse flexibility, scalability, and performance at a fraction of the cost. Run Dremio anywhere with self-managed software or Dremio Cloud.