Dremio, the unified lakehouse platform for self-service analytics and AI, has unveiled new capabilities that simplify the process of building and managing an Apache Iceberg data lakehouse. Available immediately, the latest version reduces tedious, manual tasks critical to data management with new capabilities that include ingestion, processing, and migration. By automating Iceberg management processes, Dremio reduces total cost of ownership (TCO) and enhances data team productivity and improves overall time-to-insight.
Dremio has expanded the functionality and capability of its solution in three key areas:
- Ingestion. With support for high-speed streaming from Kafka into Iceberg, organizations can now effortlessly ingest data in real time and enable near-real-time analytics on the data lakehouse.
- Migration. New streamlined migration from legacy data lake formats such as Apache Parquet to Apache Iceberg makes it easier for companies to transition from a traditional data lake to a modern lakehouse. The platform can seamlessly convert raw data from data lakes, data warehouses, relational databases, and NoSQL databases into Apache Iceberg, both in the cloud and on premises, making Iceberg adoption rapid, easy, and error-free.
- Optimization. Dremio’s query acceleration technology (called Reflections) now allows users to achieve sub-second BI performance on Iceberg tables of any size without managing BI extracts/imports or aggregation tables in the lakehouse/warehouse. Reflections are updated incrementally and transactionally based on the updates to the Iceberg tables, thereby drastically reducing the time and cost to update Reflections with new data.
Read more, via TDWI.
