Gnarly Data Waves
Episode 56
|
September 10, 2024
What’s New in Dremio: Improved Automation, Performance + Catalog for Iceberg Lakehouses
Discover the new Dremio capabilities designed to make your Apache Iceberg data lakehouse the most efficient, scalable, and manageable platform for analytics and AI. We’ll cover enhancements in performance, data ingestion, data processing, and federated query capabilities, aimed at helping you achieve the fastest, most scalable, and easiest to use lakehouse for all of your data.
Dremio unveiled new features in our latest release that enhance the creation, performance, and management of Apache Iceberg data lakehouses.
You will learn how Dremio delivers market-leading SQL query and write performance, improved federated query security and management as well as streamlined data ingestion by delivering:
– Live Reflections on Iceberg tables that will accelerate performance, ensure up-to-date data and reduce management overhead.
– Result Set Caching that can accelerate query performance up to 28X – Merge-on-Read that can enhance write and ingestion speed
– Auto Ingest Pipes that eliminate complex pipeline setup and maintenance
– User Impersonation for federated queries that allows for granular permissions, better access control, and user workload tracking
Watch or listen on your favorite platform
Speakers
Maeve Donovan
No Bio Available
Mark Shainman
Mark Shainman is a Principal Product Marketing Manager for Dremio. He has spent more than 20-years working in both the analytics as well as privacy, governance, and security space. He has worked with numerous data products and on numerous initiatives, including database migrations, data warehousing, big data, SQL on Hadoop, data lakes, federated query access, data cataloging, privacy compliance and, now, the data lakehouse.
Ready to Get Started? Here Are Some Resources to Help
Webinars
Cyber Lakehouse for the AI Era, ZTA and Beyond
Many agencies today are struggling not only with managing the scale and complexity of cyber data but also with extracting actionable insights from that data. With new data retention regulations, such as M-21-31, compounding this problem further, agencies need a next-generation solution to address these challenges.
read more