Covering Indexes in the Data Lake with Hyperspace

How can ‘Data processing and querying in the Data Lake at scale’ can be improved? Given that our Data Lake supports hundreds of customers with wide (thousands of columns), heavy (10 and 100 TB of data), and fast changing (thousands of appends/deletes/etc) datasets, we need reliability and scalability for a fast changing data environment. At Adobe Experience Platform we try to use the right tools for the right use case. So for our Data Lake, we chose to Apache Iceberg as our core foundation and Hyperspace as our indexing subsystem. In this session, Andrei Ionescu explains how Hyperspace integrates with Iceberg and other formats to speedup the processing time while keeping the data consistent and performant. Watch to the end of the talk to see a demo of Apache Iceberg and Hyperspace.

Topics Covered

Table Formats
Unlocking Potential with Apache Iceberg

Ready to Get Started? Here Are Some Resources to Help

Whitepaper Thumb


Simplifying Data Mesh for Self-Service Analytics on an Open Data Lakehouse

read more
Whitepaper Thumb


Dremio Upgrade Testing Framework

read more
Whitepaper Thumb


Operating Dremio Cloud Runbook

read more
get started

Get Started Free

No time limit - totally free - just the way you like it.

Sign Up Now
demo on demand

See Dremio in Action

Not ready to get started today? See the platform in action.

Watch Demo
talk expert

Talk to an Expert

Not sure where to start? Get your questions answered fast.

Contact Us

Ready to Get Started?

Bring your users closer to the data with organization-wide self-service analytics and lakehouse flexibility, scalability, and performance at a fraction of the cost. Run Dremio anywhere with self-managed software or Dremio Cloud.