Unsolved Challenges in Data Infrastructure

This talk is about evolving data infrastructure over the next five years. What are the big problems? And what challenges to do we need to solve to fix them?

We asked ourselves this question five years ago and the result was Apache Iceberg. This talk will introduce the problems that inspired Iceberg and propose what we think are the big, unsolved challenges for the next five years.

Download PDF

Speakers

Ryan Blue

Ryan Blue is the co-creator of Apache Iceberg, and he works on open source data infrastructure. He is also an Avro, Parquet, and Spark committer.

Ready to Get Started? Here Are Some Resources to Help

Using Data Mesh to Advance Distributed Data Access, Agility and Governance

Join this live fireside chat to learn about using Data Mesh to Advance Distributed Data Access, Agility and Governance.

Webinars

Smart Data – Smart Factory with Octotronic and Dremio

Guides

What Is a Data Lakehouse?

The data lakehouse is a new architecture that combines the best parts of data lakes and data warehouses. Learn more about the data lakehouse and its key advantages.