Dremio Executives Predict Top Data Lakehouse and AI Trends for 2024
Read the full article via VMBlog.
The year 2023 was dominated by the advancement and mainstream acceptance of AI, from industry to culture. The exponential rise of generative AI has shown that there are applications that can help every single industry thrive. One technology category we saw that flew under the radar was the rise of data lakehouses.
The rise will continue once again into the new year and beyond. 70% of IT professionals think that more than half of all analytics will be on the data lakehouse within three years, and 86% believe that their organization plans to unify its analytics data. This can lead to cost efficiency and ease of use for its users.
The combination of artificial intelligence and data lakehouses empowers organizations to achieve their potential beyond traditional approaches to querying data. The ability to use natural language-to-SQL generative interfaces can help easily interact with data, eliminate manual repetitive tasks and take action to build a domain-specific AI application in a timely and efficient manner, giving time and power back to the people, allowing time and space for innovation.
Dremio CEO Sendur Sellakumar, CMO Read Maloney and Data & Analytics Product, Strategy, & Enterprise Architecture Leader Nik Acheson offer their predictions for the upcoming year and what trends they expect to emerge in AI, data lakehouses and more.
Practice makes perfect
"In 2024, we're going to see development best practices, in terms of code, make their way into data. The concepts of data uptime and data downtime, which are related to data observability and part of data operations, will come in.
Users have different ways to ensure the quality, and that if something goes wrong, you can pinpoint where it went wrong, saving you precious time. The increased complexity and costs are taking engineers away from the more important things and what they want to do, which is much higher value projects than shoveling data all day long." - Read Maloney
Generative AI hype train will continue to grow exponentially
"I think we're still in a GenAI hype cycle, and I tend to be very practical. Things around GenAI have been very compelling. We hardly talked about GenAI a year ago; now we do, which is excellent. The things we're doing now are going to be vastly different from what we're doing today. You have lots of models that will change a year from now dramatically, one will become more popular than another and it will evolve.
Generative AI will be the future of user interfaces. All applications will embed generative AI to drive user interaction, which guides user productivity. Companies are embedding GenAI to do semantic searching to solve some of those old data problems - discovery becomes easier, creating pipelines becomes more accessible." - Sendur Sellakumar
A new sheriff in town
"The adoption of Apache Iceberg will be huge in 2024 - it's going to be the open format for interoperability and the customer choice for flexibility. For us, it comes back to the customer and they want to own their own data, and we think Apache Iceberg is the format for that. It's going to take over as the open standard in 2024.
Data contracts pick up
"We talk a lot about data products, fabric and mesh, but the thing we continue to ignore is what does it look like to continue to mature these assets in the enterprise? That moves into things like data governance and stewardship. I think a big trend is going to be how you make it real for the enterprise." - Nick Acheson
