Gnarly Data Waves
Episode 57
|
September 24, 2024
From Hadoop & Hive to Minio & Dremio: Moving Towards a Next Gen Data Architecture
Join this session to learn how Legacy data platforms often struggle with performance, processing, and scaling for robust AI/ML initiatives, particularly in complex multi-cloud environments. The combined power of MinIO and Dremio creates a data lakehouse platform that overcomes these challenges. Learn how this architecture simplifies critical AI tasks, scales seamlessly to meet demands, and streamlines data management for IT teams.
Legacy data platforms often fall short of the performance, processing and scaling requirements for robust AI/ML initiatives. This is especially true in complex multi-cloud (public, private, edge, airgapped) environments. The combined power of MinIO and Dremio creates a data lakehouse platform that overcomes these challenges, delivering scalability, performance and efficiency to ensure successful AI initiatives.
Watch Brenna Buuck, Sr. Technical Evangelist at MinIO and Alex Merced, Sr. Technical Evangelist at Dremio provided insights on:
– AI Workflows: How a data lakehouse simplifies critical AI tasks like model training, refinement, feature selection and real-time inference for faster decisions
– Scalability and Performance: How a data lakehouse architecture scales seamlessly to meet the fast-growing demands of AI applications
– Data Management Efficiency: How a data lakehouse streamlines data management for IT teams, allowing them to focus on innovation
Watch or listen on your favorite platform
Register to view episode
Speakers
Brenna Buuck
No Bio Available
Alex Merced
Alex Merced is a Senior Tech Evangelist for Dremio, a developer, and a seasoned instructor with a rich professional background. Having worked with companies like GenEd Systems, Crossfield Digital, CampusGuard, and General Assembly.
Alex is a co-author of the O’Reilly Book “Apache Iceberg: The Definitive Guide.” With a deep understanding of the subject matter, Alex has shared his insights as a speaker at events including Data Day Texas, OSA Con, P99Conf and Data Council.
Driven by a profound passion for technology, Alex has been instrumental in disseminating his knowledge through various platforms. His tech content can be found in blogs, videos, and his podcasts, Datanation and Web Dev 101.
Moreover, Alex Merced has made contributions to the JavaScript and Python communities by developing a range of libraries. Notable examples include SencilloDB, CoquitoJS, and dremio-simple-query, among others.
Ready to Get Started? Here Are Some Resources to Help
Webinars
Cyber Lakehouse for the AI Era, ZTA and Beyond
Many agencies today are struggling not only with managing the scale and complexity of cyber data but also with extracting actionable insights from that data. With new data retention regulations, such as M-21-31, compounding this problem further, agencies need a next-generation solution to address these challenges.
read more