The Dremio Blog

The allure of the data lakehouse architecture, particularly with the Apache Iceberg table format, lies in its ability to be utilized across various systems, eliminating the need for expensive data movement and migration planning. In this article, we will explore how Apache Iceberg tables are employed within Dremio—a data lakehouse platform that serves as a […]

Dremio Cloud on Microsoft Azure brings your users closer to the data with lakehouse flexibility, scalability, and performance at a fraction of the cost of traditional data warehouses. With the availability of Dremio Cloud on Azure, companies can now take full advantage of a next-generation analytical architecture that eliminates traditional software management pain and drives […]

In today's data-driven world, organizations are increasingly relying on data analytics platforms to derive valuable insights from their data. Increasingly, organizations are battling to cope with the diversity of their data estate and enforcing access and privacy controls consistently. A powerful solution is coming from two popular platforms in this space which are Dremio, known […]

Subsurface provides an excellent opportunity to learn more about the Data Lakehouse space. Still, for fans of Apache Iceberg, there will be a lot of content to keep you learning and interested. Register for Subsurface today.

By enabling efficient, real-time analytics directly from data lakes, Dremio provides organizations with the tools they need to navigate the complexities of big data, derive actionable insights, and maintain a competitive edge in the digital age.

Choosing the right versioning solution involves considering your organization's specific data management needs, existing infrastructure, and the desired level of granularity for version control. Whether you prioritize the flexibility of file-level versioning with LakeFS, the seamless table-level versioning of Apache Iceberg, or the comprehensive catalog-level versioning offered by Nessie, each system presents a pathway to more efficient, reliable, and manageable data operations.

Tabular and Dremio have received approval from the Apache Iceberg Project Management Committee to organize the inaugural Iceberg Summit, a free-to-attend virtual event to be held May 14 - 15, 2024. Iceberg Summit is an Apache Software Foundation (ASF) sanctioned event. Those wishing to attend can register here. Your information will only be used for […]

Learn how to take advantage of Dremio Arctic’s capability to help monitor data quality, recover from mistakes, and audit data.

Dremio's approach to lakehouse management embodies a forward-thinking solution to the challenges of modern data architecture. By integrating Git-for-Data concepts, automating Apache Iceberg table maintenance, and providing an easy-to-use UI for monitoring data catalogs, Dremio not only simplifies data management but also empowers organizations to harness their data for strategic advantage.

DataOps represents a paradigm shift in managing and utilizing data across organizations. By adopting DataOps principles, companies can ensure their data lakehouse architecture is not just a repository of information but a dynamic, efficient engine for innovation and growth.

Nessie's integration with platforms like Dremio demonstrates the significant value that version control brings to the data lakehouse architecture. Whether through the cloud-based ease of Dremio Cloud or the flexible, self-managed approach with Dremio software, Nessie is set to redefine how organizations manage, collaborate on, and deploy their data assets.

By unifying data from diverse sources, simplifying data operations, and providing powerful tools for data management, Dremio stands out as a comprehensive solution for modern data needs. Whether you are a data engineer, business analyst, or data scientist, harnessing the combined power of Dremio and Apache Iceberg will undoubtedly be a valuable asset in your data management toolkit.

Data lakehouse, data virtualization, and data mesh trends significantly shift how we approach data management, addressing today's growing scale, speed, and complexity.

Dremio also facilitates a gradual and flexible adoption process. Organizations can start small, using only the necessary components, and scale up as their requirements grow. This approach reduces the initial investment and complexity, making it easier for businesses to transition to a data lakehouse architecture at their own pace.

Integrating technologies like Apache Arrow, reflections, and the Columnar Cloud Cache (C3) in Dremio's platform brings a new era in query performance on the data lake. The benefits of these technologies extend beyond just improved query performance; they contribute to a more cost-effective and efficient data management strategy.