The Dremio Blog

In today's data-driven world, organizations are constantly seeking innovative tools and technologies to harness the power of their data.

Apache Iceberg is an open table format that enables robust, affordable, and quick analytics on the data lakehouse and is poised to change the data industry in ways we can only begin to imagine. Check out our Apache Iceberg 101 course to learn all the nuts and bolts about Iceberg. By storing your data in […]

Apache Iceberg is a data lakehouse table format that has been taking the data world by storm with robust support from tools like Dremio, Fivetran, Airbyte, AWS, Snowflake, Tabular, Presto, Apache Flink, Apache Spark, Trino, and so many more. Although one of the tools most data professionals use is Apache Spark and many introductory tutorials […]

Generative AI can be a powerful tool for data engineers, but it must be used responsibly and effectively.

This blog discusses how to streamline data quality and do audits for your Apache Iceberg tables using write-audit-publish and branching

In this blog we introduce a new CLI tool that allows us to easily and quickly migrate Apache Iceberg tables from one catalog to another without data copy.

Modernizing Hadoop infrastructure is essential in today's data-driven landscape. Learn how to boost performance through proven Hadoop modernization strategies.

The top 5 trends in data engineering are explored in this article

Apache Iceberg has a wide Python footprint to allow you to do the work you need to do. Whether you use pySpark, ODBC/Arrow to send SQL to engines like Dremio or use pyIceberg to do local scans of your table with DuckDB, Iceberg has a lot to offer data practitioners who love writing Python.

In this article, we will discuss how you can use technologies like Dremio and DuckDB in conjunction to create a low-cost, high-performance data lakehouse environment that is accessible to all your users.

Apache Iceberg, with its ever-expanding features, ecosystem, and support, is quickly becoming the standard format data lakehouse table. When adopting Apache Iceberg there are several paths of migration no matter where your data architecture currently resides.

This article explores how you can use Dremio Cloud to easily convert CSV files into an Iceberg table, allowing you to have more performant queries, run DML transactions, and time-travel your dataset directly from your data lakehouse storage.

Fivetran officially released their connector to Amazon S3, and is an easy way for data teams to automatically populate their data lakehouse with Apache Iceberg tables. This blog shows how data teams can easily use Fivetran and Dremio to build their open data lakehouse.

Introducing Domo's new native connector to Dremio

This blog introduces the newly added branching and tagging capabilities for Iceberg tables using Spark.