Dremio 4.6 Feature Summary

Today we are excited to announce the release of Dremio 4.6.

This month’s release of Dremio delivers new features such as support for AWS Glue Data Catalog, the ability to open datasets directly in Power BI, a new and improved engine management interface, hourly pricing for Dremio AWS edition, new SQL functionality and more. In total, this release includes 153 improvements!

Here is the complete list of updates:

• Support for AWS Glue Data Catalog
• Hourly paid Dremio AWS Enterprise Edition
• Enhanced engine management console
• Enhanced Power BI integration
• Easy time zone conversion

Support for AWS Glue Data Catalog

AWS Glue is a fully managed service that makes it easy for customers to prepare and load their data for analytics. Users can create and run ETL jobs in the AWS Management Console and then point AWS Glue at their data AWS Glue discovers the data and stores the associated metadata in the AWS Glue Data Catalog, which is largely compatible with the Hive Metastore. Once cataloged, the data is immediately searchable, queryable, and available for further analysis by tools that integrate with the AWS Glue Catalog.

In Dremio 4.6 we are making it possible to connect Dremio to the AWS Glue Catalog. From the Dremio UI users can add Amazon Glue Data Catalog as a data source and start querying the datasets defined within Glue. In addition, this makes it easy for Athena users to adopt Dremio, which is 100x faster than Athena for BI queries, and 6-10x faster for ad-hoc queries (while still maintaining a 2-3.5x cost savings). This feature is available in all editions of Dremio.

Dremio AWS Edition Improvements

Hourly Pricing

A few months ago we announced Dremio AWS Edition, this edition of Dremio is a production-grade, high-scale data lake engine highly optimized for AWS to eliminate costs for idle compute and thus further reduce infrastructure compute costs by over 60%.

Today we are excited to announce that in Dremio 4.6 we are introducing a new hourly pricing option for Dremio AWS Edition in the AWS Marketplace. This will enable users to take advantage of enterprise edition features of Dremio on an hourly basis. This marketplace listing option will be available soon.

New Engine Management console

One of the key features of Dremio AWS Edition is elastic engines, this feature allows users to provision multiple separate execution engines from a single Dremio coordinator node, start and stop based on predefined workload requirements at runtime. Building on the productivity features that Dremio AWS edition brings to its users, this release delivers a simplified and much more intuitive engine management console.

The new engine console focuses on key attributes such as the size, status and actions across all configured engines. This makes it much easier for users to identify node status, and get a better view of engine assignment for different WLM queues.

In addition, each engine includes a dedicated page where administrators can easily view additional details such as the status of individual nodes as well as the queues assigned to an engine.

One-click Power BI integration

Starting in Dremio 4.6, connecting to Power BI is much easier. Building on the new capabilities that Power BI announced recently, users now can click on a Power BI button from a Dremio dataset which will take them directly to a Power BI workbook to continue analyzing their data.

Timezone conversion

Dremio 4.6 provides a dedicated SQL function that allows users to convert a timestamp from one timezone to another using the following syntax:

<figure class="highlight">
<pre><code class="language-shell" data-lang="shell"></code></pre>
<table class="rouge-table">
<tbody>
<tr>
<td class="gutter gl">
<pre class="lineno">1</pre>
</td>
<td class="code">
<pre>CONVERT_TIMEZONE <span class="o">([</span>source_tx',] , 'timestamp'<span class="o">)</span> </pre>
</td>
</tr>
</tbody>
</table>
<pre><code class="language-shell" data-lang="shell"></code></pre>
<p><code class="language-shell" data-lang="shell"></code><code class="language-shell" data-lang="shell"></code><code class="language-shell" data-lang="shell"></code><code class="language-shell" data-lang="shell"></code></p>
</figure>

The convert_timezone function supports standard time zone names such as: ‘America/New_York’; time zone abbreviations like ‘EDT’, and manual time offset i.e ‘-7:30’. We also included system tables that will automatically list for users the timezone names and time zone abbreviations from within Dremio. This will make it easier for users to find available time zones and abbreviations without having to navigate through documentation. To learn more about this feature please visit the release notes for Dremio 4.6.

Wrapping up!

We are very excited about this release and its capabilities and we hope you are too. As always, we look forward to your feedback. For a complete list of additional new features, enhancements and changes, please review the release notes, which includes information about additional new features and numerous improvements and fixes. Please post any questions on our community site and we’ll do our best to answer them there, along with other members of the Dremio community.