Data Analytics on The Data Lake Using Apache Superset

Naren Sankaran

Introduction

Apache Superset is a modern BI web application open source project that provides users with an intuitive, visual and interactive data exploration platform. Some of the key features that Superset offer are:

Over 30 types of visualizations
Easy to use constructor for visualizations
Easy to share and collaborate on dashboards
Enterprise-ready authentication
A simple semantic layer that allows users to decide which fields they want to use in their visualizations
And much more.

Superset 1.0 was released on January 21, 2021 and has graduated from the incubator to become a top-level project at the Apache Software Foundation. Superset provides first class connectivity to Dremio via ODBC and Arrow Flight. Preset offers a SaaS version of Apache Superset.

To get started with Apache Superset and Dremio, install the Dremio SQLAlchemy Connector in the VM where Apache Superset is running.

Creating a dataset and reflection in Dremio

To get started with Dremio, follow this tutorial. To continue with the rest of this blog post you will need to create a space called taxi and save a virtual dataset called trips in the taxi space. The location of this dataset in the sample source is: “samples.dremio.com”.”NYC-taxi-trips”

And create an aggregate reflection like below:

Configuring Dremio in Superset

Data > Databases > Add database:

ODBC Connection:

Arrow Flight Connection:

Change the hostname, username, password to point to your Dremio cluster.

Creating the trips dataset

Data > Databases > Add dataset:

Creating charts

Data > Charts > Add chart:

Creating a dashboard

Dashboards > Add dashboard:

You can do a live refresh:

And check the jobs page in Dremio to see the jobs that were executed by Dremio in sub-second:

To learn more about Dremio visit our tutorials and resources, also if you would like to experiment with Dremio on your own virtual lab, go ahead and checkout Dremio University, and if you have any questions visit our community forums where we are eager to help.

If you encounter any issues, please send an email to [email protected].

Ready to Get Started? Here Are Some Resources to Help

Using Data Mesh to Advance Distributed Data Access, Agility and Governance

Join this live fireside chat to learn about using Data Mesh to Advance Distributed Data Access, Agility and Governance.

Webinars

Smart Data – Smart Factory with Octotronic and Dremio

Guides

What Is a Data Lakehouse?

The data lakehouse is a new architecture that combines the best parts of data lakes and data warehouses. Learn more about the data lakehouse and its key advantages.