How To Share A Query Profile

   
  • Dremio

Table of Contents

Table of Contents

Intro

In this tutorial we’ll show you how to share a Dremio query profile. Query profiles store important metadata about queries that you run in Dremio, and can make it easier to help Dremio’s engineers debug any issues you encounter.

Prerequisites

You will require access to a Dremio deployment and have at least one data source connected. Alternatively, you can still follow the tutorial but you won’t be able to try out the steps yourself.

Dremio Jobs

In Dremio most work is managed as jobs, including all queries. Dremio keeps a history of all jobs so you can easily take a closer look at how a job was executed. This is where you’ll find information about who submitted the query, how long it ran, the number of results, the SQL that was submitted, and comprehensive profile information.

Let’s look at an example. First, open one of your datasets. Here we’ll use the SF_Incidents2016.json physical dataset from Working With Your First Dataset:

How to share a query profile - Dremio

To preview this dataset, Dremio executed a preview query against the JSON file on Amazon S3. We can now click on Jobs to see the history of jobs in Dremio:

How to share a query profile - Dremio

Now we see a list of jobs on the left, and a detailed view of the selected job on the right:

How to share a query profile - Dremio

Finding Your Job

In this case the first job is the one we just ran. However, in most cases the job you’re looking for may not be at the top of the list. Dremio makes it easy to find a job by using the filters that let you narrow jobs down by time, job status, and which process or user created the job:

How to share a query profile - Dremio

You can also search based on text included in the job, such as a column or table name you used in a query:

How to share a query profile - Dremio

Downloading Your Profile

Once you’ve identified the job you want to investigate, select it on the left in order to view it on the right. Let’s look at the job we issued on the police incidents data:

How to share a query profile - Dremio

Let’s take a look at how to share this profile with others. At the bottom of the job details you can see a friendly narwhal with a button to “Download Profile.” If you click this button, detailed profile information will be downloaded as a zip file.

You can now share this zip file with a Dremio engineer to help understand any issues you may be encountering. Note that none of your data is stored in the profile, only metadata about your query and underlying datasets.

Ready to Get Started? Here Are Some Resources to Help

Alteryx Analytic Platform and Dremio Open Lakehouse combine to simplify data operations and enable broad access to the data lake

Webinars

Unlocking Analytics from your Data Lake with Alteryx and Dremio

As a result of the accelerated growth of data lakes, data teams have been forced to either build and maintain expensive and complex processes to make new sources of data available for use in proprietary data warehouses, or hinder access to analytics for all data consumers. In this webinar, learn how the Alteryx Analytic Platform and Dremio Open Lakehouse combine to simplify data operations and enable broad access to the data lake for exploration, discovery, and insights.

read more

Webinars

How Open Lakehouses Simplify Analytics on Cloud Data Lakes

Cloud migration affords your organization the opportunity to rethink the fundamental architecture of corporate reporting and analytics system design. This webinar explores how cloud resources and services eliminate the need for costly data warehouse solutions that require significant data integration and preparation efforts.

read more

Guides

Data Virtualization vs. Data Lakes

Businesses need to aggregate data sources to be able to use the data. Data virtualization and data lakes are popular approaches, but which to choose?

read more

Get Started Free

No time limit - totally free - just the way you like it.

Sign Up Now

Watch Demo

Not ready to get started today? See the platform in action.

Check Out Demo