Apache Tez

What is Apache Tez?

Apache Tez is a data processing tool framework that forms part of the Hadoop ecosystem, designed with the goal of efficiently processing large sets of data. Alongside other Hadoop elements like YARN for cluster management and the Hadoop Distributed File System (HDFS), Tez can offer powerful, flexible computational capabilities in a big data context.


Launched in 2013 by the Apache Software Foundation, Tez was built to improve upon the data processing capabilities of Apache Hadoop’s MapReduce system. The latest version, Apache Tez 0.9.2, was released in 2020.

Functionality and Features

Tez improves upon MapReduce by allowing expressivity of complex data processing tasks while retaining the ability to handle vast amounts of data. Key features of Apache Tez include:

  • Native Handling of Complex Data Flow: Tez enables direct acyclic graph (DAG) tasks, which are more expressive and versatile than simple MapReduce tasks.
  • Performance Optimization: Tez employs dynamic physical data flow decisions, like pipelining, to improve efficacy.
  • Flexible and Scalable: As part of the Hadoop ecosystem, Tez can scale effectively with Hadoop clusters.


Apache Tez is based on the dataflow programming model and aims to bridge the gap between the high-level declarative nature of Hive, Pig, and other domain-specific languages, and the low-level, procedural model used in MapReduce.

Benefits and Use Cases

Tez delivers improved performance and resource management in big data processing. Its use cases typically include:

  • Big Data Analysis: Coupled with tools like Apache Hive, Tez can analyze large datasets more efficiently than MapReduce.
  • Real-Time Processing: Embedded in applications, Tez provides accelerated batch processing and near real-time processing.

Challenges and Limitations

Despite its advantages, Apache Tez has certain limitations including the lack of built-in support for data streaming and machine learning workloads. In particular, Apache Tez struggles with iterative operations, resulting in lower performance compared to Spark.

Integration with Data Lakehouse

In a data lakehouse setup, Apache Tez can support query and analytic workloads on the semi-structured and structured data stored in the lakehouse. However, modern lakehouse architectures may rely more on platforms like Databricks, which has better support for real-time processing, machine learning, and streaming workloads.

Security Aspects

As part of the Hadoop ecosystem, Tez inherits Hadoop's security features, including Kerberos authentication, access control lists, and encryption.


Apache Tez is noted for its enhanced performance in big data analytics, particularly when compared to traditional MapReduce. However, when it comes to real-time applications, Tez may not be as efficient as other platforms like Apache Spark.


What are some alternatives to Apache Tez? Some alternatives to Apache Tez include Apache Flink, Apache Spark, and Databricks.

Why would one choose Apache Tez over MapReduce? Apache Tez offers better performance, is more flexible, and can handle more complex tasks than MapReduce.


Dataflow Programming Model: A model that represents a series of computations as a directed graph.

Apache Spark: An open-source, distributed computation system used for big data processing and analytics.

Hadoop Distributed File System (HDFS): A distributed file system designed to store large data sets across clusters of commodity hardware.

YARN: Yet Another Resource Negotiator, YARN is the architectural center of Hadoop and is responsible for resource management and job scheduling.

Data Lakehouse: A new hybrid data management architecture combining the features of data warehouses and data lakes.

get started

Get Started Free

No time limit - totally free - just the way you like it.

Sign Up Now
demo on demand

See Dremio in Action

Not ready to get started today? See the platform in action.

Watch Demo
talk expert

Talk to an Expert

Not sure where to start? Get your questions answered fast.

Contact Us

Ready to Get Started?

Bring your users closer to the data with organization-wide self-service analytics and lakehouse flexibility, scalability, and performance at a fraction of the cost. Run Dremio anywhere with self-managed software or Dremio Cloud.