Apache Spark

Apache Spark is an open-source unified analytics engine for large-scale data processing. Spark provides an interface for programming entire clusters with implicit data parallelism and fault tolerance.
...
Table Formats Nessie Metastores File Formats Data Lake Engines CSV Apache Spark Apache Iceberg
September 27, 2021

Project Nessie: Transactional Catalog for Data Lakes with Git-like semantics

Read more
...
Dremio Data Lake Engines Business Intelligence Apache Superset Apache Spark
July 21, 2021

Driving Better Analytics Using Cloud Data Lakes

Read more
...
Table Formats Data Lake Engines Apache Spark Apache Iceberg
July 21, 2021

Enabling Analysts to Build a Lakehouse with Spark SQL and Iceberg

Read more
...
Azure Data Lake Storage Apache Spark Apache Iceberg
January 27, 2021

Iceberg at Adobe: Challenges, Lessons & Achievements

Read more
...
Data Lake Storage Apache Spark
January 21, 2021

Serverless Cloud Data Lake with Spark for Serving Weather Data

Read more
...
Apache Spark Apache Arrow Flight
July 29, 2020

Building an Efficient Data Pipeline for Data Intensive Workloads

Read more
Videos from Subsurface LIVE are now online! Listen to The Subsurface Podcast