Delta Lake

Databricks Delta Lake is an analytics engine that provides a transactional storage layer built on top of Apache Spark. It helps users build production data pipelines at scale and provides a consistent view of the data to end users.