Bloomberg’s Enterprise Data business has accumulated petabytes of historical financial data by taking point-in-time “snapshots” of financial entities and their attributes over four decades. Historical financial data is critical in backtesting models, evaluating risk, regulatory reporting, evaluating data quality, and more. Our Enterprise Data Lake engineering group ingested all historical text files (plus the ongoing snapshots that continue flowing in) into Apache Iceberg tables. This talk will include an overview of the challenges our organization needed to address, the open source architecture/tools we chose (Iceberg, Trino, etc.), and the impact this initiative has had on our business.
Sam Pringle
Sam Pringle joined Bloomberg’s Enterprise Content group as a Software Engineer after studying computer science at UC Berkeley. He currently leads the Enterprise Data Lake team, which aims to help internal and external clients fully leverage Bloomberg’s historical and ongoing data.
Moonfare replaced a PostgreSQL-based data warehouse on Amazon Web Services (AWS) with a Dremio data lakehouse to offer data engineers, analysts and business users a high performance platform for business intelligence and predictive analytics empowering them to make better data-driven decisions.
read more
Deutsche Bahn Group (DB) is one of the world's leading mobility and logistics companies. The DB Cargo business unit manages DB's rail freight business.
read more
Amazon's Supply Chain Finance Analytics team developed a new analytics architecture with Dremio to simplify ETL processes, accelerate queries, and provide analytics on a unified view of the data.
read more
