Using the Data Mesh Architecture to Democratize Data and Accelerate Time to Insight
Data lake storage has enabled enterprises to significantly increase the sources of data used for generating business insights. However, the pace of new data sources and integration-related work have created problems for centralized data engineering and reporting teams. They struggle to keep pace with the flood of requests and to ramp up on the business domain expertise needed. The net result is slower time to insight and lost opportunity. The Data Mesh architecture federates the data estate, enabling each organization to control prioritization and use their domain knowledge to accelerate onboarding and build data products outside the central team. At the same time, it enforces enterprise governance standards on each organization and facilitates cross organization data sharing. In this session, Piethein will share details of the Mesh-based solution he architected for ABN AMRO, the third largest bank in the Netherlands.
Piethein Strengholt is the writer of the book Data Management at Scale. Prior to Microsoft he used to work for ABN AMRO as the Chief Data Architect.