Self Serve Reporting at Scale via Change Data Capture and Delta

Business transactions captured in relational databases are critical to understanding the state of business operations. MiQ needed the relational data for analytical purposes and reporting. To avoid disruptions to operational databases, they replicated the data via Change Data Capture (CDC) and spark streaming into Delta tables.

In this session, learn how, Self-Serve Reporting, MIQ’s proprietary product, translates the data from traditional relational database systems via CDC and replicates them in a Big Data system using Spark Delta tables to generate reports for end customers, and how this system can be used to achieve high performance ad hoc and synchronous reporting.