Demo-ing a 3-step OLTP database replication to data lake tables

OLTP databases are a key source of data for analytics. Many CDC tools land database changes in a cloud object storage but can’t automatically provide and maintain query-able tables.Upsolver’s new CDC capability comes with unique features such as:

A simple 3 step flow to build the replication pipeline
UPSERT support for replica consistency
Stateful transformations
Automatic table optimization
Dynamic table split based on key field
Schema evolution handling
Rewind and replay data

This talk will cover

Popular methods for database replication
The challenges with replicating a database into data lake tables
What Upsolver CDC offers that’s new and exciting
A live demo of Upsolver CDC in action

Topics Covered

Amazon S3

Data Lake Storage

Speakers

Ori Rafael

Ori Rafael is co-founder and CEO of Upsolver, the only no-code data lake engineering platform. He has more than 15 years of experience in databases, data integration and big data. Before founding Upsolver he held a variety of technology management roles in the Israeli Defense Force (IDF) elite technology intelligence unit.

Ready to Get Started? Here Are Some Resources to Help

Webinars

Smart Data – Smart Factory with Octotronic and Dremio

Guides

What Is a Data Lakehouse?

The data lakehouse is a new architecture that combines the best parts of data lakes and data warehouses. Learn more about the data lakehouse and its key advantages.

Whitepaper

Simplifying Data Mesh for Self-Service Analytics on an Open Data Lakehouse

The adoption of data mesh as a decentralized data management approach has become popular in recent years, helping teams overcome challenges associated with centralized data architecture.