Events

[Vaccination 2022] Open-source Change Data Capture With Debezium (Gunnar Morling)

Event Date: Monday March 14, 2022
Event Time: 04:30pm EST
Location: https://cmu.zoom.us/j/95002789605?pwd=eEtJRnRaNnQ1bFZmTnUwbDRMaXBRQT09
Speaker: Gunnar Morling [INFO]

Title: Open-source Change Data Capture With Debezium

Change Data Capture (CDC) is one big enabler for your data; by reacting to changes in your database in “real-time”, CDC comes in handy for implementing a wide range of use cases, such as low-latency data updates from OLTP data stores to OLAP systems, caches, or search indexes, data exchange between microservices, building audit logs, and many more.

In this talk you’ll learn about Debezium, a distributed open-source log-based CDC platform for a variety of databases, such as Postgres, MySQL, Cassandra, MongoDB, and Vitess. We’ll not only explore what makes Debezium and CDC so interesting from a user’s perspective, but we’ll also dive into some of the technical challenges we encountered while implementing Debezium, such as preventing an indefinite growth of WAL files in Postgres, keeping track of the schema of captured tables as DDL statements come in, and strategies for snapshotting your initial data set before capturing data changes from transaction logs.

This talk is part of the Vaccination Database (Booster) Tech Talk Seminar Series.

Zoom Link: https://cmu.zoom.us/j/95002789605 (Passcode 982149)

Bio:
Gunnar Morling is a software engineer and open-source enthusiast by heart. He is leading the Debezium project, a distributed platform for change data capture. He is a Java Champion, the spec lead for Bean Validation 2.0 (JSR 380) and has founded multiple open source projects such as JfrUnit, Layrry, and MapStruct. Gunnar is an avid blogger (morling.dev) and has spoken at a wide range of conferences like QCon, Java One, Devoxx, JavaZone, and many others. He's based in Hamburg, Germany.

More Info: https://db.cs.cmu.edu/seminar2022-booster#db7