Premium Only Content

Realtime Change Data Capture Streaming | End to End Data Engineeering Project
In this video, we dive deep into the world of Change Data Capture (CDC) and how it can be implemented for real-time data streaming using a powerful tech stack. You will use the integration of technologies like Docker, Postgres, Debezium, Kafka, Apache Spark, and Slack to create an efficient and responsive data pipeline.
Master Data Engineering by enrolling at datamasterylab.com
Timestamps:
0:00 Introduction
0:35 The system architecture
14:40 Getting live data into postgres db
31:00 Connecting to Postgres with Debezium and Kafka from the UI
34:35 Previewing Debezium data on Kafka
37:25 Getting full data from Postgres with Debezium
39:55 Setting up debezium connector from the terminal
41:00 Handling decimal values on debezium
46:00 Getting the user that changed data on postgres with time
53:17 Creating a more robust data capture on postgres
1:03:31 Outro
Don't forget to SUBSCRIBE, LIKE, COMMENT and SHARE for more exciting videos!
🔹 Connect with Us:
Follow us on Twitter: x.com/@DataMasterylab
Follow us on LinkedIn: https://www.linkedin.com/in/yusuf-ganiyu-b90140107
Tags:
Change Data Capture, CDC, Real-Time Streaming, Docker, Postgres, Debezium, Kafka, Apache Spark, Slack, Data Engineering, Data Pipeline, Tech Tutorial, Software Development, Data Streaming, IT Education, End to End Data Engineering
Hashtags:
#ChangeDataCapture #RealTimeData #Docker #Postgres #Debezium #Kafka #ApacheSpark #Slack #DataEngineering #TechTutorial #SoftwareDevelopment #DataStreaming #ITEducation #bigdataanalytics #EndToEndDataEngineeringProject
-
LIVE
Matt Kohrs
9 hours agoTrump Tanks Stocks, Breaking Market News & Payday Friday || Live Trading
675 watching -
LIVE
Wendy Bell Radio
4 hours agoBUSTED
7,493 watching -
LIVE
JuicyJohns
1 hour ago🟢#1 REBIRTH PLAYER 10.2+ KD🟢$500 GIVEAWAY SATURDAY!
125 watching -
LIVE
LFA TV
13 hours agoLFA TV ALL DAY STREAM - FRIDAY 8/1/25
7,292 watching -
LIVE
The Bubba Army
23 hours agoHulk Hogan had Leukemia? - Bubba the Love Sponge® Show | 8/01/25
2,179 watching -
18:36
DeVory Darkins
8 hours ago $3.55 earnedTrump scores MAJOR WIN with Americas youth as Biden drops HORRIBLE speech
8.44K27 -
14:13
Clickbait Wasteland
14 hours ago $4.28 earnedAsking New Yorkers Who they Support for Mayor: Harlem
29.9K27 -
19:55
The Rad Factory
16 hours ago $1.33 earnedCan I Fix My Fire Damaged F1 Car?
12.8K2 -
1:26:22
Dialogue works
2 days ago $0.36 earnedScott Ritter: Russia Just DEFIED the U.S.: We'll End the War on OUR Terms!
3.35K10 -
2:00:40
BEK TV
1 day agoTrent Loos in the Morning - 8/01/2025
13.5K1