Premium Only Content

Realtime Change Data Capture Streaming | End to End Data Engineeering Project
In this video, we dive deep into the world of Change Data Capture (CDC) and how it can be implemented for real-time data streaming using a powerful tech stack. You will use the integration of technologies like Docker, Postgres, Debezium, Kafka, Apache Spark, and Slack to create an efficient and responsive data pipeline.
Master Data Engineering by enrolling at datamasterylab.com
Timestamps:
0:00 Introduction
0:35 The system architecture
14:40 Getting live data into postgres db
31:00 Connecting to Postgres with Debezium and Kafka from the UI
34:35 Previewing Debezium data on Kafka
37:25 Getting full data from Postgres with Debezium
39:55 Setting up debezium connector from the terminal
41:00 Handling decimal values on debezium
46:00 Getting the user that changed data on postgres with time
53:17 Creating a more robust data capture on postgres
1:03:31 Outro
Don't forget to SUBSCRIBE, LIKE, COMMENT and SHARE for more exciting videos!
🔹 Connect with Us:
Follow us on Twitter: x.com/@DataMasterylab
Follow us on LinkedIn: https://www.linkedin.com/in/yusuf-ganiyu-b90140107
Tags:
Change Data Capture, CDC, Real-Time Streaming, Docker, Postgres, Debezium, Kafka, Apache Spark, Slack, Data Engineering, Data Pipeline, Tech Tutorial, Software Development, Data Streaming, IT Education, End to End Data Engineering
Hashtags:
#ChangeDataCapture #RealTimeData #Docker #Postgres #Debezium #Kafka #ApacheSpark #Slack #DataEngineering #TechTutorial #SoftwareDevelopment #DataStreaming #ITEducation #bigdataanalytics #EndToEndDataEngineeringProject
-
LIVE
RalliedLIVE
1 day ago $0.60 earnedBattlefield 6 REVEAL w/ Ral
359 watching -
1:42:17
The Quartering
2 hours agoHillary Clinton FINALLY BUSTED, Nancy Pelosi MELTDOWN, Kamala Harris Admits Defeat & More
84.2K23 -
LIVE
Barry Cunningham
7 hours agoMUST SEE: KAROLINE LEAVITT HOSTS WHITE HOUSE PRESS CONFERENCE ( AND MORE NEWS)
1,364 watching -
53:03
Sean Unpaved
3 hours agoSchlereth Unplugged: 3x Champ Talks TV, Football, & 2025 Season Expectations
14.9K -
1:03:28
Russell Brand
3 hours agoCan You Really Take an Unbiased Look at Hitler? - SF624
118K76 -
12:39
Michael Button
5 hours ago $0.84 earnedAn Entire Civilization Might Be Buried Under the Sahara
10.4K4 -
4:38
Michael Heaver
11 hours agoShifting UK Triggers Rapid REVOLUTION
7.72K1 -
58:53
The White House
3 hours agoPress Secretary Karoline Leavitt Briefs Members of the Media, July 31, 2025
24.3K33 -
5:48:07
JuicyJohns
7 hours ago $3.09 earned🟢#1 REBIRTH PLAYER 10.2+ KD🟢$500 GIVEAWAY SATURDAY!
74.4K3 -
IrishBreakdown
3 hours agoNotre Dame Fall Camp Practice Report
18.1K1