Premium Only Content

Realtime Change Data Capture Streaming | End to End Data Engineeering Project
In this video, we dive deep into the world of Change Data Capture (CDC) and how it can be implemented for real-time data streaming using a powerful tech stack. You will use the integration of technologies like Docker, Postgres, Debezium, Kafka, Apache Spark, and Slack to create an efficient and responsive data pipeline.
Master Data Engineering by enrolling at datamasterylab.com
Timestamps:
0:00 Introduction
0:35 The system architecture
14:40 Getting live data into postgres db
31:00 Connecting to Postgres with Debezium and Kafka from the UI
34:35 Previewing Debezium data on Kafka
37:25 Getting full data from Postgres with Debezium
39:55 Setting up debezium connector from the terminal
41:00 Handling decimal values on debezium
46:00 Getting the user that changed data on postgres with time
53:17 Creating a more robust data capture on postgres
1:03:31 Outro
Don't forget to SUBSCRIBE, LIKE, COMMENT and SHARE for more exciting videos!
🔹 Connect with Us:
Follow us on Twitter: x.com/@DataMasterylab
Follow us on LinkedIn: https://www.linkedin.com/in/yusuf-ganiyu-b90140107
Tags:
Change Data Capture, CDC, Real-Time Streaming, Docker, Postgres, Debezium, Kafka, Apache Spark, Slack, Data Engineering, Data Pipeline, Tech Tutorial, Software Development, Data Streaming, IT Education, End to End Data Engineering
Hashtags:
#ChangeDataCapture #RealTimeData #Docker #Postgres #Debezium #Kafka #ApacheSpark #Slack #DataEngineering #TechTutorial #SoftwareDevelopment #DataStreaming #ITEducation #bigdataanalytics #EndToEndDataEngineeringProject
-
15:03
Dad Saves America
11 hours ago $0.01 earnedHow the Department of Education Hijacked Our Schools - Poisoning of the American Mind: Pt 3
22K1 -
14:06
Silver Dragons
14 hours agoBullion Dealer Reacts to Silver Price TRIPLING in 5 Years
3.96K3 -
28:31
Anthony Rogers
13 hours agoBOWLING FOR SOUP interview
3.92K1 -
17:12
Nate The Lawyer
2 days ago $0.11 earnedTrans Swimmer Lia Thomas Stripped of Titles for Being a Man in Women’s Sports
30519 -
12:17
Zoufry
18 hours agoThe Hunt For The Real Life James Bond
23.4K6 -
24:05
DeVory Darkins
8 hours ago $7.78 earnedTrump HUMILIATES Jerome Powell in TENSE moment... Columbia University surrenders
98.6K65 -
14:17
Doc Rich
5 days agoLefties Losing It Once Again
26.3K34 -
25:31
Liberty Hangout
1 day agoMAGA Crashes Pathetic Anti-ICE Rally
103K56 -
2:02:26
Inverted World Live
10 hours agoUS Soldiers Saw Non-Humans in Suffolk, The Rendlesham Forest Incident | Ep. 80
148K24 -
6:42:47
Akademiks
11 hours agoICE MAN EPISODE 2 tonight. NEW NBA YOUNGBOY 'MASA' TONIGHT. BIG AKADEMIKS #2 MEDIA PERSONALITY 2025.
98.3K5