Premium Only Content

CI/CD for Modern Data Engineering | End to End Data Engineering Project
In this video, we delve deep into the world of DevOps, focusing on Continuous Integration (CI) and Continuous Deployment (CD) within the realm of modern data engineering.
Enroll in my Data Engineering Mastery Course: datamasterylab.com
Timestamps:
0:00 Introduction
2:00 System architecture
4:00 Prerequisites and installations
9:21 Azure Infrastructure as Code Automation with Terraform
13:50 Storage account module with Terraform
32:52 Automating Azure Data Factory with Terraform
1:04:30 Testing and Validation of Results
1:09:14 Outro
Resources:
Github Code: https://github.com/airscholar/cicd_for_data_engineering.git
Terraform installation: https://developer.hashicorp.com/terraform/install
Azure CLI installation: https://learn.microsoft.com/en-us/cli/azure/
Tags:
CI/CD, Data Engineering, Azure, Terraform, DevOps, Cloud Computing, Continuous Integration, Continuous Deployment, Azure DevOps, Infrastructure as Code, Automation,Cloud Services, Azure Cloud, Terraform Automation, Data Pipeline
Hashtags:
#CICD #DataEngineering #Azure #Terraform #DevOps #CloudComputing #ContinuousIntegration #ContinuousDeployment #AzureDevOps #InfrastructureAsCode #Automation #CloudServices #AzureCloud #TerraformAutomation #DataPipeline #DevSecOps
-
1:01:27
Part Of The Problem
11 hours agoDave Smith | The System is Broken | Part Of The Problem 1290
1.22K5 -
LIVE
Matt Kohrs
9 hours agoMARKET OPEN: Stocks Rocket, Trade War News & Earnings Season || Live Trading
706 watching -
LIVE
Wendy Bell Radio
5 hours agoWhen Are "The Experts" Ever Right?
7,669 watching -
LIVE
JuicyJohns
1 hour ago $0.74 earned🟢#1 REBIRTH PLAYER 10.2+ KD🟢 !loadout
202 watching -
UPCOMING
The Mike Schwartz Show
1 hour agoTHE MIKE SCHWARTZ SHOW with DR. MICHAEL J SCHWARTZ 07-29-2025
22 -
1:09:29
Dialogue works
12 hours ago $0.07 earnedLarry C. Johnson & Pepe Escobar: Trump's Pressure Backfires, Russia Ignites Unstoppable BRICS Unity
2362 -
LIVE
LFA TV
12 hours agoLFA TV ALL DAY STREAM - TUESDAY 7/29/25
5,389 watching -
1:31:45
Chicks On The Right
4 hours agoTerror in NYC, Nancy Mace can't stop teasing a Gov run, Swalwell humiliates himself again
14.3K4 -
1:05:09
Game On!
18 hours ago $2.17 earnedJustin Herbert LEADS Chargers to NFL Glory in 2025?
36.7K2 -
The Bubba Army
23 hours ago4 KILLED in Manhattan Shooting Rampage - Bubba the Love Sponge® Show | 7/29/25
43.3K12