Premium Only Content
CI/CD for Modern Data Engineering | End to End Data Engineering Project
In this video, we delve deep into the world of DevOps, focusing on Continuous Integration (CI) and Continuous Deployment (CD) within the realm of modern data engineering.
Enroll in my Data Engineering Mastery Course: datamasterylab.com
Timestamps:
0:00 Introduction
2:00 System architecture
4:00 Prerequisites and installations
9:21 Azure Infrastructure as Code Automation with Terraform
13:50 Storage account module with Terraform
32:52 Automating Azure Data Factory with Terraform
1:04:30 Testing and Validation of Results
1:09:14 Outro
Resources:
Github Code: https://github.com/airscholar/cicd_for_data_engineering.git
Terraform installation: https://developer.hashicorp.com/terraform/install
Azure CLI installation: https://learn.microsoft.com/en-us/cli/azure/
Tags:
CI/CD, Data Engineering, Azure, Terraform, DevOps, Cloud Computing, Continuous Integration, Continuous Deployment, Azure DevOps, Infrastructure as Code, Automation,Cloud Services, Azure Cloud, Terraform Automation, Data Pipeline
Hashtags:
#CICD #DataEngineering #Azure #Terraform #DevOps #CloudComputing #ContinuousIntegration #ContinuousDeployment #AzureDevOps #InfrastructureAsCode #Automation #CloudServices #AzureCloud #TerraformAutomation #DataPipeline #DevSecOps
-
1:00:40
Bek Lover Podcast
1 day agoKamala Will Be President? Trump In Trouble & More Strange News Podcast
6.56K4 -
48:44
PMG
14 hours ago $2.24 earned"Hannah Faulkner and Bishop Leon Benjamin | REVIVAL IN AMERICA"
5.56K1 -
41:55
Man in America
13 hours ago🔴 LIVE: The Cabal’s Most Powerful Weapon is COLLAPSING
103K66 -
DVR
Jerry After Dark
13 hours agoJerry After Dark: Carnival Games
94K4 -
3:55:04
ThatStarWarsGirl
9 hours agoTSWG LIVE: Big NEWS! Plus Reacting to Woke Meltdowns!
96.9K14 -
8:02:46
FusedAegisTV
10 hours ago『AST lvl 100』Tuesday Raid & Rant | Final Fantasy XIV | Patch 7.1 Day of Reckoning!
64.9K2 -
59:17
Matt Kohrs
11 hours agoRumble's Q3 Recap & What's Next w/ CEO Chris Pavlovski
86.7K30 -
1:43:47
Adam Does Movies
15 hours ago $25.85 earnedGladiator II Early Reviews + Tom Cruise Stans Glen Powell + Freddy Krueger - Movie News LIVE!
78K5 -
2:24:03
WeAreChange
11 hours agoTrump Creates Department Of Government Efficiency With Elon And Vivek!
137K61 -
2:10:32
Slightly Offensive
12 hours ago $28.36 earnedGET READY: Civil Unrests ERUPTS As Trump Resistance 2.0 EMERGES
74.9K52