2020 @SQLSatLA presents: Data Lakes with Azure Databricks by Dustin Vannoy | @Blackline Room
Data Lakes with Azure Databricks by Dustin Vannoy (@dustinvannoy)
The world of analytics and data warehousing has evolved rapidly in the last 10 years with the Data Lake as the backbone of modern data environments. Data Lakes are best built leveraging unique services of the cloud provider to reduce operations complexity. This session will explain why everyone's talking about data lakes, break down the best services in Azure to build a Data Lake, and walk through code for querying and loading with Azure Databricks.
Attendees will leave the session with a firm grasp of why we build data lakes and how Azure Databricks fits in for ETL and querying.
Agenda:
- Why Data Lakes?
- Data Lake best practices
- Reference Architecture implemented with:
○ Azure Databricks
○ Azure Data Lake Storage (Gen 2)
○ Event Hubs for Apache Kafka
-
53:40
Data.SQL.Saturday.LA
3 years ago2020 @SQLSatLA presents: Data Lakes with Azure Databricks by Dustin Vannoy | @Blackline Room
20 -
59:40
Data.SQL.Saturday.LA
3 years ago2020 @SQLSatLA presents: Data Lake Design Patterns by Jason Horner | @Blackline Room
6 -
1:15:51
Magna Data
3 years agoIntroduction to Azure Databricks
9 -
1:06:40
Magna Data
2 years agoAzure Synapse Analytics, SQL OnDemand and Power BI
13 -
15:43
VMblog
1 year agoVMblog 2022 Mega Series, Komprise Offers Expertise on the Topic of Unstructured Data Management
46 -
2:30:31
CodeWithYu
3 months agoRealtime Streaming with Unstructured Data Engineering | Get Hired as an Experienced Data Engineer
28 -
1:22:11
Magna Data
3 years agoIntroduction to Snowflake on Microsoft Azure
12 -
1:27:47
CodeWithYu
8 months agoRealtime Data Streaming | End To End Data Engineering Project
30 -
1:59:28
CodeWithYu
6 months agoRobust Data Pipelines with Apache Spark, DBT and Azure | End-to-End Data Engineering Project
11 -
1:46:34
infosectrain01
1 year agoDatabase Services in AWS | Explore databases in AWS | Networking in AWS
8