March 2021 - Spark and Databricks in Azure Synapse by Ginger Grant (@desertislesql)
Abstract:
Azure Synapse Workspace provides the ability to use both Apache Spark and Databricks. Which one should you use? The answer of course is “It Depends”. In this session we are going to review what the use cases are which would determine why you would select one tool over another. Here we will examine the costs, the kind of data being analyzed, how much data is processed, variability of data loads, and other variables which determine which solution should be implemented. This session will also review when a Spark based processing tool should be used and when you are better off another tool such as SQL on-demand or an Extract, Load and Transform (ELT) process. The demos will show how to implement each solution in the Azure Synapse Workspace and how each can be used to process data.
About Ginger
Ginger Grant is a Principal Consultant in Advanced Analytics. She manages the consultancy Desert Isle Group and shares what she has learned while working with data technology to people around the world.
As a Microsoft MVP in Data Platform, Microsoft Certified Trainer and an instructor on DataCamp, she focuses on guiding clients to create solutions using the entire Microsoft Data Stack, which includes SQL Server, Power BI, and Azure Data Cloud components.
When not working, she protypes the latest pre-release data technologies, maintains her blog http://www.desertislesql.com, and spends time on twitter @desertislesql.
-
1:06:40
Magna Data
2 years agoAzure Synapse Analytics, SQL OnDemand and Power BI
13 -
53:40
Data.SQL.Saturday.LA
3 years ago2020 @SQLSatLA presents: Data Lakes with Azure Databricks by Dustin Vannoy | @Blackline Room
20 -
1:59:28
CodeWithYu
6 months agoRobust Data Pipelines with Apache Spark, DBT and Azure | End-to-End Data Engineering Project
11 -
1:03:38
Magna Data
3 years agoAzure Synapse Back to Back
1 -
1:15:51
Magna Data
3 years agoIntroduction to Azure Databricks
9 -
0:08
danilosousa
1 year agoApache Spark
3 -
10:42
VMblog
10 months agoMicrosoft Azure Arc-enabled VMware vSphere and Hybrid Distributed Clouds | VMware Explore 2023
80 -
1:58:08
infosectrain01
1 year ago $0.01 earnedCore Azure Solution and Management Tools | Azure Monitoring Service | Azure Serverless Technology
12 -
1:14:04
Magna Data
3 years agoBuilding AI-powered solutions with Microsoft Azure
13 -
1:22:11
Magna Data
3 years agoIntroduction to Snowflake on Microsoft Azure
12