Python + Upsolver: Simplified Realtime Data Workflows
One of the powerful things about Python is its ability to connect disparate tools into one common integrated development experience. In this talk, we’ll explore how to create and run a near real-time pipeline where we consume events from a Kafka topic and transform the data before landing them in the lake, using Upsolver through our Python SDK. In this way, we get exactly-once processing, strong ordering and automatic schema evolution out of the box thanks to the powerful Upsolver engine, but without having to switch to a different UI and building in SQL only.
Presenter: Santona Tuli
Santona Tuli, PhD began her data journey through fundamental physics—searching through massive event data from particle collisions at CERN to detect rare particles. She’s since extended her machine learning engineering to natural language processing, before switching focus to product and data engineering for data workflow authoring frameworks. As a python engineer, she started with the programmatic data orchestration tool, Airflow, helping improve its developer experience for data science and machine learning pipelines. Currently at Upsolver, she leads data engineering and science, driving developer research and engagement for the declarative workflow authoring framework in SQL. Dr. Tuli is passionate about building, as well as empowering others to build, end-to-end data and ML pipelines, scalably.
Note: The microphone wasn't in the best position to record the speaker. I've done my best to amplify the audio, but that includes some static noise in the background.
-
0:58
OusmanAnalytics
1 year agoSTRINGS DATA TYPES IN PYTHON
4 -
16:08
mokv300
1 year agoTop 5 Python Libraries For Data Science | Python Libraries Explained | Python Tutorial
20 -
11:50
Programming Tutorials
1 year agoR vs Python | Which is Better for Data Analysis?
13 -
0:07
jhp230gr2001
1 year agoColt Python
1 -
47:13
Kozbo
1 year agoAmazon Web Scraping Using Python _ Data Analyst Portfolio Project
9 -
9:49
siddiki
1 year agopython programming
31 -
1:09
OusmanAnalytics
1 year agoWhat is an Integer data types in python
5 -
1:36:05
The Podcast of the Lotus Eaters
7 hours agoThe Podcast of the Lotus Eaters #951
59.8K18 -
2:53:26
The Front
1 day agoThe Darkest Sides of WW2: Most Horrific Stories of the War Explained
34.8K2 -
1:24:48
Game On!
20 hours agoThe 49ers May Never Win a Super Bowl Again | NFC West 2024 Preview
43.4K5