October 2019 - Using Columnstore indexes in AzureDevOps by Konstantin Kosinsky (@kkosinsky)
Abstract:
The Analytics service in Azure DevOps Services provides all-over insights to your DevOps data: work item tracking, CI/CD pipelines, testing process, etc.
Built on top of columnstore indexes, the Analytics service has to deal with 100s of millions of records and daily growth in 10s of millions, only a few minutes delay from operation store, sub-second query performance for in-product experiences as well as 3rd party extensions, Power BI integration and ad-hoc queries.
Working on it, I've learned a lot of DOs and DON'Ts about columnstore indexes. The session covers how to:
* partition columnstore indexes in a multitenant environment
* maintain columnstore indexes in case of updates and/or purge to keep segment elimination possible
* evolve database schema without downtimes and maintenance windows
* design to benefit from predicate and aggregation pushdown
* deal with edge case like ad-hoc queries for raw data and paging
* choose between CCI and NCCI based on usage patterns
About Konstantin:
Konstantin is an industry expert who loves optimizing the performance at least in 10x. More data - more fun.
Konstantin is a Principal Software Engineer at Azure DevOps Services, where he works on moving the Analytics for software engineering to a completely new level.
Konstantin was born and had been working in Ukraine for a long time, passionately sharing his knowledge with Ukrainian and other European data communities. Before joining Microsoft in 2012, he was a Data Platform MVP for many years.
-
LIVE
Akademiks
2 hours agoDrake vs Kendrick Lamar. Who winning currently. Family Matters vs Not Like Us. Drake on Clock?
12,804 watching -
59:42
The Late Kick with Josh Pate
7 hours agoLate Kick Live Ep 510: Bold Prediction Season | FSU vs Miami | G5 Perception vs Reality | A&M Future
2.92K2 -
2:02:18
vivafrei
13 hours agoEp. 209: Trump Trial; Ole Miss; Pennsylvania Farmers; Owen Shroyer; Whitmer & MORE!
86.3K126 -
1:27:31
RealitySurvival
3 hours agoPrepper SITREP: With Ethical Preparedness
15.2K3 -
3:40:49
XrayGirl
9 hours agoGTFO | Sunday Funday with Kara Lynne, QBG and HeelvsBabyface
31.5K4 -
2:16:20
George Galloway
2 days agoTHE FINAL COUNTDOWN - MOATS with George Galloway Ep 340
57.1K134 -
Major League Fishing
5 days agoBass Pro Tour LIVE - Stage Three - Day 4
55.3K6 -
29:33
Front & Center with Jacquie Jordan
2 days agoFront & Center w/ Jacquie Jordan - Unmasking the Masks
78.7K57 -
1:22:20
Real Coffee With Scott Adams
12 hours agoEpisode 2465 CWSA 05/05/24
90.7K65 -
38:35
Standpoint with Gabe Groisman
3 days agoEp. 22. Knesset Speaker on The Challenging Times in Israel. Amir Ohana
109K90