Open Assistant Inference Backend Development (Hands-On Coding)
#ai #huggingface #coding
Join me as I build streaming inference into the Hugging Face text generation server, going through cuda, python, rust, grpc, websockets, server-sent events, and more...
Original repo is here: https://github.com/huggingface/text-generation-inference
OpenAssistant repo is here: https://github.com/LAION-AI/Open-Assistant (see inference/)
Check out https://www.wandb.courses/ for free MLOps courses!
Links:
Homepage: https://ykilcher.com
Merch: https://ykilcher.com/merch
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://ykilcher.com/discord
LinkedIn: https://www.linkedin.com/in/ykilcher
If you want to support me, the best thing to do is to share out the content :)
If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: https://www.subscribestar.com/yannickilcher
Patreon: https://www.patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n
-
3:15:49
The Breanna Morello Show
12 hours agoMike Benz in Studio: Hillary Clinton & John Kerry Declare War on First Amendment | The Breanna Morello Show
55.4K19 -
1:54:42
Kimberly Guilfoyle
9 hours agoSave America: President Trump in Erie, PA- Replay September 29
91.3K43 -
59:12
Flyover Conservatives
1 day agoUN Power Grab… Are They Using Google to Control Dissent and Push Propaganda? - Alex Newman; Economic Update - Dr. Kirk Elliott | FOC Show
41.2K5 -
1:13:55
Abigail Joy
4 hours agoYou're Not Bullish Enough! - Human 1.0 w/ Abigail Joy - September 30 2024 - LIVE STREAM
35.7K2 -
14:35
China Uncensored
5 hours agoI Wasn’t Expecting THIS Would Turn China Against Xi Jinping
35.3K15 -
55:21
LFA TV
19 hours agoNetanyahu Understands War | Trumpet Daily 9.30.24 9PM EST
38.1K15 -
1:13:17
We Like Shooting
17 hours agoDouble Tap 377 (Gun Podcast)
31.8K -
1:00:44
The StoneZONE with Roger Stone
5 hours agoWill Hurricane Helene Affect The Election In 35 DAYS? The StoneZONE w/ Roger Stone
36.6K27 -
3:12:23
Tundra Gaming Live
11 hours agoThe Worlds Worst Horror Streamer Has Heart Attack Playing Phasmophobia
29.1K -
56:22
Patriots With Grit
8 hours agoReclaiming The Republic One County At A Time | Natalie Scholl
23.7K1