Premium Only Content

Open Assistant Inference Backend Development (Hands-On Coding)
#ai #huggingface #coding
Join me as I build streaming inference into the Hugging Face text generation server, going through cuda, python, rust, grpc, websockets, server-sent events, and more...
Original repo is here: https://github.com/huggingface/text-generation-inference
OpenAssistant repo is here: https://github.com/LAION-AI/Open-Assistant (see inference/)
Check out https://www.wandb.courses/ for free MLOps courses!
Links:
Homepage: https://ykilcher.com
Merch: https://ykilcher.com/merch
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://ykilcher.com/discord
LinkedIn: https://www.linkedin.com/in/ykilcher
If you want to support me, the best thing to do is to share out the content :)
If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: https://www.subscribestar.com/yannickilcher
Patreon: https://www.patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n
-
LIVE
itsReel
1 hour agoGaming SUNDAY
60 watching -
28:43
Liberty Hangout
3 days agoAnti-Trumpers Don't Know What They're Protesting
33K202 -
20:33
Sideserf Cake Studio
1 day ago $3.36 earnedI Built A Bikini Bottom Fish Tank CAKE!
27.5K11 -
LIVE
Gore TV
51 minutes agoNO LOOT?! Fine 😤 I’ll Build My Own Gun! 🔫🪵✨
56 watching -
LIVE
XxXAztecwarrior
1 hour agoPlaying Normals Big Red Hunting Delta Force
320 watching -
2:22:46
The Connect: With Johnny Mitchell
23 hours ago $13.82 earnedOne Man's Mission To Stop Human Trafficking: How A Billionaire Mercenary Saved Hundreds Of Children
41.4K33 -
16:24
Forrest Galante
16 hours ago6 Deadliest Man Eaters to Ever Exist
81.4K18 -
LIVE
TheItalianCEO
4 hours agoPlaying video games on a Sunday since 1989
167 watching -
3:32:43
OneRandomDolly
4 hours ago[GB]Long Stream?!?! ✨ Turtle Beach Partner !TB
24.7K2 -
5:14:14
Atarithepaladin
15 hours agoPaladin Playthrough Ep 17
24.5K