Premium Only Content

Open Assistant Inference Backend Development (Hands-On Coding)
#ai #huggingface #coding
Join me as I build streaming inference into the Hugging Face text generation server, going through cuda, python, rust, grpc, websockets, server-sent events, and more...
Original repo is here: https://github.com/huggingface/text-generation-inference
OpenAssistant repo is here: https://github.com/LAION-AI/Open-Assistant (see inference/)
Check out https://www.wandb.courses/ for free MLOps courses!
Links:
Homepage: https://ykilcher.com
Merch: https://ykilcher.com/merch
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://ykilcher.com/discord
LinkedIn: https://www.linkedin.com/in/ykilcher
If you want to support me, the best thing to do is to share out the content :)
If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: https://www.subscribestar.com/yannickilcher
Patreon: https://www.patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n
-
LIVE
Repentency
6 hours agoHalo 2 HCS Pro Playing Matchmaking
495 watching -
4:03:42
Alex Zedra
7 hours agoLIVE! CoD tonight :D
19.8K2 -
1:31:19
AimControllers
2 days ago $13.26 earned🔴LIVE - THE PRE GAME LOBBY PODCAST
60.4K10 -
2:17:32
megimu32
8 hours agoOTS: Born to Grill, Raised on Fireworks - 4th of July Throwbacks
33.9K17 -
4:18:02
IcyFPS
5 hours ago32 days left in Ranked.. How far do we get?!
24K1 -
8:01:43
JdaDelete
1 day ago $0.45 earnedThe Legend Of Zelda Breath of the Wild | July Gone Wild #3
14.8K -
5:27:59
OhHiMark1776
10 hours ago🟢 07-03-25 ||||| Dur ||||| Baldur's Gate 3 (2023)
10.6K2 -
13:47
Adam Does Movies
8 hours ago $0.89 earnedJurassic World Rebirth - Movie Review
15.8K7 -
51:55
The Finance Hub
9 hours ago $5.98 earnedBREAKING: DONALD TRUMP JUST SHOCKED THE WORLD!
22K24 -
7:57:32
Right Side Broadcasting Network
9 days agoLIVE REPLAY: President Trump's America250 Kick-Off Rally at the Iowa State Fairgrounds - 7/3/25
355K76