Premium Only Content

How to run a self hosted AI
An overview of an open source, self hosted A.I. system. We'll see how to set it up, how to run it (with the CPU only), and an example interaction.
We'll also see how Python scripts that interface with these systems look like.
For this video we'll look at text generative A.I. models only.
A.I.:
- FastChat: https://github.com/lm-sys/FastChat
A.I. Models:
- FastChat-T5: https://huggingface.co/lmsys/fastchat-t5-3b-v1.0
- RedPajama-INCITE-Chat-3B-v1: https://huggingface.co/togethercomputer/RedPajama-INCITE-Chat-3B-v1
O.S.:
- Debian: https://www.debian.org/download
CHAPTERS
0:00 Intro
0:59 Virtual machine settings
1:29 Debian as OS of choice
1:48 PIP installation
2:00 FastChat installation through PIP
2:12 The FastChat-T5 model
2:26 First part of interaction with FastChat-T5
4:41 Real speed, processor and memory usage
6:12 Clone GIT repositories of the models and datasets
6:26 Second part of interaction with FastChat-T5
9:06 Bonus coding question
9:19 Testing another model using a Python script instead of interacting with the CLI directly
10:22 Outtro
#ai #generativeai #selfhostedai #fastchat #debian
-
LIVE
Inverted World Live
1 hour agoThe Aliens Are Underwater | Ep. 117
8,500 watching -
LIVE
Badlands Media
9 hours agoDevolution Power Hour Ep. 394
5,200 watching -
2:08:38
TimcastIRL
3 hours agoNetflix Shares TANK, Elon Says BOYCOTT After Writer MOCKS Charlie Kirk Assassination
149K98 -
LIVE
SpartakusLIVE
5 hours agoI'M BACK || Quads w/ The Boys
536 watching -
9:33
Ken LaCorte: Elephants in Rooms
8 hours ago $0.03 earnedWhy Do Black Men Love Big Butts?
611 -
2:12
From Zero → Viral with AI
1 day ago🚀 AI Marketing Isn’t Just for Big Brands Anymore — Here’s Why
27 -
9:51:58
Dr Disrespect
11 hours ago🔴LIVE - DR DISRESPECT - 10 WINS ON CONTROLLER - BO7 TOMORROW
268K17 -
1:24:56
Glenn Greenwald
5 hours agoTrump Declares Cities as the Enemies Within; Reagan Appointed Judge Slams Trump Over Speech Crackdowns; American ER Doctor on Gaza Atrocities | SYSTEM UPDATE #524
96.4K79 -
LIVE
I_Came_With_Fire_Podcast
11 hours agoPete Hegseth and the Chamber of Standards | Digital IDs | Taiwan Chips & Salsa | CDL Crisis
212 watching -
LIVE
Adam Does Movies
10 hours agoTalking Movies + Ask Me Anything - LIVE
34 watching