Premium Only Content
How to run a self hosted AI
An overview of an open source, self hosted A.I. system. We'll see how to set it up, how to run it (with the CPU only), and an example interaction.
We'll also see how Python scripts that interface with these systems look like.
For this video we'll look at text generative A.I. models only.
A.I.:
- FastChat: https://github.com/lm-sys/FastChat
A.I. Models:
- FastChat-T5: https://huggingface.co/lmsys/fastchat-t5-3b-v1.0
- RedPajama-INCITE-Chat-3B-v1: https://huggingface.co/togethercomputer/RedPajama-INCITE-Chat-3B-v1
O.S.:
- Debian: https://www.debian.org/download
CHAPTERS
0:00 Intro
0:59 Virtual machine settings
1:29 Debian as OS of choice
1:48 PIP installation
2:00 FastChat installation through PIP
2:12 The FastChat-T5 model
2:26 First part of interaction with FastChat-T5
4:41 Real speed, processor and memory usage
6:12 Clone GIT repositories of the models and datasets
6:26 Second part of interaction with FastChat-T5
9:06 Bonus coding question
9:19 Testing another model using a Python script instead of interacting with the CLI directly
10:22 Outtro
#ai #generativeai #selfhostedai #fastchat #debian
-
LIVE
SpartakusLIVE
7 hours ago#1 Solo Savant stream DEEP into the night || PUBG Later Tonight?!
624 watching -
13:56
Clintonjaws
12 hours ago $15.39 earnedEntire Room Speechless As Poilievre Snaps & Puts TV Hosts In Their Place
35.6K13 -
4:23:32
EricJohnPizzaArtist
1 day agoAwesome Sauce PIZZA ART LIVE Ep. #67: HALLOWEEN SPECIAL tribute to “Need to Breathe”
52.6K10 -
2:26:26
Nerdrotic
8 hours ago $38.96 earned3I/Atlas : A Cosmic Horror or a New Interstellar Understanding? | Forbidden Frontier #122
200K17 -
54:56
Sarah Westall
6 hours agoHidden Biblical Writings: Evidence Based Investigation, Worlds First Collection w/ Matthew McWhorter
26.6K19 -
3:08:48
megimu32
5 hours agoOTS: Great Scott! How Back to the Future Changed Movies Forever
28.3K9 -
3:40:15
CassaiyanGaming
5 hours ago🟢LIVE - The OUTLAST Trials with JahBless & CatDog
20.2K4 -
10:54
Nate The Lawyer
2 days ago $12.68 earnedNEW Charges & Lawsuit For Fake Doctor Illegal Who Ran Schools For Decades
47.3K36 -
2:34:44
Joker Effect
4 hours agoSTREAMER NEWS: Adin Ross, LupLupka, SideScrollers, N3on, TrainwrecksTv, Cuffem, WestCol, BottedWTF.
20.5K9 -
3:04:40
IsaiahLCarter
1 day ago $4.54 earnedWill New York City Choose Communism? || APOSTATE RADIO 032 (with John D. Macari)
28.4K11