How to Keep Improving When You're Better Than Any Teacher - Iterated Distillation and Amplification
Like and subscribe. This is an archive channel, i'm not the owner of the content, check the link in the end. [2nd upload] AI systems can be trained using demonstrations from experts, but how do you train them to out-perform those experts? Can this still be done even without clear win/loss criteria? And how do you do it safely?
This video was based on work including:
"Supervising strong learners by amplifying weak experts" by Paul Christiano, Buck Shlegeris, Dario Amodei (https://arxiv.org/abs/1810.08575)
https://openai.com/blog/amplifying-ai-training/
https://www.alignmentforum.org/s/EmDuGeRw749sD3GKd
https://ai-alignment.com/iterated-distillation-and-amplification-157debfd1616
With thanks to my wonderful Patrons: ( https://www.patreon.com/robertskmiles )
Steef
Jason Strack
Jordan Medina
Jason Hise
Scott Worley
JJ Hepboin
Pedro A Ortega
Said Polat
Chris Canal
Nicholas Kees Dupuis
James
Richárd Nagyfi
Phil Moyer
Alec Johnson
Clemens Arbesser
Bryce Daifuku
Simon Strandgaard
Jonatan R
Michael Greve
The Guru Of Vision
Volodymyr
David Tjäder
Julius Brash
Tom O'Connor
Erik de Bruijn
Robin Green
Laura Olds
Jon Halliday
Paul Hobbs
Jeroen De Dauw
Tim Neilson
Eric Scammell
Igor Keller
Ben Glanton
Robert Sokolowski
anul kumar sinha
Jérôme Frossard
Sean Gibat
Sun Sun
andrew Russell
Cooper Lawton
Gladamas
Sylvain Chevalier
DGJono
robertvanduursen
Dmitri Afanasjev
Brian Sandberg
Einar Ueland
Marcel Ward
Andrew Weir
Taylor Smith
Ben Archer
Scott McCarthy
Kabs Kabs Kabs
Tendayi Mawushe
Jannik Olbrich
Anne Kohlbrenner
Bjorn Nyblad
Jussi Männistö
Mr Fantastic
Wr4thon
Archy de Berker
Marc Pauly
Joshua Pratt
Shevis Johnson
Andy Kobre
Brian Gillespie
Martin Wind
Peggy Youell
Poker Chen
Kees
Darko Sperac
Truls
Paul Moffat
Jelle Langen
Anders Öhrt
Marco Tiraboschi
Michael Kuhinica
Fraser Cain
Robin Scharf
Oren Milman
John Rees
Shawn Hartsock
Seth Brothwell
Brian Goodrich
Clark Mitchell
Kasper Schnack
Michael Hunter
Klemen Slavic
Patrick Henderson
Long Nguyen
Oct todo22
Melisa Kostrzewski
Hendrik
Daniel Munter
Graham Henry
Duncan Orr
https://rumblevideoarchive.wordpress.com/
-
17:32
JoBlo Originals
20 hours agoWhat Happened to DANNY GLOVER?
29.7K19 -
22:14
MYLUNCHBREAK CHANNEL PAGE
16 hours agoAngels Helped Build the Old World?
35.1K31 -
4:16
Chris Jericho
13 hours agoTalk Is Jericho Highlight: Joel McHale x Chevy Chase & Community
32.6K2 -
2:43:34
a12cat34dog
9 hours agoROCKIN' OUT IN THE RUMBLE CREATOR HOUSE
18.9K7 -
4:27:24
Right Side Broadcasting Network
11 days agoLIVE REPLAY: President Trump Addresses Libertarian National Convention in D.C. - 5/25/24
333K507 -
2:29:01
SLS - Street League Skateboarding
10 days agoSLS APEX 02: Men's and Women’s Finals
562K26 -
3:14:26
Pepkilla
15 hours agoWarzone From The Rumble Creator House ~
48.4K24 -
2:50:58
FusedAegisTV
20 hours ago34 Days to Dawntrail🕒| FFXIV Online Endwalker 6.0 MSQ @ RUMBLE CREATOR HOUSE!!!
76.9K10 -
2:54:37
SilverFox
19 hours ago🔴LIVE - WOLVERINE vs MALENIA at the RUMBLE CREATOR HOUSE!
84.1K9 -
9:59:44
SNEAKO
21 hours agoNYC One Minute Podcast!
216K115