Premium Only Content

Gradient descent, how neural networks learn | Chapter 2, Deep learning
Enjoy these videos? Consider sharing one or two.
Help fund future projects: https://www.patreon.com/3blue1brown
Special thanks to these supporters: http://3b1b.co/nn2-thanks
Written/interactive form of this series: https://www.3blue1brown.com/topics/ne...
This video was supported by Amplify Partners.
For any early-stage ML startup founders, Amplify Partners would love to hear from you via 3blue1brown@amplifypartners.com
To learn more, I highly recommend the book by Michael Nielsen
http://neuralnetworksanddeeplearning....
The book walks through the code behind the example in these videos, which you can find here:
https://github.com/mnielsen/neural-ne...
MNIST database:
http://yann.lecun.com/exdb/mnist/
Also check out Chris Olah's blog:
http://colah.github.io/
His post on Neural networks and topology is particular beautiful, but honestly all of the stuff there is great.
And if you like that, you'll love the publications at distill:
https://distill.pub/
For more videos, Welch Labs also has some great series on machine learning:
• Learning To See [Part 1: Introduction]
• Neural Networks Demystified [Part 1: ...
"But I've already voraciously consumed Nielsen's, Olah's and Welch's works", I hear you say. Well well, look at you then. That being the case, I might recommend that you continue on with the book "Deep Learning" by Goodfellow, Bengio, and Courville.
Thanks to Lisha Li (@lishali88) for her contributions at the end, and for letting me pick her brain so much about the material. Here are the articles she referenced at the end:
https://arxiv.org/abs/1611.03530
https://arxiv.org/abs/1706.05394
https://arxiv.org/abs/1412.0233
Music by Vincent Rubinetti:
https://vincerubinetti.bandcamp.com/a...
-------------------
Video timeline
0:00 - Introduction
0:30 - Recap
1:49 - Using training data
3:01 - Cost functions
6:55 - Gradient descent
11:18 - More on gradient vectors
12:19 - Gradient descent recap
13:01 - Analyzing the network
16:37 - Learning more
17:38 - Lisha Li interview
19:58 - Closing thoughts
------------------
-
2:21:13
Tundra Tactical
12 hours ago $2.37 earned"The World's Okayest Gun Live Stream: Reloading Series Announcement & ATF Pistol Brace is Dead
17.8K1 -
1:15:42
The Connect: With Johnny Mitchell
1 day ago $14.94 earnedHow Did This Happen? Male Escort Who Testified Against Diddy Exposes LIES About Government's Case
60.4K16 -
LIVE
Boxin
2 hours agoFable 2! but if it crashes we change games (latter maybe peak with Scottish)
645 watching -
49:34
TruthStream with Joe and Scott
23 hours agoEllen P Lincoln interviews Joe: A deep dive into his history and background. Premiers 7/19
40.2K3 -
DVR
LarryDickmanGaming
11 hours agoSNIKT Me Outside, How 'Bout Dat
5.44K -
5:00:40
Captainpapsgaming
6 hours agoThe Thrilling Conclusion of Doom The Dark Ages! Come Hang!
7.18K -
11:49
Nikko Ortiz
1 day agoCrazy Instant Karma Clips
78.8K34 -
4:35:35
MSFT__kiLRoy
5 hours agoBorderlands 3 - Atlas Zane (Pt. 17) \\ Guardian Takedown Again...
15.3K -
3:29:24
EXPBLESS
4 hours agoWhy Am I Awake This Early - Hunt Showdown Madness #RumbleGaming
10.9K1 -
6:47:14
GamersErr0r
10 hours ago $0.85 earnedBecoming A Support Main | Marvel Rivals
10.3K