All about AI Accelerators: GPU, TPU, Dataflow, Near-Memory, Optical, Neuromorphic & more (w/ Author)
#ai #gpu #tpu
This video is an interview with Adi Fuchs, author of a series called "AI Accelerators", and an expert in modern AI acceleration technology.
Accelerators like GPUs and TPUs are an integral part of today's AI landscape. Deep Neural Network training can be sped up by orders of magnitudes by making good use of these specialized pieces of hardware. However, GPUs and TPUs are only the beginning of a vast landscape of emerging technologies and companies that build accelerators for the next generation of AI models. In this interview, we go over many aspects of building hardware for AI, including why GPUs have been so successful, what the most promising approaches look like, how they work, and what the main challenges are.
OUTLINE:
0:00 - Intro
5:10 - What does it mean to make hardware for AI?
8:20 - Why were GPUs so successful?
16:25 - What is "dark silicon"?
20:00 - Beyond GPUs: How can we get even faster AI compute?
28:00 - A look at today's accelerator landscape
30:00 - Systolic Arrays and VLIW
35:30 - Reconfigurable dataflow hardware
40:50 - The failure of Wave Computing
42:30 - What is near-memory compute?
46:50 - Optical and Neuromorphic Computing
49:50 - Hardware as enabler and limiter
55:20 - Everything old is new again
1:00:00 - Where to go to dive deeper?
Read the full blog series here:
Part I: https://medium.com/@adi.fu7/ai-accele...
Part II: https://medium.com/@adi.fu7/ai-accele...
Part III: https://medium.com/@adi.fu7/ai-accele...
Part IV: https://medium.com/@adi.fu7/ai-accele...
Part V: https://medium.com/@adi.fu7/ai-accele...
Links:
Merch: store.ykilcher.com
TabNine Code Completion (Referral): http://bit.ly/tabnine-yannick
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://discord.gg/4H8xxDF
BitChute: https://www.bitchute.com/channel/yann...
LinkedIn: https://www.linkedin.com/in/ykilcher
BiliBili: https://space.bilibili.com/2017636191
If you want to support me, the best thing to do is to share out the content :)
If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: https://www.subscribestar.com/yannick...
Patreon: https://www.patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n
-
8:08
Tyler Monagan
1 day agoWorlds Fastest E-Bike with Paddle Tire RIPS!!
26.5K23 -
7:53
ParisDemers
22 hours agoAndrew Tate's 25-Min Daily At-Home Workout Hack Will Get You Jacked!?
22.1K28 -
23:14
Brewzle
1 day agoI Went Bourbon Hunting For Dusties in Alabama
26.9K8 -
24:18
CarlCrusher
18 hours agoSkinwalker's Evil Twin - Beyond Skinwalker Ranch Behind the Scenes Season 1 ep 6
35.7K2 -
13:47
RealitySurvival
17 hours agoHow To Build A Camp Fire Fast!
23.5K2 -
13:24
Space Ice
21 hours agoSteven Seagal's Exit Wounds Is So Bad DMX Was Jailed Over 30 Times - Worst Movie Ever
36.9K20 -
1:17:22
Andy Frisella
1 day agoDid He Just Threaten Us? - Ep 726 CTI
34.4K61 -
28:44
TudorDixon
23 hours agoThe Key to Limitless Health with Casey Means | The Tudor Dixon Podcast
45.1K17 -
1:06:35
theDaily302
1 day agoPatriots With Grit Show-Daniel McGirr
41.6K10 -
1:54:17
Kim Iversen
18 hours agoFired from 'Rising'! Briahna Joy Gray Gives Behind-the-Scenes Revelations and Opens Up About Her Departure
75.6K213