Premium Only Content
![JEPA - A Path Towards Autonomous Machine Intelligence (Paper Explained)](https://1a-1791.com/video/s8/1/L/y/1/X/Ly1Xe.qR4e-small-JEPA-A-Path-Towards-Autonom.jpg)
JEPA - A Path Towards Autonomous Machine Intelligence (Paper Explained)
#jepa #ai #machinelearning
Yann LeCun's position paper on a path towards machine intelligence combines Self-Supervised Learning, Energy-Based Models, and hierarchical predictive embedding models to arrive at a system that can teach itself to learn useful abstractions at multiple levels and use that as a world model to plan ahead in time.
OUTLINE:
0:00 - Introduction
2:00 - Main Contributions
5:45 - Mode 1 and Mode 2 actors
15:40 - Self-Supervised Learning and Energy-Based Models
20:15 - Introducing latent variables
25:00 - The problem of collapse
29:50 - Contrastive vs regularized methods
36:00 - The JEPA architecture
47:00 - Hierarchical JEPA (H-JEPA)
53:00 - Broader relevance
56:00 - Summary & Comments
Paper: https://openreview.net/forum?id=BZ5a1r-kVsf
Abstract: How could machines learn as efficiently as humans and animals? How could machines learn to reason and plan? How could machines learn representations of percepts and action plans at multiple levels of abstraction, enabling them to reason, predict, and plan at multiple time horizons? This position paper proposes an architecture and training paradigms with which to construct autonomous intelligent agents. It combines concepts such as configurable predictive world model, behavior driven through intrinsic motivation, and hierarchical joint embedding architectures trained with self-supervised learning.
Author: Yann LeCun
Links:
Homepage: https://ykilcher.com
Merch: https://ykilcher.com/merch
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://ykilcher.com/discord
LinkedIn: https://www.linkedin.com/in/ykilcher
If you want to support me, the best thing to do is to share out the content :)
If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: https://www.subscribestar.com/yannickilcher
Patreon: https://www.patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n
-
5:49
Hannah Barron
23 hours agoRedneck Euro Mount
7.15K19 -
32:34
hickok45
7 hours agoSunday Shoot-a-Round # 268
3.56K8 -
27:33
The Finance Hub
17 hours ago $1.98 earnedBREAKING: ALINA HABBA JUST DROPPED A MASSIVE BOMBSHELL!!!
9.29K51 -
40:23
PMG
21 hours ago $0.18 earnedHannah Faulkner and Dr. Michael Schwartz | EXPOSING BIG PHARMA
5.7K1 -
18:55
GBGunsRumble
19 hours agoGBGuns Range Report & Channel Update 15FEB25
3.57K -
13:31:32
iViperKing
20 hours agoGood Times + Good Energy Ft. Whez.. #VKGFAM #RRR
92.4K13 -
12:24
Winston Marshall
1 day agoWOAH! Bannon just Revealed THIS About MUSK - The Tech-Right vs MAGA Right Civil War Ramps Up
219K306 -
7:33:46
Phyxicx
19 hours agoRaid & Rant with the FF14 Guild on Rumble! Halo Night just wrapped up! - Go Follow all these great guys please! - 2/15/2025
147K4 -
10:42:19
Reolock
21 hours agoWoW Classic Hardcore (LVL 60) | RAID DAY | Rumble FIRST HC Raid
94.1K5 -
3:10:03
Barry Cunningham
18 hours agoTRUMP WEEKEND BRIEFING! MORE WINNING...MORE LEFTIES LOSING IT!
85.1K43