Premium Only Content

ActInf ModelStream 011.1 ~ Hadi Vafaii: "Poisson Variational Autoencoder"
"Poisson Variational Autoencoder"
Hadi Vafaii, Dekel Galor, Jacob L. Yates
https://arxiv.org/abs/2405.14473
[Submitted on 23 May 2024]
Variational autoencoders (VAE) employ Bayesian inference to interpret sensory inputs, mirroring processes that occur in primate vision across both ventral (Higgins et al., 2021) and dorsal (Vafaii et al., 2023) pathways. Despite their success, traditional VAEs rely on continuous latent variables, which deviates sharply from the discrete nature of biological neurons. Here, we developed the Poisson VAE (P-VAE), a novel architecture that combines principles of predictive coding with a VAE that encodes inputs into discrete spike counts. Combining Poisson-distributed latent variables with predictive coding introduces a metabolic cost term in the model loss function, suggesting a relationship with sparse coding which we verify empirically. Additionally, we analyze the geometry of learned representations, contrasting the P-VAE to alternative VAE models. We find that the P-VAEencodes its inputs in relatively higher dimensions, facilitating linear separability of categories in a downstream classification task with a much better (5x) sample efficiency. Our work provides an interpretable computational framework to study brain-like sensory processing and paves the way for a deeper understanding of perception as an inferential process.
----
Active Inference Institute information:
Website: https://activeinference.org/
Twitter: https://twitter.com/InferenceActive
Discord: https://discord.gg/8VNKNp4jtx
YouTube: https://www.youtube.com/c/ActiveInference/
Active Inference Livestreams: https://coda.io/@active-inference-institute/livestreams
CSID: e9aeb713e167ab71
Content Managed by ContentSafe.co
-
1:00:40
Active Inference Institute
16 days agoActInf GuestStream 113.1 ~ Bayesian Mechanics of Economic Choice (Ernesto Moya-Albor et al.)
81 -
LIVE
vivafrei
8 hours agoEp. 273: Russia Hoax CONFIRMED! Will ARRESTS Follow? Trump SUES WSJ! Epstein Docs Release? & MORE!
9,117 watching -
LIVE
Barry Cunningham
7 hours agoPRESIDENT TRUMP HAS EXPOSED BARACK OBAMA AS A TRAITOR! AND MORE NEWS!
4,764 watching -
1:07:58
Sarah Westall
1 hour agoThe Discipline of Remote Viewing: Shroud of Turin, Surface of Mars & the Unknown w/ Daz Smith & Team
2.47K3 -
17:37
Colion Noir
3 hours agoGavin Newsom Gifted A Gun On Shawn Ryan Podcast, Claims He's Not Anti-Gun
10.1K29 -
31:37
The Rad Factory
1 day ago $11.67 earnedTesting $300 Amazon Supercharger: Will It Blow??
35.9K13 -
22:02
Mrgunsngear
20 hours ago $10.63 earnedHeckler & Koch Full Size VP9A1 F Review: The Best Striker Fired Duty Handgun?
31.3K18 -
1:25:18
Jeff Ahern
3 hours ago $7.35 earnedThe Sunday Show with Jeff Ahern
21.3K7 -
LIVE
Spartan
4 hours agoSpartan - Pro Halo Player for OMiT | Scrims vs C9 then ranked
213 watching -
LIVE
Gore TV
6 hours ago🔥💥 MY GUN BROKE MID-FIGHT?! 🤯💣 | Division 2 Chaos with a Toy Rifle 😂🔫
199 watching