Premium Only Content

ActInf MathStream 010.1 ~ Thomas Varley "Generalized decomposition of multivariate information"
Generalized decomposition of multivariate information
Thomas Varley
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10843128/
Since its introduction, the partial information decomposition (PID) has emerged as a powerful, information-theoretic technique useful for studying the structure of (potentially higher-order) interactions in complex systems. Despite its utility, the applicability of the PID is restricted by the need to assign elements as either “sources” or “targets”, as well as the specific structure of the mutual information itself. Here, I introduce a generalized information decomposition that relaxes the source/target distinction while still satisfying the basic intuitions about information. This approach is based on the decomposition of the Kullback-Leibler divergence, and consequently allows for the analysis of any information gained when updating from an arbitrary prior to an arbitrary posterior. As a result, any information-theoretic measure that can be written as a linear combination of Kullback-Leibler divergences admits a decomposition in the style of Williams and Beer, including the total correlation, the negentropy, and the mutual information as special cases. This paper explores how the generalized information decomposition can reveal novel insights into existing measures, as well as the nature of higher-order synergies. We show that synergistic information is intimately related to the well-known Tononi-Sporns-Edelman (TSE) complexity, and that synergistic information requires a similar integration/segregation balance as a high TSE complexity. Finally, I end with a discussion of how this approach fits into other attempts to generalize the PID and the possibilities for empirical applications.
Active Inference Institute information:
Website: https://activeinference.org/
Twitter: https://twitter.com/InferenceActive
Discord: https://discord.gg/8VNKNp4jtx
YouTube: https://www.youtube.com/c/ActiveInference/
Active Inference Livestreams: https://coda.io/@active-inference-institute/livestreams
CSID: ccd5b36fe12011c2
Content Managed by ContentSafe.co
-
1:00:40
Active Inference Institute
1 month agoActInf GuestStream 113.1 ~ Bayesian Mechanics of Economic Choice (Ernesto Moya-Albor et al.)
101 -
LIVE
TimcastIRL
1 hour agoTrump Claims Total Victory, Court Eliminates $500M Fine In NY Fraud Case| Timcast IRL
19,414 watching -
LIVE
SpartakusLIVE
2 hours agoVerdansk QUADS || #1 MACHINE is BACK taking NO DAYS OFF (until I feel like it)
1,575 watching -
LIVE
JustPearlyThings
52 minutes agoPearl Reacts: 20 Black Conservatives DESTROY Radical Feminist Activist | Pearl Daily
605 watching -
2:09:22
Robert Gouveia
3 hours agoTrump WINS Appeal! 🚨 Letitia James BLOWN OUT! Biden Scandal BOMBSHELL!
8.84K9 -
Barry Cunningham
3 hours agoBREAKING NEWS: PRESIDENT TRUMP ON PATROL IN WASHINGTON D.C.
32.1K7 -
LIVE
LFA TV
13 hours agoLFA TV ALL DAY STREAM - THURSDAY 8/21/25
905 watching -
UPCOMING
Kat Espinda
16 hours ago[your]NEWS - Become a PAID Journalist - With Sam Anthony
458 -
LIVE
megimu32
1 hour agoOTS: Pimp My Ride LOL - Insane Mods & Car Stereo Nostalgia
129 watching -
1:29:46
Glenn Greenwald
3 hours agoIsraeli Official Caught in Pedophile Sting Operation Allowed to Flee; Israeli Data: 83% of the Dead in Gaza are Civilians; Ukrainian Man Arrested over Nord Stream Explosions | SYSTEM UPDATE #503
54.6K41