Premium Only Content

ActInf MathStream 010.1 ~ Thomas Varley "Generalized decomposition of multivariate information"
Generalized decomposition of multivariate information
Thomas Varley
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10843128/
Since its introduction, the partial information decomposition (PID) has emerged as a powerful, information-theoretic technique useful for studying the structure of (potentially higher-order) interactions in complex systems. Despite its utility, the applicability of the PID is restricted by the need to assign elements as either “sources” or “targets”, as well as the specific structure of the mutual information itself. Here, I introduce a generalized information decomposition that relaxes the source/target distinction while still satisfying the basic intuitions about information. This approach is based on the decomposition of the Kullback-Leibler divergence, and consequently allows for the analysis of any information gained when updating from an arbitrary prior to an arbitrary posterior. As a result, any information-theoretic measure that can be written as a linear combination of Kullback-Leibler divergences admits a decomposition in the style of Williams and Beer, including the total correlation, the negentropy, and the mutual information as special cases. This paper explores how the generalized information decomposition can reveal novel insights into existing measures, as well as the nature of higher-order synergies. We show that synergistic information is intimately related to the well-known Tononi-Sporns-Edelman (TSE) complexity, and that synergistic information requires a similar integration/segregation balance as a high TSE complexity. Finally, I end with a discussion of how this approach fits into other attempts to generalize the PID and the possibilities for empirical applications.
Active Inference Institute information:
Website: https://activeinference.org/
Twitter: https://twitter.com/InferenceActive
Discord: https://discord.gg/8VNKNp4jtx
YouTube: https://www.youtube.com/c/ActiveInference/
Active Inference Livestreams: https://coda.io/@active-inference-institute/livestreams
CSID: ccd5b36fe12011c2
Content Managed by ContentSafe.co
-
1:07:49
Active Inference Institute
1 month agoActInf OrgStream 009.1 ~ The Value of Open Source Software (Hoffmann, Nagle, Zhou)
63 -
LIVE
vivafrei
2 hours agoAcosta AI Interview: Journalism or Exploitation? The War of the Jeans! Cincinnati Update & MORE!
13,141 watching -
LIVE
The Quartering
2 hours agoClintons To Testify, Zoo Asks For Peoples Pets For Food, Young Voters, GTA To Require ID To Play
7,374 watching -
Awaken With JP
1 hour agoArrest Warrants for Dems, MSNBC Sucks, and More - LIES Ep 103
12.8K8 -
LIVE
Barry Cunningham
4 hours agoREACTING TO THE PRESIDENT TRUMP INTERVIEW ON CNBC! (THE CONTRAST OF COMMUNISM AND MORE NEWS))
3,676 watching -
1:58:54
The Charlie Kirk Show
3 hours agoThe Obamagate Grand Jury + The Mamdani/Warren Alliance | Prof. Steele, Brand | 8.5.2025
53.4K22 -
1:20:03
Sean Unpaved
3 hours agoNFL Coaching Edge: Top Staffs, Rookie Head Coaches, & NFC South Breakdown
23.5K -
LIVE
Viss
4 hours ago🔴LIVE - Adrenaline Infused PUBG Tactics The Get Wins! - PUBG
269 watching -
16:22
Clickbait Wasteland
19 hours ago $1.20 earnedAsking New Yorkers Who They Support For Mayor: Upper West Side
15.2K8 -
LIVE
StoneMountain64
2 hours agoBATTLEFIELD 6 BETA Training and Prepping
145 watching