ActInf MathStream 010.1 ~ Thomas Varley "Generalized decomposition of multivariate information"
Generalized decomposition of multivariate information
Thomas Varley
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10843128/
Since its introduction, the partial information decomposition (PID) has emerged as a powerful, information-theoretic technique useful for studying the structure of (potentially higher-order) interactions in complex systems. Despite its utility, the applicability of the PID is restricted by the need to assign elements as either “sources” or “targets”, as well as the specific structure of the mutual information itself. Here, I introduce a generalized information decomposition that relaxes the source/target distinction while still satisfying the basic intuitions about information. This approach is based on the decomposition of the Kullback-Leibler divergence, and consequently allows for the analysis of any information gained when updating from an arbitrary prior to an arbitrary posterior. As a result, any information-theoretic measure that can be written as a linear combination of Kullback-Leibler divergences admits a decomposition in the style of Williams and Beer, including the total correlation, the negentropy, and the mutual information as special cases. This paper explores how the generalized information decomposition can reveal novel insights into existing measures, as well as the nature of higher-order synergies. We show that synergistic information is intimately related to the well-known Tononi-Sporns-Edelman (TSE) complexity, and that synergistic information requires a similar integration/segregation balance as a high TSE complexity. Finally, I end with a discussion of how this approach fits into other attempts to generalize the PID and the possibilities for empirical applications.
Active Inference Institute information:
Website: https://activeinference.org/
Twitter: https://twitter.com/InferenceActive
Discord: https://discord.gg/8VNKNp4jtx
YouTube: https://www.youtube.com/c/ActiveInference/
Active Inference Livestreams: https://coda.io/@active-inference-institute/livestreams
CSID: ccd5b36fe12011c2
Content Managed by ContentSafe.co
-
3:58:22
Due Dissidence
15 hours agoBIDEN DROPS OUT, ICJ Orders END To Israeli Occupation
69.6K48 -
3:10:48
vivafrei
13 hours agoEp. 220: Hillary Running? Trump Assassination Attempt UPDATES! Student Loans; Hunter Biden & MORE!
219K485 -
1:56:22
The Quartering
7 hours agoJoe Biden Drops Out, Massive Fallout To Come, Kamala Issues Statements, Trump Shooter Update!
117K115 -
28:22
The Dan Bongino Show
9 hours agoEMERGENCY BROADCAST: Bongino on Biden Dropping Out
1.08M3.91K -
1:24:30
Tate Speech by Andrew Tate
9 hours agoEMERGENCY MEETING EPISODE 61 - $DADDY DOESNT PULL OUT
380K397 -
1:48:30
The Charlie Kirk Show
10 hours agoBiden Drops Out! LIVE with Charlie Kirk! 7/21/24
537K735 -
2:22:44
Benny Johnson
10 hours ago🚨BREAKING: Joe Biden DROPS OUT, Democrats in PANIC, | This Was a SET UP
304K785 -
2:00:20
Joe Pags
10 hours agoBiden Out!
176K74 -
3:00:23
DDayCobra
10 hours agoJoe Biden QUITS
136K51 -
LIVE
NEWSMAX
8 months agoNEWSMAX2 LIVE | Real News for Real People
3,164 watching