Premium Only Content

ActInf GuestStream 079.1 ~ Ryota Kanai: "Meta-Representations as Representations of Processes"
"Meta-Representations as Representations of Processes"
Ryota Kanai, Ryota Takatsuki, and Ippei Fujisawa
https://osf.io/preprints/psyarxiv/zg27u
In this study, we explore how the notion of meta-representations in Higher-Order Theories (HOT) of consciousness can be implemented in computational models. HOT suggests that consciousness emerges from meta-representations, which are representations of first-order sensory representations. However, translating this abstract concept into a concrete computational model, such as those used in artificial intelligence, presents a theoretical challenge. For example, a simplistic interpretation of meta-representation as a representation of representation makes the notion rather trivial and ubiquitous. Here, we propose a refined interpretation of meta-representations. Contrary to the simplistic view of meta-representations as mere transformations of the first-order representational states or confidence estimates, we argue that meta-representations are representations of the processes that generate first-order representations. This presents a process-oriented view whereby meta-representations capture the qualitative aspect of how sensory information is transformed into first-order representations. To concretely illustrate and operationalize thus formulated notion of meta-representation, we constructed "meta-networks" designed to explicitly model meta-representations within deep learning architectures. Specifically, we constructed meta-networks by implementing autoencoders of first-order neural networks. In this architecture, the latent spaces embedding those first-order networks correspond to the meta-representations of first-order networks. By applying meta-networks to embed neural networks trained to encode visual and auditory datasets, we show that the meta-representations of first-order networks successfully capture the qualitative aspects of those networks by separating the visual and auditory networks in the meta-representation space. We argue that such meta-representations would be useful for quantitatively compare and contrast the qualitative differences of computational processes. While whether such meta-representational systems exist in the human brain remains an open question, this formulation of meta-representation offers a new empirically testable hypothesis that there are brain regions that represent the processes of transforming a representation in one brain region to a representation in another brain region. Furthermore, this form of meta-representations might underlie our ability to describe the qualitative aspect of sensory experience or qualia.
Active Inference Institute information:
Website: https://activeinference.org/
Twitter: https://twitter.com/InferenceActive
Discord: https://discord.gg/8VNKNp4jtx
YouTube: https://www.youtube.com/c/ActiveInference/
Active Inference Livestreams: https://coda.io/@active-inference-institute/livestreams
CSID: ebb7a10035fed94d
Content Managed by ContentSafe.co
-
1:28:07
Active Inference Institute
22 days agoActInf GuestStream 112.1 ~ Brain-like variational inference (Hadi Vafaii)
101 -
4:26:54
Nerdrotic
9 hours ago $1.03 earnedFantastic Four Baby Steps V Superman's James Gunn, South Park Returns | Friday Night Tights 364
97.1K7 -
LIVE
megimu32
2 hours agoOFF THE SUBJECT: FAFO Friday! Cops, Crash, Kombat & Chaos!
152 watching -
10:17:28
GrimmHollywood
11 hours ago🔴LIVE • GRIMM HOLLYWOOD • CLIP FARMING 101 •
14.1K1 -
1:07:56
Glenn Greenwald
9 hours agoIsrael-Made Famine Crisis Finally Recognized | SYSTEM UPDATE #493
101K55 -
2:29:42
TheSaltyCracker
4 hours agoGhislaine Maxwell Talks ReEEeStream 7-25-25
84.9K162 -
9:27
MattMorseTV
7 hours ago $0.43 earnedHe just lost EVERYTHING.
24.8K9 -
LIVE
a12cat34dog
5 hours agoSPOOKY ASS 2005 GAME :: F.E.A.R. :: FIRST-TIME FINISHING THIS CLASSIC {18+}
92 watching -
2:13:15
WickedVirtue
2 hours agoFortnite w/ Friends
4.19K -
8:11:13
Spartan
9 hours agoSpartan - Pro Halo Player for OMiT | Scrims vs ETHR
18.8K1