Unlocking AI’s Black Box: New Formula Explains How They Detect Relevant Patterns
The findings can also be applied to enhance the efficiency of various machine learning frameworks.
Neural networks have been powering breakthroughs in artificial intelligence, including the large language models that are now being used in a wide range of applications, from finance, to human resources to healthcare. But these networks remain a black box whose inner workings engineers and scientists struggle to understand. Now, a team led by data and computer scientists at the University of California San Diego has given neural networks the equivalent of an X-ray to uncover how they actually learn.
The researchers found that a formula used in statistical analysis provides a streamlined mathematical description of how neural networks, such as GPT-2, a precursor to ChatGPT, learn relevant patterns in data, known as features. This formula also explains how neural networks use these relevant patterns to make predictions.
“We are trying to understand neural networks from first principles,” said Daniel Beaglehole, a Ph.D. student in the UC San Diego Department of Computer Science and Engineering and co-first author of the study. “With our formula, one can simply interpret which features the network is using to make predictions.”
-
1:21:17
Redacted News
5 hours ago🚨 BREAKING! BIDEN REPLACEMENT ANNOUNCEMENT COMING, White House in PANIC mode | Redacted News
121K232 -
53:44
The Osbournes
5 days ago $1.31 earned50 Cent vs. Trump, 7M Dance Cult Drama, and Sharon's TikTok Spiral
27K45 -
1:59:37
Revenge of the Cis
4 hours agoEpisode 1359: Major Disappointment
34.8K9 -
1:01:57
In The Litter Box w/ Jewels & Catturd
22 hours agoBiden FREEZES! | In the Litter Box w/ Jewels & Catturd - Ep. 588 - 6/17/2024
65.9K48 -
7:45
Ignace Aleya
3 days agoI Turned My Car Into A Transformer (challenging Hollywood)
31.5K7 -
1:27:35
Winston Marshall
2 days agoWho Are More Radical…Populists or The ELITE?! EU Election Breakdown | The Winston Marshall Show #019
46K39 -
4:13
OUT OF ORDER
6 hours agoThe Age of Elegance - Season 2
53.1K4 -
1:59:44
Barstool Yak
9 hours agoThe Yak with Big Cat & Co. Presented by Rhoback | The Yak 6-17-24
49.4K -
53:45
The Kevin Trudeau Show
5 hours agoYour Wish Is Your Command | The Kevin Trudeau Show | Ep. 22
46.1K11 -
1:54:49
Russell Brand
11 hours agoBREAKING: Putin’s Peace Deal REJECTED By NATO! - Stay Free 387
232K603