Unlocking AI’s Black Box: New Formula Explains How They Detect Relevant Patterns
The findings can also be applied to enhance the efficiency of various machine learning frameworks.
Neural networks have been powering breakthroughs in artificial intelligence, including the large language models that are now being used in a wide range of applications, from finance, to human resources to healthcare. But these networks remain a black box whose inner workings engineers and scientists struggle to understand. Now, a team led by data and computer scientists at the University of California San Diego has given neural networks the equivalent of an X-ray to uncover how they actually learn.
The researchers found that a formula used in statistical analysis provides a streamlined mathematical description of how neural networks, such as GPT-2, a precursor to ChatGPT, learn relevant patterns in data, known as features. This formula also explains how neural networks use these relevant patterns to make predictions.
“We are trying to understand neural networks from first principles,” said Daniel Beaglehole, a Ph.D. student in the UC San Diego Department of Computer Science and Engineering and co-first author of the study. “With our formula, one can simply interpret which features the network is using to make predictions.”
-
8:57
Vigilant News Network
17 hours agoThe Top 5 Biden Lies from the DNC | Beyond the Headlines
16.7K35 -
6:28:56
The Charlie Kirk Show
13 hours agoObama On-Stage: The DNC, Night 2
221K339 -
LIVE
Jerry After Dark
19 hours agoJerry After Dark: Overnight Camping
1,692 watching -
2:27:20
The Quartering
13 hours agoLive DNC & Kamala Cringe Rally! Trump DESTROYS Woke Reporter, Kamala Tanks , RFK Joining Trump
122K102 -
6:23:04
Drew Hernandez
22 hours agoWATCH PARTY: DNC ROAST DAY 2
146K133 -
4:31:28
Due Dissidence
15 hours agoLIVE: DNC PROTESTS, DAY 2 - Workers Strike Back Rally w/ Jill Stein, Kshama Sawant, Nick Cruse
112K45 -
1:37:17
Kim Iversen
14 hours agoAbortion Activists Go Wild at the DNC: Abortion Pills & Free Vasectomies on Display
107K167 -
26:31
Michael Franzese
13 hours agoJoe Rogan doesn't HOLD BACK in Netflix Special
89.3K47 -
1:36:32
Glenn Greenwald
14 hours agoIs Kamala Harris "Working Tirelessly" for a Cease-Fire in Gaza?; Jonathan Turley on Free Speech; Richard Medhurst on his UK Arrest | System Update #318
136K136 -
2:21:37
WeAreChange
14 hours agoWARNING: DNC To Be Designated Monkeypox Spreader Event??
120K26