Premium Only Content

Neural Networks are Decision Trees (w/ Alexander Mattick)
#neuralnetworks #machinelearning #ai
Alexander Mattick joins me to discuss the paper "Neural Networks are Decision Trees", which has generated a lot of hype on social media. We ask the question: Has this paper solved one of the large mysteries of deep learning and opened the black-box neural networks up to interpretability?
OUTLINE:
0:00 - Introduction
2:20 - Aren't Neural Networks non-linear?
5:20 - What does it all mean?
8:00 - How large do these trees get?
11:50 - Decision Trees vs Neural Networks
17:15 - Is this paper new?
22:20 - Experimental results
27:30 - Can Trees and Networks work together?
Paper: https://arxiv.org/abs/2210.05189
Abstract:
In this manuscript, we show that any feedforward neural network having piece-wise linear activation functions can be represented as a decision tree. The representation is equivalence and not an approximation, thus keeping the accuracy of the neural network exactly as is. We believe that this work paves the way to tackle the black-box nature of neural networks. We share equivalent trees of some neural networks and show that besides providing interpretability, tree representation can also achieve some computational advantages. The analysis holds both for fully connected and convolutional networks, which may or may not also include skip connections and/or normalizations.
Author: Caglar Aytekin
Links:
Homepage: https://ykilcher.com
Merch: https://ykilcher.com/merch
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://ykilcher.com/discord
LinkedIn: https://www.linkedin.com/in/ykilcher
If you want to support me, the best thing to do is to share out the content :)
If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: https://www.subscribestar.com/yannickilcher
Patreon: https://www.patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n
-
LIVE
TheSaltyCracker
25 minutes agoUkraine Pokes The Bear ReeEEEStream 06-01-25
10,992 watching -
LIVE
MyronGainesX
13 hours ago $8.38 earnedUkraine Strikes Russia, Diddy Victim Lies, Palantir Takeover, Glenn Greeenwald Blackmail?
2,130 watching -
LIVE
IsaiahLCarter
1 hour agoAPOSTATE RADIO 016: WPATH's Pseudoscientific Insanity (feat. Mia Hughes)
297 watching -
LIVE
EricJohnPizzaArtist
5 days agoAwesome Sauce PIZZA ART LIVE Ep. #49: Rumble Gaming Night featuring Scottish Viking Gaming!
131 watching -
13:23
Exploring With Nug
22 hours ago $2.14 earnedWe Recovered A Stolen Truck From The Swamp!
28.5K2 -
28:59
Athlete & Artist Show
3 hours ago $0.90 earnedFlorida Panthers Sweep Oilers in Stanley Cup Final?
9.9K -
1:09:12
Adam Does Movies
1 day ago $0.52 earned31 On 31 - Law & Disorder Edition - Ranking 31 Mob Movies!
10.3K2 -
LIVE
SpartakusLIVE
2 hours agoNEW Easter Egg, SPECIALIST || Duos w/ @GloryJean followed by quads later!
90 watching -
LIVE
sophiesnazz
4 hours ago $2.57 earnedSEASON 4 UPDATE l PLAYING WI @spartakusLIVE !socials
650 watching -
1:04:22
Squaring The Circle, A Randall Carlson Podcast
1 day ago#049 Mysteries Of The Moon: Lunar Insights - Squaring The Circle: A Randall Carlson Podcast
11.8K3