Premium Only Content

Involution: Inverting the Inherence of Convolution for Visual Recognition (Research Paper Explained)
Paper: https://arxiv.org/abs/2103.06255​
Code: https://github.com/d-li14/involution​
Abstract:
Convolution has been the core ingredient of modern neural networks, triggering the surge of deep learning in vision. In this work, we rethink the inherent principles of standard convolution for vision tasks, specifically spatial-agnostic and channel-specific. Instead, we present a novel atomic operation for deep neural networks by inverting the aforementioned design principles of convolution, coined as involution. We additionally demystify the recent popular self-attention operator and subsume it into our involution family as an over-complicated instantiation. The proposed involution operator could be leveraged as fundamental bricks to build the new generation of neural networks for visual recognition, powering different deep learning models on several prevalent benchmarks, including ImageNet classification, COCO detection and segmentation, together with Cityscapes segmentation. Our involution-based models improve the performance of convolutional baselines using ResNet-50 by up to 1.6% top-1 accuracy, 2.5% and 2.4% bounding box AP, and 4.7% mean IoU absolutely while compressing the computational cost to 66%, 65%, 72%, and 57% on the above benchmarks, respectively. Code and pre-trained models for all the tasks are available at this https URL.
Authors: Duo Li, Jie Hu, Changhu Wang, Xiangtai Li, Qi She, Lei Zhu, Tong Zhang, Qifeng Chen
Links:
TabNine Code Completion (Referral): http://bit.ly/tabnine-yannick​
YouTube: https://www.youtube.com/c/yannickilcher​
Twitter: https://twitter.com/ykilcher​
Discord: https://discord.gg/4H8xxDF​
BitChute: https://www.bitchute.com/channel/yann...​
Minds: https://www.minds.com/ykilcher​
Parler: https://parler.com/profile/YannicKilcher​
LinkedIn: https://www.linkedin.com/in/yannic-ki...​
BiliBili: https://space.bilibili.com/1824646584​
If you want to support me, the best thing to do is to share out the content :)
If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: https://www.subscribestar.com/yannick...​
Patreon: https://www.patreon.com/yannickilcher​
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n
-
LIVE
Kim Iversen
1 hour agoEpstein to Empire: Scott Horton Unpacks the Lies That Led Us Here
6,525 watching -
1:48:16
Redacted News
2 hours agoSomething BIG is happening in Ukraine, new CIA coup? Putin launches new massive offensive | Redacted
111K23 -
53:22
Candace Show Podcast
2 hours agoBREAKING! Brigitte Sues Me For Defamation | Candace Ep 218
22.2K51 -
LIVE
Robert Gouveia
1 hour agoObama CRIMINAL REFERRAL!! Tulsi Drops MOTHERLODE! Senators DEMAND Charges!
921 watching -
LIVE
Dr Disrespect
6 hours ago🔴LIVE - DR DISRESPECT - 10 WINS CHALLENGE - BIG ANNOUNCEMENT AT 12PM PT
2,063 watching -
LIVE
Barry Cunningham
2 hours agoPRESIDENT TRUMP MAKES SPEECH ABOUT AI
1,631 watching -
LIVE
The Jimmy Dore Show
21 minutes agoJon Stewart LIVID About Colbert Show Cancelation! Trump ADMITS His Name Is in the Epstein Files!
2,538 watching -
13:18
The Rad Factory
8 hours ago $0.02 earnedIs This E Scooter Worth $900?
73 -
54:38
The Dr. Ardis Show
6 hours ago $1.52 earnedThe Dr. Ardis Show | 5 Ways Alcohol Destroys Your Health | Episode 07.23.2025
1.83K3 -
LIVE
RalliedLIVE
5 hours ago $1.36 earned10 WINS WITH THE SHOTTY BOYS
110 watching