[ML News] Microsoft trains 530B model | ConvMixer model fits into single tweet | DeepMind profitable

#mlnews #turingnlg #convmixer

Your latest upates on what's happening in the Machine Learning world.

OUTLINE:
0:00 - Intro
0:16 - Weights & Biases raises on 1B valuation (sponsored)
2:30 - Microsoft trains 530 billion parameter model
5:15 - StyleGAN v3 released
6:45 - A few more examples may be worth billions of parameters
8:30 - ConvMixer fits into a tweet
9:45 - Improved VQGAN
11:25 - William Shatner AI chats about his life
12:35 - Google AI pushes material science
14:10 - Gretel AI raises 50M for privacy protection
16:05 - DeepMind's push into ML for biology
19:00 - Schmidhuber laudates Kunihiko Fukushima for Bower Award
21:30 - Helpful Things
22:25 - Mosaic ML out of stealth mode
23:55 - First German self-driving train
24:45 - Ex-Pentagon Chief: China has already won
26:25 - DeepMind becomes profitable

Sponsor: Weights & Biases
https://wandb.com

References:
Microsoft Trains 530B Parameter Model
https://www.microsoft.com/en-us/resea...

StyleGAN 3 Code Released
https://nvlabs.github.io/stylegan3/
https://github.com/NVlabs/stylegan3
https://colab.research.google.com/git...

When do labels help?
https://arxiv.org/pdf/2110.04374.pdf

ml_paper.bruh
https://openreview.net/pdf?id=TVHS5Y4...

Improved VQGAN
https://openreview.net/pdf?id=pfNyExj7z2

William Shatner "AI" & Storyfile
https://www.livescience.com/william-s...
https://www.storyfile.com/

GoogleAI Finds Complex Metal Oxides
https://ai.googleblog.com/2021/10/fin...

GretelAI raises 50M Series B
https://techcrunch.com/2021/10/07/gre...
https://gretel.ai/
https://gretel.ai/blog/why-privacy-by...

DeepMind's Push in ML for Bio
https://www.biorxiv.org/content/10.11...
https://deepmind.com/blog/article/enf...

Kunihiko Fukushima wins Bower Award: Schmidhuber Congratulates
https://www.fi.edu/laureates/kunihiko...
https://www.youtube.com/watch?v=ysOw6...

Helpful Things
https://github.com/UKPLab/beir#beers-...
https://arxiv.org/pdf/2104.08663.pdf
https://bayesoptbook.com/
https://github.com/nvlabs/imaginaire/
https://github.com/NVlabs/imaginaire/...

MosaicML out of Stealth Mode
https://www.mosaicml.com/
https://www.mosaicml.com/blog/founder...
https://app.mosaicml.com/library/imag...
https://github.com/mosaicml/composer
https://mosaicml-composer.readthedocs...

Germany's first self-driving train
https://techxplore.com/news/2021-10-g...

Ex-Pentagon Chief: China has already won tech war
https://nypost.com/2021/10/11/pentago...

DeepMind becomes profitable
https://bdtechtalks.com/2021/10/07/go...

Links:
TabNine Code Completion (Referral): http://bit.ly/tabnine-yannick
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://discord.gg/4H8xxDF
BitChute: https://www.bitchute.com/channel/yann...
Minds: https://www.minds.com/ykilcher
Parler: https://parler.com/profile/YannicKilcher
LinkedIn: https://www.linkedin.com/in/ykilcher
BiliBili: https://space.bilibili.com/1824646584

If you want to support me, the best thing to do is to share out the content :)

If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: https://www.subscribestar.com/yannick...
Patreon: https://www.patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n