[ML News] BLOOM: 176B Open-Source | Chinese Brain-Scale Computer | Meta AI: No Language Left Behind

#mlnews #bloom #ai

Today we look at all the recent giant language models in the AI world!

OUTLINE:
0:00 - Intro
0:55 - BLOOM: Open-Source 176B Language Model
5:25 - YALM 100B
5:40 - Chinese Brain-Scale Supercomputer
7:25 - Meta AI Translates over 200 Languages
10:05 - Reproducibility Crisis Workshop
10:55 - AI21 Raises $64M
11:50 - Ian Goodfellow leaves Apple
12:20 - Andrej Karpathy leaves Tesla
12:55 - Wordalle

References:
BLOOM: Open-Source 176B Language Model
https://bigscience.huggingface.co/blog/bloom
https://huggingface.co/spaces/bigscience/license
https://huggingface.co/bigscience/bloom?text=34%2B10%3D44+%0A54%2B20%3D

YALM 100B
https://github.com/yandex/YaLM-100B

Chinese Brain-Scale Supercomputer
https://www.scmp.com/news/china/science/article/3182498/china-supercomputer-achieves-global-first-brain-scale-ai-model?utm_source=pocket_mylist
https://archive.ph/YaoA6#selection-1237.156-1237.246

Meta AI Translates over 200 Languages
https://ai.facebook.com/research/no-language-left-behind/

Reproducibility Crisis Workshop
https://reproducible.cs.princeton.edu/

AI21 Raises $64M
https://techcrunch.com/2022/07/12/openai-rival-ai21-labs-raises-64m-to-ramp-up-its-ai-powered-language-services/?guccounter=1

Ian Goodfellow leaves Apple
https://twitter.com/goodfellow_ian/status/1544638709039091717

Andrey Karpathy leaves Tesla
https://mobile.twitter.com/karpathy/status/1547332300186066944
https://www.businessinsider.com/report-tesla-laid-off-about-200-people-in-autopilot-unit-2022-6?r=US&IR=T

Wordalle
https://huggingface.co/spaces/huggingface-projects/wordalle?utm_source=pocket_mylist

Links:
Homepage: https://ykilcher.com
Merch: https://ykilcher.com/merch
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://ykilcher.com/discord
LinkedIn: https://www.linkedin.com/in/ykilcher

If you want to support me, the best thing to do is to share out the content :)

If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: https://www.subscribestar.com/yannickilcher
Patreon: https://www.patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n