[ML News] Geoff Hinton leaves Google | Google has NO MOAT | OpenAI down half a billion

#google #openai #mlnews

Updates from the world of Machine Learning and AI
Great AI memes here: https://twitter.com/untitled01ipynb

OUTLINE:
0:00 - Google I/O 2023: Generative AI in everything
0:20 - Anthropic announces 100k tokens context
0:35 - Intro
1:20 - Geoff Hinton leaves Google
7:00 - Google memo leaked: we have no moat
11:30 - OpenAI loses 540M
12:30 - Google AI: Product first
15:50 - Ilya Sutskever on safety vs competition
18:00 - AI works cannot be copyrighted
19:40 - OpenAI tries to trademark GPT
20:30 - StarCoder: accessible code model
21:40 - RedPyjama & OpenLlama
22:55 - Mosaic 7B model
23:50 - YoloNAS
24:10 - Mojo programming language
25:30 - Random helpful things
37:40 - DeepMind soccer robots

References:
https://twitter.com/weirddalle/status/1649908805788893185
https://www.nytimes.com/2023/05/01/technology/ai-google-chatbot-engineer-quits-hinton.html
https://www.technologyreview.com/2023/05/01/1072478/deep-learning-pioneer-geoffrey-hinton-quits-google/
https://archive.ph/TrPoH
https://twitter.com/DanHendrycks/status/1654560913939374080
https://twitter.com/ylecun/status/1654930029569101824
https://twitter.com/home
https://twitter.com/ylecun/status/1654931495419621376
https://twitter.com/pkedrosky/status/1653955254181068801
https://www.semianalysis.com/p/google-we-have-no-moat-and-neither
https://twitter.com/untitled01ipynb/media
https://www.theinformation.com/articles/openais-losses-doubled-to-540-million-as-it-developed-chatgpt
https://archive.ph/bKsdM
https://www.washingtonpost.com/technology/2023/05/04/google-ai-stop-sharing-research/
https://twitter.com/giffmana/status/1654962145707130880
https://twitter.com/Ken_Goldberg/status/1651309843804987393
https://tsdr.uspto.gov/documentviewer?caseId=sn97733259&docId=PTD20230418160641&s=09#docIndex=1&page=1
https://twitter.com/osanseviero/status/1654230764513370112
https://huggingface.co/bigcode/starcoder
https://huggingface.co/spaces/bigcode/bigcode-model-license-agreement
https://twitter.com/hardmaru/status/1654649036333514753
https://www.together.xyz/blog/redpajama-models-v1
https://huggingface.co/togethercomputer/RedPajama-INCITE-Base-3B-v1
https://github.com/openlm-research/open_llama
https://www.mosaicml.com/blog/mpt-7b
https://github.com/Deci-AI/super-gradients/blob/master/YOLONAS.md
https://www.modular.com/mojo
https://www.aicrowd.com/challenges/hackaprompt-2023
https://learnprompting.org/
https://developer.nvidia.com/blog/nvidia-enables-trustworthy-safe-and-secure-large-language-model-conversational-systems/?ncid=prsy-552511
https://blogs.nvidia.com/blog/2023/04/25/ai-chatbot-guardrails-nemo/
https://lmql.ai/#distribution
https://github.com/gventuri/pandas-ai?utm_source=pocket_reader
https://lamini.ai/blog/introducing-lamini
https://github.com/deep-floyd/IF
https://huggingface.co/spaces/DeepFloyd/IF
https://twitter.com/FaramaFound/status/1650952295901720576
https://txt.cohere.com/embedding-archives-wikipedia/?hsa_acc=509563538&hsa_ad=242008083&hsa_cam=626636963&hsa_grp=205646033&hsa_net=linkedin&hsa_ver=3&hss_channel=lcp-24024765
https://arxiv.org/abs/2304.12210
https://github.com/h2oai/h2ogpt
https://huggingface.co/h2oai/h2ogpt-oasst1-512-20b
https://github.com/h2oai/h2o-llmstudio
https://ai.facebook.com/blog/ai-dataset-animating-kids-drawings/
https://www.camel-ai.org/
https://github.com/lightaime/camel?utm_source=pocket_reader
https://huggingface.co/Writer/camel-5b-hf
https://laion.ai/blog/paella/
https://magazine.sebastianraschka.com/p/finetuning-large-language-models
https://pickapic.io/
https://github.com/yuvalkirstain/heroku_app
https://huggingface.co/datasets/yuvalkirstain/PickaPic
https://future.snorkel.ai/poster-contest/
https://twitter.com/d_feldman/status/1649466422018318338/photo/4
https://twitter.com/DeepMind/status/1651897358894919680
https://arxiv.org/abs/2304.13653
https://twitter.com/SmokeAwayyy/status/1652712832738422784

Links:
Homepage: https://ykilcher.com
Merch: https://ykilcher.com/merch
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://ykilcher.com/discord
LinkedIn: https://www.linkedin.com/in/ykilcher

If you want to support me, the best thing to do is to share out the content :)

If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: https://www.subscribestar.com/yannickilcher
Patreon: https://www.patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n