Google Deepmind RT 2 - Using LLMs to Build Thinking, Learning Robots

#deepmind #ai #robotics 🔥 Get my A.I. + Business Newsletter (free): https://natural20.com/ [LINKS] https://www.deepmind.com/blog/rt-2-new-model-translates-vision-and-language-into-action https://robotics-transformer2.github.io/assets/rt2.pdf https://openai.com/research/gpt-4 https://www.understandingai.org/p/large-language-models-explained-with https://voyager.minedojo.org/assets/documents/voyager.pdf https://twitter.com/DrJimFan [MENTIONED VIDEOS] Minecraft AI - SELF-IMPROVING 🤯 autonomous agent: https://www.youtube.com/watch?v=7yI4yfYftfM LLMs as Tool Makers [LATM] - GPT-4 *UPGRADES* lower AI Models. https://www.youtube.com/watch?v=qWI1AJ2nSDY Sam Altman on UBI and Massive Job Losses from AI Automation https://www.youtube.com/watch?v=5Nsqv3FWXio [TIMELINE] [00:00] Intro [02:04] Using LLMs as a "brain" [05:28] Robotic Control [09:03] What's the Point?! [12:40] The Paper [18:15] Dr Jim Fan [19:30] Examples and Limitations [22:59] Training in Simulations