Meta's Code World Model

In this video I look at some new research out of Meta which is a code world model and is basically an LLM trained in a different way to try and get it to understand the tokens that it's generating. more than a conventional LLM. Blog: https://ai.meta.com/research/publications/cwm-an-open-weights-llm-for-research-on-code-generation-with-world-models/ HF: https://huggingface.co/facebook/cwm For more tutorials on using LLMs and building agents, check out my Patreon Patreon: https://www.patreon.com/SamWitteveen Twitter: https://x.com/Sam_Witteveen 🕵️ Interested in building LLM Agents? Fill out the form below Building LLM Agents Form: https://drp.li/dIMes 👨‍💻Github: https://github.com/samwit/llm-tutorials ⏱️Time Stamps: 00:00 Intro 02:04 World Models 04:55 Agentic Interactions 06:03 CWM Diagram 07:01 Agentic Loop 09:04 CWM Hugging Face 09:38 Code World Model Paper