In this video I explain the problem formulation of TD-MPC and how TD-MPC works at rollout.
TD-MPC paper: https://arxiv.org/abs/2203.04955
Many thanks to Nicklas Hansen et. al. for publishing their research and open sourcing their code.
Chapters:
0:00 - Intro
0:54 - Notation and problem formulation
6:20 - High level summary of MPC
11:15 - Why are we optimizing for a fixed horizon?
16:03 - Generalizing to a formulation for CEM
17:38 - CEM with a physics thought experiment
23:32 - CEM applied to action trajectories
25:30 - Summary
Choose to Build with AI
Matched to AI skills
AI Maker Residence 3
The third AI workshop taught by our legendary teacher, Nick Sarafa. This is a full-day hands-on training workshop for purposeful co-creation with AI using Claude Code.
Imagine having access to hundreds of billions of dollars of computing power and knowing exactly how to make it work for you through the power of super intelligence.
◆ Fri 09 Oct 2026◆ KOKO Cafe, London◆ With Nick Sarafa
