Workshop: Training Agents at the frontier of AI Industry
Training Agents IRL: four talks and a panel on post-training agents with open models Training Agents IRL is the in-person follow-up to the Training Agents livestream series. Speakers from Microsoft, Mercor, RadixArk and BenchFlow cover enterprise RL, environment design, scaling agent RL with Miles, and OpenEnv Arena. A panel and audience Q&A close the session. The four livestream classes teach the methods discussed here, step by step. If a talk makes you want to try something yourself, start there. CHAPTERS 00:00 Training Agents livestream series recap 01:46 Learnings from enterprise RL (Gobind, Microsoft) 19:23 Environments and benchmarks in industry (Victor, Mercor) 40:25 How to train your agents with Miles (Tao Lin, RadixArk) 52:40 Why we built OpenEnv Arena (Xiangyi Li, BenchFlow) 1:07:54 Panel discussion 1:38:28 Audience Q&A SLIDES All slides https://huggingface.co/buckets/burtenshaw/training-agents-irl Intro (Training Agents IRL) https://huggingface.co/buckets/burtenshaw/training-agents-irl/resolve/00-training-agents-irl-intro.pptx Learnings from enterprise RL https://huggingface.co/buckets/burtenshaw/training-agents-irl/resolve/01-learnings-from-enterprise-rl.html How to train your agents with Miles https://huggingface.co/buckets/burtenshaw/training-agents-irl/resolve/02-how-to-train-your-agents-with-miles.pdf Why we built OpenEnv Arena https://huggingface.co/buckets/burtenshaw/training-agents-irl/resolve/03-why-we-built-openenv-arena.html TRAINING AGENTS LIVESTREAM SERIES Full curriculum (blog) https://huggingface.co/blog/huggingface/train-agents Playlist https://www.youtube.com/playlist?list=PLo2EIpI_JMQvQZm-kVlz4wY1vWF0LBcf5 Class 1, fine-tune a coding agent on traces https://www.youtube.com/watch?v=rNgUoH7Wbv8 Code: https://huggingface.co/burtenshaw/gemma4-pi-mono-youtube-livestream-1-scripts TRL SFT Trainer: https://huggingface.co/docs/trl/sft_trainer Class 2, distillation https://www.youtube.com/watch?v=GZT_oNQnLV4 Collection: https://huggingface.co/collections/sergiopaniego/training-agents-class-2-distillation-6a47a62b9f09867dccf61e1e TRL Distillation Trainer: https://huggingface.co/docs/trl/distillation_trainer Class 3, reinforcement learning https://www.youtube.com/watch?v=ztdTed5egrM Collection: https://huggingface.co/collections/sergiopaniego/training-agents-class-3-reinforcement-learning-6ad6aa71050342629dd0e3ec TRL GRPO Trainer: https://huggingface.co/docs/trl/grpo_trainer Class 4, from reward functions to environments https://www.youtube.com/watch?v=nJV3yUuz6DU Collection: https://huggingface.co/collections/sergiopaniego/training-agents-class-4-rl-environments-6aa27543918888a0f2b5312c RL for Agents Workshop https://www.youtube.com/watch?v=cixmqTsi2A4 TOOLS AND PROJECTS FROM THE TALKS Miles (RadixArk) https://github.com/radixark/miles Miles docs https://miles.radixark.com OpenEnv Arena https://posttrain.com OpenEnv docs https://huggingface.co/docs/openenv TRL + OpenEnv https://huggingface.co/docs/trl/openenv Async GRPO Trainer https://huggingface.co/docs/trl/async_grpo_trainer FURTHER READING Train the agent, not just the model (slides) https://huggingface.co/spaces/sergiopaniego/train-the-agent-slides Harness, scaffold, and the AI agent terms worth getting right https://huggingface.co/blog/agent-glossary A brief history of distillation in AI https://huggingface.co/blog/sergiopaniego/brief-history-of-distillation-in-ai Distillation in 2026 (so far) https://huggingface.co/blog/sergiopaniego/distillation-2026 How frontier models train on outcomes in 2026 https://huggingface.co/blog/sergiopaniego/agentic-rl-2026 Fine-tuning a 350M model for structured outputs in 100 GRPO steps https://huggingface.co/blog/grpo-with-trl-ifstruct Why RL environments work now (and could not in 2016) https://huggingface.co/blog/sergiopaniego/rl-environments-story One sandbox per rollout https://huggingface.co/blog/sergiopaniego/rl-environments-2026 Keep the tokens flowing, lessons from 16 open-source RL libraries https://huggingface.co/blog/async-rl-training-landscape The ultimate guide to multi-harness RL https://huggingface.co/spaces/FineEnvs/multi-harness-rl Multi-harness RL slides https://huggingface.co/spaces/FineEnvs/multi-harness-rl-slides OpenEnv harnesses https://huggingface.co/docs/openenv/tutorials/harnesses Hugging Face LLM Course https://huggingface.co/learn/llm-course
