Video by Hugging Face via YouTube
Training Agents IRL: four talks and a panel on post-training agents with open models
Training Agents IRL is the in-person follow-up to the Training Agents livestream series. Speakers from Microsoft, Mercor, RadixArk and BenchFlow cover enterprise RL, environment design, scaling agent RL with Miles, and OpenEnv Arena. A panel and audience Q&A close the session.
The four livestream classes teach the methods discussed here, step by step. If a talk makes you want to try something yourself, start there.
CHAPTERS
00:00 Training Agents livestream series recap
01:46 Learnings from enterprise RL (Gobind, Microsoft)
19:23 Environments and benchmarks in industry (Victor, Mercor)
40:25 How to train your agents with Miles (Tao Lin, RadixArk)
52:40 Why we built OpenEnv Arena (Xiangyi Li, BenchFlow)
1:07:54 Panel discussion
1:38:28 Audience Q&A
SLIDES
All slides https://huggingface.co/buckets/burtenshaw/training-agents-irl
Intro (Training Agents IRL) https://huggingface.co/buckets/burtenshaw/training-agents-irl/resolve/00-training-agents-irl-intro.pptx
Learnings from enterprise RL https://huggingface.co/buckets/burtenshaw/training-agents-irl/resolve/01-learnings-from-enterprise-rl.html
How to train your agents with Miles https://huggingface.co/buckets/burtenshaw/training-agents-irl/resolve/02-how-to-train-your-agents-with-miles.pdf
Why we built OpenEnv Arena https://huggingface.co/buckets/burtenshaw/training-agents-irl/resolve/03-why-we-built-openenv-arena.html
TRAINING AGENTS LIVESTREAM SERIES
Full curriculum (blog) https://huggingface.co/blog/huggingface/train-agents
Playlist https://www.youtube.com/playlist?list=PLo2EIpI_JMQvQZm-kVlz4wY1vWF0LBcf5
Class 1, fine-tune a coding agent on traces https://www.youtube.com/watch?v=rNgUoH7Wbv8 Code: https://huggingface.co/burtenshaw/gemma4-pi-mono-youtube-livestream-1-scripts TRL SFT Trainer: https://huggingface.co/docs/trl/sft_trainer
Class 2, distillation https://www.youtube.com/watch?v=GZT_oNQnLV4 Collection: https://huggingface.co/collections/sergiopaniego/training-agents-class-2-distillation-6a47a62b9f09867dccf61e1e TRL Distillation Trainer: https://huggingface.co/docs/trl/distillation_trainer
Class 3, reinforcement learning https://www.youtube.com/watch?v=ztdTed5egrM Collection: https://huggingface.co/collections/sergiopaniego/training-agents-class-3-reinforcement-learning-6ad6aa71050342629dd0e3ec TRL GRPO Trainer: https://huggingface.co/docs/trl/grpo_trainer
Class 4, from reward functions to environments https://www.youtube.com/watch?v=nJV3yUuz6DU Collection: https://huggingface.co/collections/sergiopaniego/training-agents-class-4-rl-environments-6aa27543918888a0f2b5312c
RL for Agents Workshop https://www.youtube.com/watch?v=cixmqTsi2A4
TOOLS AND PROJECTS FROM THE TALKS
Miles (RadixArk) https://github.com/radixark/miles
Miles docs https://miles.radixark.com
OpenEnv Arena https://posttrain.com
OpenEnv docs https://huggingface.co/docs/openenv
TRL + OpenEnv https://huggingface.co/docs/trl/openenv
Async GRPO Trainer https://huggingface.co/docs/trl/async_grpo_trainer
FURTHER READING
Train the agent, not just the model (slides) https://huggingface.co/spaces/sergiopaniego/train-the-agent-slides
Harness, scaffold, and the AI agent terms worth getting right https://huggingface.co/blog/agent-glossary
A brief history of distillation in AI https://huggingface.co/blog/sergiopaniego/brief-history-of-distillation-in-ai
Distillation in 2026 (so far) https://huggingface.co/blog/sergiopaniego/distillation-2026
How frontier models train on outcomes in 2026 https://huggingface.co/blog/sergiopaniego/agentic-rl-2026
Fine-tuning a 350M model for structured outputs in 100 GRPO steps https://huggingface.co/blog/grpo-with-trl-ifstruct
Why RL environments work now (and could not in 2016) https://huggingface.co/blog/sergiopaniego/rl-environments-story
One sandbox per rollout https://huggingface.co/blog/sergiopaniego/rl-environments-2026
Keep the tokens flowing, lessons from 16 open-source RL libraries https://huggingface.co/blog/async-rl-training-landscape
The ultimate guide to multi-harness RL https://huggingface.co/spaces/FineEnvs/multi-harness-rl
Multi-harness RL slides https://huggingface.co/spaces/FineEnvs/multi-harness-rl-slides
OpenEnv harnesses https://huggingface.co/docs/openenv/tutorials/harnesses
Hugging Face LLM Course https://huggingface.co/learn/llm-course