POET: Paired Open-Ended Trailblazer | Paper Explained
❤️ Become The AI Epiphany Patreon ❤️ https://www.patreon.com/theaiepiphany 👨👩👧👦 Join our Discord community 👨👩👧👦 https://discord.gg/peBrCpheKE In this video I cover "Paired Open-Ended Trailblazer (POET): Endlessly Generating Increasingly Complex and Diverse Learning Environments and Their Solutions" paper. They simultaneously keep a collection of multiple environments and their associated agents. Environments are occasionally mutated, agents are optimized (using evolutionary search algorithm) w.r.t. their envs. Finally, periodically a competition happens that decides the best agent (out of all agents in the collection) for each env individually. This forms a potent curriculum that leads to agents mastering even tougher envs. ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ ✅ Paper: https://arxiv.org/abs/1901.01753 ✅ Kenneth Stanley on open-endedness: https://www.youtube.com/watch?v=dXQPL9GooyI ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ ⌚️ Timetable: 00:00 Intro to POET 08:00 Evolutionary search explained 17:15 POET algorithm 18:40 Environment encoding 21:35 Agent and reward modeling 24:35 POET main loop 27:30 Environment mutation algorithm 30:35 Results 33:20 Direct-path curriculum comparison 39:45 POET "unstucks" agents 41:30 Extensions and outro ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ 💰 BECOME A PATREON OF THE AI EPIPHANY ❤️ If these videos, GitHub projects, and blogs help you, consider helping me out by supporting me on Patreon! The AI Epiphany - https://www.patreon.com/theaiepiphany One-time donation - https://www.paypal.com/paypalme/theaiepiphany Huge thank you to these AI Epiphany patreons: Kevin Stone Eli Mahler Petar Veličković ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ 💼 LinkedIn - https://www.linkedin.com/in/aleksagordic/ 🐦 Twitter - https://twitter.com/gordic_aleksa 👨👩👧👦 Discord - https://discord.gg/peBrCpheKE 📺 YouTube - https://www.youtube.com/c/TheAIEpiphany/ 📚 Medium - https://gordicaleksa.medium.com/ 💻 GitHub - https://github.com/gordicaleksa 📢 AI Newsletter - https://aiepiphany.substack.com/ ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ #poet #evolution #openended
