NeuroEvolution of Augmenting Topologies (NEAT) and Compositional Pattern Producing Networks (CPPN)
❤️ Become The AI Epiphany Patreon ❤️ https://www.patreon.com/theaiepiphany 👨👩👧👦 Join our Discord community 👨👩👧👦 https://discord.gg/peBrCpheKE In this video I cover 2 papers: 1) NEAT: NeuroEvolution of Augmenting Topologies - a seminal paper from 2002 that evolves not just the network weights but also network architectures 2) CPPN: Compositional Pattern Producing Networks: A Novel Abstraction of Development - an interesting model of developmental biology with a completely different approach compared to e.g. cellular automata models ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ ✅ NEAT paper: http://nn.cs.utexas.edu/downloads/papers/stanley.ec02.pdf ✅ CPPN paper: http://eplex.cs.ucf.edu/papers/stanley_gpem07.pdf ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ ⌚️ Timetable: 00:00 Intro to NEAT and CPPNs 02:35 Basic ideas behind NEAT 07:55 NEAT genome explained 11:05 Competing conventions problem 13:25 NEAT mutations explained 15:30 NEAT genome mating explained 19:20 Maintaining innovations via speciation 25:25 Explicit fitness sharing 29:45 NEAT on XOR task 31:30 CPPNs and neural automata 36:40 Spatial signal as a chemical gradient abstraction 39:20 Composing functions 45:10 CPPN main idea recap 46:45 Breeding "images" using CPPNs 49:20 CPPNs are highly expressive (symmetries, repetition...) 54:17 HyperNEAT idea explained 57:43 Outro ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ 💰 BECOME A PATREON OF THE AI EPIPHANY ❤️ If these videos, GitHub projects, and blogs help you, consider helping me out by supporting me on Patreon! The AI Epiphany - https://www.patreon.com/theaiepiphany One-time donation - https://www.paypal.com/paypalme/theaiepiphany Huge thank you to these AI Epiphany patreons: Eli Mahler Kevin Stone Petar Veličković ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ 💼 LinkedIn - https://www.linkedin.com/in/aleksagordic/ 🐦 Twitter - https://twitter.com/gordic_aleksa 👨👩👧👦 Discord - https://discord.gg/peBrCpheKE 📺 YouTube - https://www.youtube.com/c/TheAIEpiphany/ 📚 Medium - https://gordicaleksa.medium.com/ 💻 GitHub - https://github.com/gordicaleksa 📢 AI Newsletter - https://aiepiphany.substack.com/ ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ #NEAT #CPPN #evolution
