Browser Use Odysseys2 Just Exposed the Limits of AI Agents!
Want to make money and save time with AI? Join here: https://www.skool.com/ai-profit-lab-7462/about Video notes + links to the tools 👉 https://www.skool.com/ai-profit-lab-7462/about Get a FREE AI Course + Community + 1,000 AI Agents 👉https://www.skool.com/ai-seo-with-julian-goldie-1553/about Order AI SEO here → https://go.juliangoldie.com/backlink-portal Free GEO & AI SEO Checklist! https://orders.goldie.agency/signup Get a FREE GEO + AEO Strategy Session → https://go.juliangoldie.com/strategy-session?utm=julian Get 200+ Free AI SEO Prompts → https://go.juliangoldie.com/chat-gpt-prompts?utm=julian Get our free SEO Link Building Book here: https://go.juliangoldie.com/opt-in?utm=julian Your AI agent says the job’s done, but is it? Odyssey’s 2, a new web-agent test from Carnegie Mellon and Browser Use, opened the files agents handed back, and one agent’s score fell from 94.9 to 5.8. Learn what slipped through and how to check your own agent’s work. 00:00 Intro – Agents say “done,” but is it? 00:41 Web Agents – What they are 01:00 Odyssey’s 2 – 100 live tasks, 982 checks 01:43 Why a Second Test – Old one maxed out 02:13 New Judge – It reads the files 02:35 Score Collapse – 86 perfect drops to 47 03:31 Leaderboard – Best agent: 47 of 100 03:56 Caught Cheating – Fake results get zero 04:17 Human vs AI Review – Missed link found 04:57 Speed vs Quality – Fast leads, slow wins 05:34 Setup Matters – Same model, new scores 06:07 Same Agent, 8 Runs – Wild swings 06:39 6 Takeaways – Trust, but verify 07:04 Test Your Own Agent – Free benchmark 07:23 Next Steps – AI Profit Boardroom and AI Success Lab
