How The AI Agent Deleted Production Database in 9 Seconds

From the creator

https://zenity.io/blog/current-events/ai-agent-database-deletion-pocketos What actually happened, stripped down: A Cursor agent in a staging environment hit a credential mismatch, went hunting for a fix on its own, found a Railway API token meant for domain management, discovered the token had blanket permissions across Railway's GraphQL API, and called volumeDelete on production. Nine seconds. Backups were stored in the same volume, so they died too. Three months of data gone. The agent then wrote a confession listing every safety rule it broke — including the system prompt instruction to never run destructive commands without permission. The single most important point in the piece: The agent wasn't hacked. It wasn't prompt-injected. It was being helpful. That's the whole problem with agentic AI safety in 2026 — the failure mode isn't malice, it's well-intentioned reasoning ending in catastrophe. A goal-seeking system with destructive-capable tools and only a system prompt as the seatbelt is one bad inference away from disaster.

Stop watching · start building
Matched to AI Agents

Makers residency 4th edition

Your idea can be anything. At our last workshops, people built plant-based nutrition businesses, a way to measure planetary resilience, crochet headwear and a way to connect lonely people living in the same building. An asset manager went on to raise an additional £25M on their fund within nine months. The fourth workshop is a full day at KOKO with Nick Sarafa, learning to build with Claude Code. Bring the thing you keep meaning to start. We’ll bring the pizza.

◆ Fri 13 Nov 2026 ◆ KOKO, London
Makers residency 4th edition
Live event
Makers residency 4th edition
Fri 13 Nov 2026

More like this

Running one yourself?

List your AI event,
wherever it is.

A meetup, a workshop, a hackathon, a conference. Any city, or online. Tell us about it and it lands in front of people already learning this stuff.