Notes from production

June 2026 · 4 min read

Evals before launch: testing agent behaviour like code

The difference between an AI demo and an AI system is not the model – it is whether anyone can prove the system still works after something changes. Here is how we gate releases on evals across three production systems.