Field notes

What we learn testing AI agents: how we build tasks, what our evals catch, and the writes that go wrong.

  1. 01

    The agent is non-deterministic. The consequence is not.

    Non-deterministic agents still have deterministic consequencesUpdated Ao Fu, Gagan Devagiri3 min read