What building Shippy taught us about building agents

Ai2's Shippy agent revealed that reliability comes from deterministic tools and explicit guardrails, not the model itself. The key lessons: use isolated infrastructure, ground evaluations in real workflows, and prioritize tool design over model selection.