Google DeepMind pilots world's first double-blind AI evaluations

Google DeepMind is piloting the world's first double-blind evaluation of a proprietary frontier AI model, using a cryptographic environment to prevent benchmark contamination. The pilot tests a Gemini Flash Lite model with partners including the Singapore AI Safety Institute and OpenMined.