Noam Brown: AI benchmark scores are misleading

OpenAI researcher Noam Brown argues that standard AI benchmarks don't reflect true model capability because performance is heavily tied to compute budget. He suggests the industry needs to evaluate models at specific cost levels, not just raw scores.