METR proposes Expenditure Horizon to measure AI optimization ability

The metric accounts for token cost, experiment compute cost, and human labor cost to measure an AI agent's optimization ability. Applied to the NanoGPT speedrun, it illustrates a concrete way to measure AI's ability to accelerate AI R&D.