AnalysisAI ModelsSeptember 4, 2026

Karpathy lecture: 'Delete everything, keep attention'

In a Stanford guest lecture, Andrej Karpathy discusses how programming is changing with Software 2.0 and LLMs as a new computing substrate. He argues the Transformer's success hinges on the attention mechanism, suggesting other components can be removed.

Featured · Andrej Karpathy

1 source

More stories today

Open the live feed