Aaronson: LLMs show self-reference emerges without being built in

Scott Aaronson argues that self-referentiality, long thought central to intelligence, was never explicitly built into LLMs like GPT 5.6 Pro and Fable, yet emerged as a byproduct of pretraining. He notes Hofstadter has been stunned by LLM success.