Ilya Sutskever argues pre-training era is over, research is back

On the Dwarkesh podcast, Sutskever declared pre-training is over and research is back, arguing scaling yields to brain-inspired learning. He also said "a human being is not an AGI" because humans lack a huge amount of knowledge and instead rely on continual learning.

Featured · Ilya Sutskever