AnalysisAI Models
18 days ago
Mental framework for transformer learning limits

swyx
@swyxachieve ambition with intentionality, intensity, integrity & insanity. affiliations: - @dxtipshq - @cognition - @temporalio - @aidotengineer - @latentspacepod
san francisco / singaporeswyx.io

Swyx
@swyx
co-sign. a very handy mental framework for what kinds of learning transformers do well today, and why it runs into limitations. when @ankit2119 and i wrote about the need for adversarial world models earlier this year, we were describing a couple of the functions of these rungs

·
18 days ago