AnalysisAI ModelsOctober 6, 2026

300M-parameter model learns new languages in context

Read original source →arxiv.org

Prior-Fitted Language Model (PFLM) is a 300M-parameter byte-level transformer pretrained only on a synthetic non-linguistic prior. With frozen weights, it learns to predict real text from a prefix, having never seen a word of any real language.

1 source

More stories today

Open the live feed