Scaling up Continual Learning — Ronak Malde, Trajectory

Ronak Malde of Trajectory describes how scaling policy self-distillation to trajectories with a hundred tool calls makes a model collapse into hedging, filling tokens with "wait, but, and maybe" — a failure he calls the "but wait problem".

Featured · Ronak Malde