Karpathy: Context windows are a cheap way to manipulate AI

Andrej Karpathy said that context windows provide a cheap way to manipulate AI, while fine-tuning or customizing a model without losing capabilities is much trickier. The remarks were made on the No Priors Podcast.

Featured · Andrej Karpathy