GPT-2 Small embedding geometry visualized around 'Trump' token

Visualization of GPT-2 Small's static embedding for 'Trump' using t-SNE on 32,070 alphabetic tokens. Compares discretized vs. continuous nearest neighbors before attention.