toolsWTF 5.0via r/MachineLearning
Interactive map of GPT-2's token embedding space - tap any token and explore [P]
"finally, a way to see what your LLM is actually smoking inside its brain"
Explain Like I'm Normal
A new interactive 3D map allows users to explore the latent space of GPT-2 by visualizing all 32,070 tokens as a connected graph. Using t-SNE and minimum spanning trees, the tool lets you physically 'walk' through linguistic relationships and see how the model clusters concepts without any active context. It is an impressive piece of interpretability porn that works surprisingly well on mobile browsers.
#visualization#gpt-2#interpretability#embeddings
GET THE DAILY CHAOS
The only newsletter for people who read AI news at 3am and feel things. One email a day.