HomeAI & Machine LearningToken Attention Graph

Word Embedding Space Simulator

Interactive 3D word embedding simulator: explore a point cloud of word vectors clustering by semantic similarity, trace nearest neighbors by cosine distance, and watch analogy vectors (king − man + woman ≈ queen) in real time.

AI & Machine Learning3DEasy60 FPS📱 Mobile-adapted⇄ 2D version
3d-natural-language-processing-data-science ↗ Open standalone

Word embeddings are the foundation every modern NLP system is built on: instead of treating words as arbitrary symbols, models like Word2Vec, GloVe and BERT map each word to a dense vector so that semantically related words land close together in the space. This simulator plots a small vocabulary as a live 3D point cloud — animals, royalty, cities and numbers each form their own visible cluster — and lets you pick any word to trace its nearest neighbors by cosine similarity. A built-in analogy button runs the classic "king − man + woman ≈ queen" vector arithmetic so you can watch the resulting point land right next to "queen," a direct visualization of why embeddings support reasoning about meaning, not just lookup.

⚙ Under the hood

Represents word embeddings in a vector space where semantically related words cluster together, demonstrating the king-man+woman=queen analogy.

Natural Language ProcessingData ScienceMachine LearningToken Attention

3D · Three.js / WebGL renderer · 60 FPS target · runs fully client-side, no install

What did you find?

Add reproduction steps (optional)