Home▸Data Science▸Vector-Space Search Engine: tf-idf Cosine Retrieval, Common-Word Damping and Ranking Quality

Vector-Space Search Engine: tf-idf Cosine Retrieval, Common-Word Damping and Ranking Quality

Search a synthetic corpus of documents on six topics with raw term counts, tf-idf and sublinear tf-idf under cosine similarity. Raise the share of common words in documents and queries and watch raw counts lose to idf weighting in precision at ten and mean reciprocal rank, with document frequency, cosine and idf checked by brute force and closed form. A Blender-built data bench with a ranked result list.

Data Science3DModerate60 FPS📱 Mobile-adapted🟠 Blender⇄ 2D version
Vector-Space Search Engine: tf-idf Cosine Retrieval, Common-Word Damping and Ranking Quality ↗ Open standalone

Search a synthetic corpus of documents on six topics with raw term counts, tf-idf and sublinear tf-idf under cosine similarity. Raise the share of common words in documents and queries and watch raw counts lose to idf weighting in precision at ten and mean reciprocal rank, with document frequency, cosine and idf checked by brute force and closed form. A Blender-built data bench with a ranked result list.

⚙ Under the hood

Search a synthetic corpus of documents on six topics with raw term counts, tf-idf and sublinear tf-idf under cosine similarity. Raise the share of common words in documents and queries and watch raw counts lose to idf weighting in precision at ten and mean reciprocal rank, with document frequency, cosine and idf checked by brute force and closed form. A Blender-built data bench with a ranked result list.

TF-IDFInformation RetrievalCosine SimilarityVector Space ModelSearch Ranking

3D · Three.js / WebGL renderer · 60 FPS target · runs fully client-side, no install

What did you find?

Add reproduction steps (optional)