Vector-Space Search Engine: tf-idf Cosine Retrieval, Common-Word Damping and Ranking Quality
Search a synthetic corpus of documents on six topics with raw term counts, tf-idf and sublinear tf-idf under cosine similarity. Raise the share of common words in documents and queries and watch raw counts lose to idf weighting in precision at ten and mean reciprocal rank, with document frequency, cosine and idf checked by brute force and closed form. A Blender-built data bench with a ranked result list.
Search a synthetic corpus of documents on six topics with raw term counts, tf-idf and sublinear tf-idf under cosine similarity. Raise the share of common words in documents and queries and watch raw counts lose to idf weighting in precision at ten and mean reciprocal rank, with document frequency, cosine and idf checked by brute force and closed form. A Blender-built data bench with a ranked result list.
Search a synthetic corpus of documents on six topics with raw term counts, tf-idf and sublinear tf-idf under cosine similarity. Raise the share of common words in documents and queries and watch raw counts lose to idf weighting in precision at ten and mean reciprocal rank, with document frequency, cosine and idf checked by brute force and closed form. A Blender-built data bench with a ranked result list.
3D · Three.js / WebGL renderer · 60 FPS target · runs fully client-side, no install