←BACK TO WORK
modular information retrieval
A modular search engine built from scratch using Wikipedia text to explore core Information Retrieval concepts such as inverted indexing, TF-IDF, BM25, and relevance evaluation.
Description
A modular search engine built from scratch using Wikipedia text to explore core Information Retrieval concepts such as inverted indexing, TF-IDF, BM25, and relevance evaluation.
The Experiment
Deep dive into search engine mechanics and Information Retrieval theory.
Core Insights
Built an end-to-end information retrieval engine parsing raw text into searchable inverted indexes with mathematical ranking.
Tech Stack
PythonInverted IndexingTF-IDFBM25Search Evaluation
Tools & Concepts Learned
Inverted Index Data StructuresBM25 Ranking AlgorithmText Tokenization
Deployment Status
Offline / Development
CLI search engine pipeline repository.