←BACK TO WORK
web search engine from scratch
Building a mini web search engine from scratch while studying Information Retrieval. Covers crawling, indexing, retrieval models, ranking, evaluation, and web IR concepts.
Description
Building a mini web search engine from scratch while studying Information Retrieval. Covers crawling, indexing, retrieval models, ranking, evaluation, and web IR concepts.
The Experiment
Understanding search engine crawling and ranking from first principles.
Core Insights
Implemented link graph processing, web document parsing, and PageRank scoring algorithms.
Tech Stack
PythonWeb CrawlerInverted IndexPageRankAlgorithms
Tools & Concepts Learned
Web Crawling GraphsPageRank CalculationVector Space Retrieval
Deployment Status
Offline / Development
Experimental web IR repository.