Back to projects
ML InfrastructureRetrieval

Custom Vector Database

A lightweight educational vector database built from scratch in Python, featuring dense vector storage, metadata filtering, exact similarity search, graph-based approximate search, and JSON persistence.

GitHub repository

Views

1

Stars

0

Forks

0

Updated

Jun 22, 2026

Case study

A from-scratch vector database implementation that demonstrates understanding of similarity search internals and vector storage design.

Problem solved

Shows how vector databases work internally, including indexing, metadata filtering, and approximate search.

Related projects

Retrieval

Custom Retrieval Pipeline with Reranker

Featured

End-to-end local retrieval pipeline with BM25, FAISS dense search, hybrid ranking, a custom scikit-learn feature reranker, evaluation metrics, CLI tooling, and Streamlit demo.

Improves document retrieval quality by combining sparse search, dense search, and learned reranking.

PythonBM25FAISSHybrid SearchReranking
0 0 0
Case study Repo

NLP

Custom BPE Tokenizer

Featured

Advanced tokenizer engineering project implementing BPE, byte-level BPE, WordPiece, and SentencePiece-style unigram tokenization, with benchmarking against Hugging Face tokenizers and API/demo tooling.

Explains and implements the core tokenization algorithms behind modern language models.

PythonNLPTokenizationBPEWordPiece
0 0 0
Case study Repo