01About
I'm Muhammad Hamza — a fourth-year undergraduate at Indian Institute of Technology, Kharagpur, pursuing a Dual Degree (B.Tech + M.Tech) in Chemical Engineering with a specialisation in Artificial Intelligence & Applications. My research interests span
I aspire to work as an ML Engineer and actively seek collaborations in NLP, LLMs, and Computer Vision. Outside the lab, I write on Medium (cricket & sports analytics), have accumulated 1 Million+ views on Quora, and write fiction: I've published a Sherlock Holmes novel and a story collection.
02News
03Industry Experience
04Research




05Publications
06Projects
ApexSearch: Audio-Visual RAG & Multimodal Video Retrieval Engine
Engineered an interactive, end-to-end multimodal retrieval-augmented generation (RAG) system allowing natural language querying and autonomous live commentary over untrimmed, high-speed Formula 1 broadcasts.
- Localizes specific events (e.g., crashes, pit stops) in untrimmed sports broadcasts from natural language queries.
- Extracts temporal visual features (1 FPS) and synchronized audio chunks, vectorizing them via frozen CLIP and CLAP transformers into independent FAISS databases for sub-50ms retrieval.
- Implements a dynamically weighted late-fusion scoring heuristic to resolve cross-modal ambiguity (e.g., trusting audio over visual during heavy motion blur).
- Serverless deployment on GitHub and Streamlit Community Cloud, with Vision-Language Model inference offloaded to Groq API calls for zero-cost hosting.
Synthesia: Visuo-Lingual Affective Recommender System
Engineered a multimodal machine learning pipeline fusing facial expression recognition and textual sentiment analysis to power a dynamic, emotion-driven movie recommendation engine.
- Late-Fusion architecture using ResNet (via DeepFace) for visual emotion extraction and DistilRoBERTa for textual sentiment, mathematically blending the distributions.
- Dense vector search engine using FAISS and MiniLM embeddings to retrieve and rank recommendations.
- Quantitative ablation study showing Late-Fusion outperforms unimodal baselines.
- Deployed to a live cloud server, resolving Linux graphics driver dependencies and Python versioning conflicts.
VictorianGPT: Compound AI Conversational Agent
Engineered an end-to-end pipeline combining Parameter-Efficient Fine-Tuning with Retrieval-Augmented Generation to deploy an atmospheric, 19th-century conversational agent.
- Fine-tuned Qwen 2.5 3B Instruct with QLoRA (4-bit) on ~10,000 synthetic conversational pairs to match a Dark Academia and Victorian gothic aesthetic.
- Semantic memory pipeline using ChromaDB and MiniLM embeddings to inject historical context from 19th-century literature (Dickens, Stoker, Wilde).
- Resolved 'Context Domination' (Lazy RAG) by restructuring the prompt injection hierarchy and tuning repetition penalties to force original prose.
- Deployed to Hugging Face Spaces via a custom Gradio interface, managing background threads and memory caching.
ML-Driven Volatility Surface Modeling — NIFTY50 Options
High-frequency options volatility forecasting pipeline on 578,000+ NIFTY50 index records across 50+ strikes & maturities. Achieved ultra-low MSE of 0.00009 via batch-wise ensemble with strike-aware feature selection.
- Engineered 100+ features including Greeks, moneyness, term structure, and microstructure signals for implied volatility surface modelling.
- Batch-wise ensemble integrating gradient boosting and regularised regression, outperforming standard ML baselines by over 10× in accuracy.
07Scholastic Achievements
08Writing

A Sherlock Holmes novel.
View on Amazon
A collection of mysteries.
View on AmazonOccasional Verse
6 poems on memory, war, and the burden of consciousness.
Free Stories
Shorter fiction: mystery, philosophy, and the uncanny.