ML / Blogs

Machine Learning

Deep dives into Theoretical ML, Large Language Models, Neural Operators, Computer Vision — and technical notes from my ongoing research at IIT Kharagpur, Manchester, and Oulu.

6 articles published  ·  updated regularly
Filter :
-->
Optimization Theory Mathematics
The Geometry of Gradient Descent: Why Adam Lies and What to Do About It
May 14, 2026 · 22 min read · IIT Kharagpur
From steepest descent's Euclidean blindspot, through the Fisher Information Matrix and Riemannian manifolds, to a practical curvature-aware optimizer you can actually run on your laptop. A geometric dissection of why Adam's diagonal approximation lies — and what natural gradient does instead.
Natural Gradient Fisher Information Riemannian Geometry Adam Optimizer
2
Fundamentals Mathematics From Scratch
The Shape of Occam's Razor: Demystifying L1 and L2 Regularization
May 14, 2026 · 12 min read · IIT Kharagpur
Why your neural network wants to memorize noise — and how circles, diamonds, and Bayesian priors force it to generalize instead. A geometric and probabilistic view of regularization from first principles.
L1 / L2 Penalty Bayesian Priors Sparsity Overfitting
3
Architectural Autopsy Deep Learning Research
The Architecture of Intelligence: A Deep Autopsy of the Transformer
June 02, 2026 · 17 min read · IIT Kharagpur
From the ruins of sequential recurrence to the elegance of parallelized attention — a step-by-step autopsy of "Attention Is All You Need," covering QKV projections, multi-head parallelism, scaling laws, BERT vs GPT, FlashAttention, RoPE, and the world model hypothesis.
Self-Attention Multi-Head Attn Scaling Laws BERT vs GPT FlashAttention MoE
4
Operator Learning PDEs Research
Learning the 1+2D Burgers Equation with DeepONets
Feb 27, 2026 · 18 min read · Manchester Intern
Continuous operator learning, spatial bottlenecks, and predicting shock fronts in fluid dynamics. A 4-dimensional branch network combined with an adaptive trunk learns to approximate solutions of the Burgers PDE across 819K spatiotemporal points.
DeepONet Burgers PDE Neural Operators Shock Fronts
5
LLMs Architecture Research
Inside the Machines: What's Actually Different About LLaMA 4, Qwen3, Gemini 2.5, and Claude Sonnet 4
August 12, 2025 | 30 min read | IIT Kharagpur
Everyone's posting benchmark screenshots. Nobody's explaining the architectural bets each lab actually made — the ones that will define the next two years of the field. Let's fix that.
6
LLMs RAG Evaluation
VictorianGPT: Teaching a 3B Model to Speak Victorian — and Grading Its Own Work
September 1, 2026 | 15 min read | IIT Kharagpur
LoRA fine-tuning + retrieval-augmented generation over 40 public-domain novels, built entirely on free Colab GPUs — with an evaluation section that reports the numbers that didn't work, not just the ones that did.
7
Neuromorphic Optimization Research
Pruning Spiking Neural Networks: A Constrained Optimization Approach
Sept 26, 2025 · 12 min read · Oulu Intern
SNNs are highly energy-efficient, but scaling them remains a challenge. Biologically inspired constraints, mathematical continuous relaxation traps in CVXPY, and Iterative Combined Importance Scoring to conquer the 50% sparsity wall.
SNN Pruning CVXPY Sparsity Neuromorphic
7
NLP Vision Conference
Multimodal Fusion Strategies for Sentiment Analysis
May 5, 2025 · 6 min read · IIM Ranchi
Combining text and vision to improve sentiment analysis models — integrating BERT and ViT with CLIP-based alignment, and why Dempster-Shafer evidential fusion outperforms standard concatenation by explicitly modelling uncertainty across modalities.
BERT + ViT CLIP Alignment Dempster-Shafer Multimodal Fusion
8