Machine Learning
Deep dives into Theoretical ML, Large Language Models, Neural Operators, Computer Vision — and technical notes from my ongoing research at IIT Kharagpur, Manchester, and Oulu.
6 articles published · updated regularly
Filter :
-->
The Geometry of Gradient Descent: Why Adam Lies and What to Do About It
From steepest descent's Euclidean blindspot, through the Fisher Information Matrix and Riemannian manifolds, to a practical curvature-aware optimizer you can actually run on your laptop. A geometric dissection of why Adam's diagonal approximation lies — and what natural gradient does instead.
Natural Gradient
Fisher Information
Riemannian Geometry
Adam Optimizer
2
The Shape of Occam's Razor: Demystifying L1 and L2 Regularization
Why your neural network wants to memorize noise — and how circles, diamonds, and Bayesian priors force it to generalize instead. A geometric and probabilistic view of regularization from first principles.
L1 / L2 Penalty
Bayesian Priors
Sparsity
Overfitting
3
The Architecture of Intelligence: A Deep Autopsy of the Transformer
From the ruins of sequential recurrence to the elegance of parallelized attention — a step-by-step autopsy of "Attention Is All You Need," covering QKV projections, multi-head parallelism, scaling laws, BERT vs GPT, FlashAttention, RoPE, and the world model hypothesis.
Self-Attention
Multi-Head Attn
Scaling Laws
BERT vs GPT
FlashAttention
MoE
4
Learning the 1+2D Burgers Equation with DeepONets
Continuous operator learning, spatial bottlenecks, and predicting shock fronts in fluid dynamics. A 4-dimensional branch network combined with an adaptive trunk learns to approximate solutions of the Burgers PDE across 819K spatiotemporal points.
DeepONet
Burgers PDE
Neural Operators
Shock Fronts
5
Inside the Machines: What's Actually Different About LLaMA 4, Qwen3, Gemini 2.5, and Claude Sonnet 4
Everyone's posting benchmark screenshots. Nobody's explaining the architectural bets each lab actually made — the ones that will define the next two years of the field. Let's fix that.
6
VictorianGPT: Teaching a 3B Model to Speak Victorian — and Grading Its Own Work
LoRA fine-tuning + retrieval-augmented generation over 40 public-domain novels,
built entirely on free Colab GPUs — with an evaluation section that reports
the numbers that didn't work, not just the ones that did.
7
Pruning Spiking Neural Networks: A Constrained Optimization Approach
SNNs are highly energy-efficient, but scaling them remains a challenge. Biologically inspired constraints, mathematical continuous relaxation traps in CVXPY, and Iterative Combined Importance Scoring to conquer the 50% sparsity wall.
SNN
Pruning
CVXPY
Sparsity
Neuromorphic
7
Multimodal Fusion Strategies for Sentiment Analysis
Combining text and vision to improve sentiment analysis models — integrating BERT and ViT with CLIP-based alignment, and why Dempster-Shafer evidential fusion outperforms standard concatenation by explicitly modelling uncertainty across modalities.
BERT + ViT
CLIP Alignment
Dempster-Shafer
Multimodal Fusion
8