Interactive Explorations
Read alongside visualizations that update as you scroll. Adjust parameters and see immediate changes. Play with the concepts.
The Mathematics of Learning
Exploring the mathematical foundations of deep learning through interactive visualizations. See how concepts connect, from gradient descent to state space models.
Five Mathematical Pillars
Connected Ideas
See how concepts link together. How attention relates to state spaces, how diffusion connects to flow matching.
Explore the knowledge graph.
Hands-On Understanding
Adjust learning rates. Watch convergence patterns. Break things. Sometimes the best way to understand is to experiment.
Gradient Descent Playground
Adjust the learning rate and momentum to see how the optimizer moves along a simple 1D loss landscape.
Try:
Step: 0
x: 4.000
Loss: 2.0000
Too large a learning rate overshoots the minimum; low momentum gives a wiggly path, high momentum smooths it.