Core ML Visuals
Classical ML, deep learning, optimisation, and neural network foundations — taught through numbered SVG sequences
Activation Functions
Follow sigmoid, ReLU and GELU from local slopes to a checked XOR construction, then separate activation effects from full-network gradients.
See it visuallyAdaBoost
Trace classic binary AdaBoost through five illustrative samples, normalized reweighting and three signed stump votes, with training and noise limits.
See it visuallyAdam Optimizer, Visually
Trace Adam's two moving averages, bias correction and coordinatewise steps, then see why retained momentum can raise the current minibatch loss.
See it visuallyThe Agent Router Architecture
Trace request classification, policy rules and confidence gating into tool, model and human lanes, then see the cost trade-off and a confident routing error.
See it visuallyAnomaly Detection
How to spot the odd value out using standardized distance, isolation partitioning, and local neighbourhood density.
See it visuallyAttention Mechanism
Follow a query from key scores through normalized weights to a value blend, then inspect how a new query and score scaling change it.
See it visuallyAutoencoders
How squeezing 784 numbers through 32 forces a network to learn pure structure.
See it visuallyBackpropagation
How the chain rule blames each weight and fixes all of them in one backward sweep.
See it visuallyBagging vs Boosting
Two fixes for weak trees: average parallel hands to calm variance or chain fixes to melt bias.
See it visuallyBatch Normalization
How centering each batch steadies deep layers and buys bigger learning steps.
See it visuallyBias-Variance Tradeoff
Why total error forms a U-curve, and how you find the sweet spot between a rigid model and a twitchy one.
See it visuallyClustering
How grouping unlabelled points by nearest center works, and where you pick K and where it fails.
See it visuallyConfusion Matrix
The 2x2 table behind every classification metric, worked with 40, 10, 20 and 30 calls.
See it visuallyConvolution Operation
How one small kernel slides over an image and writes a feature map, with every number shown.
See it visuallyConvolutional Neural Networks
How stacked convolution and pooling shrink a 28x28 image to 784 features and vote for 10 classes.
See it visuallyCross-Validation
How rotating the held-out slice over five folds turns one lucky split into an honest average.
See it visuallyDBSCAN
How grouping by crowd density finds rings and chains, with core, border and noise calls shown.
See it visuallyDecision Trees
Follow ten illustrative samples through a Gini-scored split, recursive branches and an unseen-point prediction, then inspect depth and diagonal boundaries.
See it visuallyDimensionality Reduction
How PCA keeps 85 percent of spread on two axes, and when neighbour-keeping maps serve you better.
See it visuallyDropout
How randomly zeroing half the units stops lazy co-adaptation, with train and test sums matched at 4.
See it visuallyGenerative Adversarial Networks
Two networks sharpen each other through contest: a forger turns noise into pictures while a judge learns to spot the fakes.
See it visuallyGradient Boosting
Chain weak learners so each one corrects only the mistakes of the one before it, turning shallow trees into a strong ensemble.
See it visuallyGradient Descent
Walk a loss curve from w = 2 to the bottom: read the uphill slope, flip it into a step, and watch out for flat ground.
See it visuallyHow A Decision Head Works
Skip the word by word loop: read a request once with an encoder and answer with small typed heads that output choices, scores and flags.
See it visuallyHyperparameter Tuning
Spend sixteen runs wisely: random search tests sixteen learning rates where a grid tests four, then spendier methods take over.
See it visuallyK-Means Clustering
How Lloyd's algorithm discovers groups in unlabelled data through a two-step dance of assigning points and moving centroids.
See it visuallyK-Nearest Neighbors
Predict a new point's class by looking at the k training points closest to it and taking a majority vote.
See it visuallyLearning Curves
Plot training error against held out error as data grows, and the gap tells you whether to buy labels or add muscle.
See it visuallyLearning Rate Scheduling, Visually
Start bold and finish gentle: warm the rate from 0 to 0.1, glide it down a cosine, and never decay before the loss settles.
See it visuallyLinear Regression
Fit a straight line through scattered data points by minimising the vertical errors, giving a single trend for prediction.
See it visuallyLogistic Regression
Bend a straight line into an S-curve to predict probabilities for yes-or-no categories.
See it visuallyLong Short-Term Memory
LSTMs add a cell highway with three gates so old context survives the trip forward.
See it visuallyLoss Functions
How a network scores its own mistakes so gradients know which way to push.
See it visuallyModel Evaluation
Why you cannot trust training scores and how train, validation, and test splits keep you honest.
See it visuallyMomentum
Plain steps zigzag across valleys while a velocity sum cancels sideways noise and dives forward.
See it visuallyMulti-Layer Perceptron
Stacked neuron layers with bends between them turn straight cuts into curved borders.
See it visuallyOverfitting vs Underfitting
Training and test error on one scale reveal whether your model is too stiff or too wiggly.
See it visuallyPerceptron
One neuron draws one straight border by weighting inputs, then fixes mistakes step by step.
See it visuallyPolynomial Regression
Squared and cubed columns let a linear solver draw curves, until extra degrees wobble.
See it visuallyPooling Layers
Small windows that keep one value per region shrink maps and forgive tiny shifts.
See it visuallyRandom Forests
Bootstrap hundreds of de-correlated decision trees with random feature subspaces and combine their votes, collapsing single-tree variance from 0.33 to 0.08 without overfitting.
See it visuallyResidual Connections
Let each neural block learn an additive residual correction F(x) added to identity skip x, preserving gradient flow across extreme depths without optimization degradation.
See it visuallyRidge & Lasso Regularisation
Add a regularization penalty on parameter magnitude to control model variance: contrast smooth L2 ridge shrinkage against sparse L1 lasso feature selection.
See it visuallyROC and AUC
Sweep decision cutoffs to trace True Positive Rate against False Positive Rate, measuring threshold-independent ranking discrimination via Area Under the Curve.
See it visuallySequence-to-Sequence
Compress variable-length input sequences into a fixed context vector with a recurrent encoder, then unroll it autoregressively with a decoder.
See it visuallyStochastic Gradient Descent, Visually
Read the whole dataset for one exact step, or grab one row and step at once. The noisy path escapes ruts but needs calming to land.
See it visuallySupport Vector Machines
Draw the widest street between two classes, anchor the boundary on border support vectors, and forgive slack crossings when data overlaps.
See it visuallyt-SNE & UMAP
Preserve local neighborhood probabilities and let strangers spread, unravelling high-dimensional data clouds into faithful two-dimensional visual maps.
See it visuallyTransfer Learning
Freeze a pretrained body and train a small head first, then thaw the top gently. Reuse wins tiny data and fails across far domains.
See it visuallyVanilla RNN
Read left to right with one looping cell and a running note, then watch old words fade as gradients shrink going back.
See it visuallyVanishing and Exploding Gradients
Trace how products of local derivatives shrink or amplify gradients, then separate what identity skips and norm clipping can actually fix.
See it visuallyVariational Autoencoders
Trace Gaussian latent codes, reparameterized sampling and the reconstruction–KL objective, then see why prior sampling can still fail.
See it visuallyWhat Is Machine Learning?
Machine learning fits patterns from data. Follow a toy classifier from labelled examples to a held-out test and see why memorization fails.
See it visuallySelf-Supervised Learning
Extract dense supervision directly from raw, unlabelled data using pretext tasks like masking and contrastive pairs to pretrain foundation backbones for downstream fine-tuning.
See it visuallyContrastive Learning
Rebuilding pixels wastes effort on backgrounds. See how pulled pairs and pushed strangers organize meaning with zero labels.
See it visuallyReinforcement Learning Foundations
Explore Markov Decision Processes without an answer key: master the agent-environment loop, Bellman Q-learning updates, discounted cumulative return, and reward hacking failure modes.
See it visuallyKnowledge Distillation
Big teachers cannot fit on phones. See how softened odds carry hidden structure into a small student that ships.
See it visuallyGraph Neural Networks
Lonely rows miss friendships that decide labels. See how mailed messages and averaged neighbours add context hop by hop.
See it visuallyDiffusion Models
Guessing whole photos in one shot yields blur. See how small noise steps and learned reversals rebuild sharp images.
See it visuallyLoRA Low-Rank Tuning
Retraining giant weights costs a fortune. See how a frozen base plus a thin detour learns new skills for pennies.
See it visuallyTransformers
Processing five words at once through softmax weights and stacked masks, instead of squeezing a sentence through one thin recurrent pipe.
See it visuallyBERT vs GPT
One mask lets GPT predict the next word from the past, while no mask lets BERT fill a hidden word from both sides of the sentence.
See it visuallyMixture Of Experts
Eight experts share the work while each token wakes only two, so the model holds far more knowledge than it spends compute on.
See it visuallyRLHF / DPO
Ranked answers train a judge that lifts preferred replies from 45 to 72 percent, while DPO tunes the same lesson straight into the model.
See it visuallyWord2Vec
Context prediction learns word vectors. Follow an explicit window, two vector tables, a four-word softmax, CBOW, and negative sampling.
See it visuallyPrecision-Recall Curve
Forty hits, ten false alarms and twenty misses give precision 0.80 and recall 0.667, and one curve shows every threshold between strict and lax.
See it visuallyEnsemble Stacking
A tree says 5.2 and a linear model says 3.1, so a trained meta-model weights them 0.1 and 0.9 to land at 3.31 near the truth of 3.5.
See it visuallyEnsemble Methods
One tree gets 7 of 10 right while five diverse trees vote 3 to 2, canceling lone mistakes to reach 0.88 where one stalls at 0.70.
See it visuallySHAP & LIME
Explain black-box model decisions through local surrogate approximations and axiomatic game-theoretic Shapley value attributions.
See it visuallyTime Series Forecasting (ARIMA)
Decompose temporal signals into trend, seasonality, and stationary noise, blending autoregressive memory with moving average shock corrections.
See it visuallyEmbedding Space
How models convert fuzzy semantic meaning into precise mathematical distances.
See it visuallyEarly Stopping
Why you shouldn't train for a fixed number of epochs, and how to reliably stop when the model actually reaches its best performance.
See it visuallyTensor Processing Units
How TPUs trade general-purpose CPU flexibility for massive hardware-accelerated matrix multiplication using a weight-stationary systolic array.
See it visuallyWord Embeddings
Word embeddings map word identities to learned vectors. Follow a toy lookup, compare cosine and distance, and see the limit of one vector per word.
See it visuallyTokenization
How raw text decomposes into discrete integer token IDs using Byte Pair Encoding, compressing sequences for Transformer self-attention while concealing character-level structure.
See it visually