Axiom AcademyAxiom Academy
HomeCoursesFormula SheetsAbout
Axiom Academy
Axiom Academy

Making math accessible and enjoyable through interactive lessons, engaging explanations, and a passion for teaching.

What's New

Learn

  • All Courses
  • Formula Sheets
  • Achievements

Test Prep

  • SAT Math
  • ACT Math
  • GRE Quant
  • Competition Math

Company

  • About
  • Contact

Legal

  • Privacy Policy
  • Terms of Service
  • Accessibility

© 2026 Axiom Academy. All rights reserved.

Built with love for math.

  1. Home
  2. Courses
  3. Linear Algebra for Machine Learning
LA+

Linear Algebra for Machine Learning

The math behind machine learning — from vectors to transformers

154Modules
8Units

Being rebuilt

This course is still in our original format. All the content is here and free to use, but it has not yet been through the rebuild that gives our newer courses their interactive animations and cleaner visuals — so you may hit some rough edges. Spot an error? Send us a note and we will fix it.

Recommended preparation

A grasp of matrix fundamentals sets you up well; a little calculus helps once we reach gradients.

Linear Algebra (Matrices)
1
Welcome to Linear Algebra for Machine LearningINTRO
2
Why Linear Algebra Matters for MLLESSON
3
Math vs Code ApproachLESSON
4
NumPy Crash CourseLESSON
5
Arrays and Shapes in NumPyEXAMPLE
6
Vectorized ThinkingLESSON
7
NumPy Operations FundamentalsEXAMPLE
8
Broadcasting in NumPyEXAMPLE
9
Performance Benefits of VectorizationACTIVITY
10
NumPy Fundamentals PracticePRACTICE
11
Unit 1 SummarySUMMARY
12
Setup Formulas & ReferenceFORMULA SHEET
13
Course Diagnostic AssessmentASSESSMENT
14
Unit 1 QuizQUIZ
1
What are Vectors?INTRO
2
Vectors as Data PointsLESSON
3
Vector Representation & ComponentsEXAMPLE
4
Vector Addition & SubtractionLESSON
5
Scalar MultiplicationEXAMPLE
6
Dot Product & Inner ProductLESSON
7
Dot Product Geometric InterpretationEXAMPLE
8
Angle Between VectorsEXAMPLE
9
Vector Norms: L1, L2, Lp, L∞LESSON
10
Properties and Uses of NormsEXAMPLE
11
Vector Spaces & SubspacesLESSON
12
Linear CombinationsEXAMPLE
13
Linear Independence & DependenceLESSON
14
Basis and DimensionLESSON
15
Change of BasisEXAMPLE
16
Activity: Visualize Vectors in 2D/3DACTIVITY
17
Real World: Word Embeddings & Semantic SpaceREAL WORLD
18
Real World: TF-IDF VectorizationREAL WORLD
19
Vectors & Spaces PracticePRACTICE
20
Unit 2 SummarySUMMARY
21
Vector Formulas & ReferenceFORMULA SHEET
22
Unit 2 QuizQUIZ
1
Introduction to MatricesINTRO
2
Matrix Notation & StructureLESSON
3
Basic Matrix OperationsLESSON
4
Matrix MultiplicationEXAMPLE
5
Matrix Transpose & PropertiesEXAMPLE
6
Matrices as Linear TransformationsLESSON
7
Visualizing TransformationsACTIVITY
8
Special Matrices: Identity, Diagonal, SymmetricLESSON
9
Orthogonal & Orthonormal MatricesEXAMPLE
10
Matrix Inverse & PropertiesLESSON
11
Determinant & its MeaningEXAMPLE
12
Matrix RankLESSON
13
Null Space & NullityEXAMPLE
14
Column Space & Row SpaceEXAMPLE
15
Kernel & Image of Linear MapsLESSON
16
Real World: Image TransformationsREAL WORLD
17
Real World: Adjacency Matrices in NetworksREAL WORLD
18
Matrices & Transformations PracticePRACTICE
19
Unit 3 SummarySUMMARY
20
Matrix Formulas & ReferenceFORMULA SHEET
21
Unit 3 QuizQUIZ
1
Systems of Linear EquationsINTRO
2
Matrix Notation for SystemsLESSON
3
Gaussian Elimination MethodLESSON
4
Row Reduction & Row Echelon FormEXAMPLE
5
Back SubstitutionEXAMPLE
6
LU DecompositionLESSON
7
Overdetermined SystemsLESSON
8
Least Squares MethodLESSON
9
Normal EquationsEXAMPLE
10
Moore-Penrose PseudoinverseLESSON
11
Linear Regression ConnectionEXAMPLE
12
Geometric Interpretation of RegressionEXAMPLE
13
Residuals and Error AnalysisEXAMPLE
14
Real World: Fitting Models to DataREAL WORLD
15
Real World: Polynomial & Nonlinear FittingREAL WORLD
16
Systems & Least Squares PracticePRACTICE
17
Unit 4 SummarySUMMARY
18
Systems & LS Formulas & ReferenceFORMULA SHEET
19
Unit 4 QuizQUIZ
1
Eigenvalues & Eigenvectors IntroductionINTRO
2
Eigenvalue Definition & PropertiesLESSON
3
Characteristic PolynomialLESSON
4
Finding EigenvaluesEXAMPLE
5
Finding EigenvectorsEXAMPLE
6
Geometric InterpretationLESSON
7
Activity: Eigenvector VisualizerACTIVITY
8
DiagonalizationLESSON
9
Similar Matrices & Matrix PowersEXAMPLE
10
Spectral TheoremLESSON
11
Positive Definite MatricesLESSON
12
Testing for Positive DefinitenessEXAMPLE
13
Eigendecomposition FundamentalsEXAMPLE
14
Power Iteration MethodEXAMPLE
15
Real World: Google PageRankREAL WORLD
16
Real World: Principal Stress AnalysisREAL WORLD
17
Eigenvalues & Eigenvectors PracticePRACTICE
18
Unit 5 SummarySUMMARY
19
Eigenvalue Formulas & ReferenceFORMULA SHEET
20
Unit 5 QuizQUIZ
1
Singular Value Decomposition IntroductionINTRO
2
SVD Definition & FormLESSON
3
Computing SVDLESSON
4
SVD from EigendecompositionEXAMPLE
5
Understanding Singular ValuesEXAMPLE
6
Geometric Interpretation of SVDLESSON
7
Truncated SVDLESSON
8
Low-Rank ApproximationEXAMPLE
9
Frobenius Norm & Eckart-Young TheoremEXAMPLE
10
SVD and PseudoinverseEXAMPLE
11
Condition Number & Numerical StabilityEXAMPLE
12
Real World: Image CompressionREAL WORLD
13
Real World: Recommender SystemsREAL WORLD
14
Real World: Latent Semantic AnalysisREAL WORLD
15
SVD Practice ProblemsPRACTICE
16
Unit 6 SummarySUMMARY
17
SVD Formulas & ReferenceFORMULA SHEET
18
Unit 6 QuizQUIZ
1
Principal Component Analysis IntroductionINTRO
2
Covariance MatrixLESSON
3
Understanding CovarianceEXAMPLE
4
PCA Derivation & MotivationLESSON
5
PCA via EigendecompositionLESSON
6
PCA via SVDEXAMPLE
7
Choosing Number of ComponentsLESSON
8
Explained Variance RatioEXAMPLE
9
Scree Plot & Elbow MethodEXAMPLE
10
Standardization in PCAEXAMPLE
11
Kernel PCALESSON
12
Nonlinear Dimensionality ReductionLESSON
13
t-SNE OverviewEXAMPLE
14
UMAP OverviewEXAMPLE
15
Real World: Face Recognition & EigenfacesREAL WORLD
16
Real World: Data VisualizationREAL WORLD
17
PCA & Dimensionality Reduction PracticePRACTICE
18
Unit 7 SummarySUMMARY
19
PCA Formulas & ReferenceFORMULA SHEET
20
Unit 7 QuizQUIZ
1
Linear Algebra in Neural NetworksINTRO
2
Neural Networks as Matrix OperationsLESSON
3
Weight Matrices & ParametersLESSON
4
Forward Pass as Matrix MultiplicationEXAMPLE
5
Batch Processing & VectorizationEXAMPLE
6
Activation Functions & NonlinearityEXAMPLE
7
Backpropagation FundamentalsLESSON
8
Chain Rule & Gradient ComputationEXAMPLE
9
Jacobian & Hessian MatricesLESSON
10
Gradient Descent OptimizationEXAMPLE
11
Attention Mechanism & Q, K, V MatricesLESSON
12
Self-Attention & Multi-Head AttentionEXAMPLE
13
Convolution as Matrix OperationLESSON
14
Optimization Landscape & HessianEXAMPLE
15
Real World: Transformer ArchitectureREAL WORLD
16
Real World: Convolutional Neural NetworksREAL WORLD
17
Neural Networks & LA PracticePRACTICE
18
Unit 8 SummarySUMMARY
19
Neural Network Formulas & ReferenceFORMULA SHEET
20
Unit 8 QuizQUIZ