Knowledge graph How the 18 topics of Introduction to Machine Learning build on each other. Hover to trace a chain; click to inspect a topic and jump straight into its next lesson.
18 topics in 5 units
29 prerequisite links
1 starting point
5 capstone topics
Topic 5 · Foundations
Similarity / Divergence Measures Measuring how different two probability distributions are — the core of generative modelling.
13 lessons13 formulas7 questions
0% of lessons complete
Prerequisites Mathematical Foundations
Unlocks Advanced Topics Key ideas Divergences need not be symmetric; metrics must be. F-divergences (KL, JS, χ², TV, Hellinger) compare density ratios point by point. IPMs (Wasserstein, MMD, Kolmogorov) compare expectations of test functions.