aNet.ai
Machine Learning/Learning path
0day streak0XP · Lv 1
← 5. Similarity / Divergence Measures
Lesson 13 of 13 7 min · 117 words

Kolmogorov distance

The largest gap between two cumulative distribution functions.

The Kolmogorov distance is the largest vertical gap between two cumulative distribution functions:

It is an IPM whose test functions are indicator functions of half-lines . It lies in and is the statistic of the Kolmogorov–Smirnov (KS) test, a classic non-parametric test for whether two samples come from the same distribution.

It is easy to compute and interpret, but it focuses on a single worst point and is mostly used for one-dimensional data.

Formula to remember

Cramér distance

Integrated squared gap between CDFs.

Quick check · +5 XP

MMD corresponds to 𝓕 being…

Practice this topic
Saved in this browser as you type.
aNet.ai · Introduction to Machine Learning · NewUU course outlineProgress saved in this browser