aNet.ai
Machine Learning/Learning path
0day streak0XP · Lv 1
← 3. Learning & Generalization
Lesson 5 of 11 7 min · 93 words

Underfitting

A model too simple to capture the pattern.

Underfitting happens when a model is too simple to capture the real pattern. Both training and validation error are high, and they are close together.

Examples: fitting a straight line to clearly curved data; a decision tree of depth 1 for a complex problem; too strong regularisation that forces all weights near zero; stopping training far too early.

Unlike overfitting, more data does not fix underfitting — the model cannot use it. You need more capacity.

Formula to remember

Ridge objective

L2 penalty shrinks all weights.

Quick check · +5 XP

Ridge regression adds which penalty?

Practice this topic
Saved in this browser as you type.
aNet.ai · Introduction to Machine Learning · NewUU course outlineProgress saved in this browser