aNet.ai
Machine Learning/Learning path
0day streak0XP · Lv 1
← 6. Linear Regression
Lesson 2 of 9 8 min · 141 words

Univariate vs. multivariate regression

One input feature versus many.

Univariate (simple) regression has one input: — a line in 2-D. It is easy to plot and reason about: is the slope, the intercept.

Multivariate (multiple) regression has many inputs: — a plane in 3-D, a hyperplane in general. Each weight is a *partial* effect: the change in per unit of with the other features held constant.

A feature can look important alone but unimportant in a multivariate model, because another correlated feature already explains the same variation. With strongly correlated features (multicollinearity), individual weights become unstable and hard to interpret, even if predictions are fine.

Formula to remember

Least squares loss

Sum of squared residuals.

Quick check · +5 XP

Which metric is least affected by a few huge errors?

Practice this topic
Saved in this browser as you type.
aNet.ai · Introduction to Machine Learning · NewUU course outlineProgress saved in this browser