Lesson 2 of 9 8 min · 141 words
Univariate vs. multivariate regression
One input feature versus many.
Univariate (simple) regression has one input: — a line in 2-D. It is easy to plot and reason about: is the slope, the intercept.
Multivariate (multiple) regression has many inputs: — a plane in 3-D, a hyperplane in general. Each weight is a *partial* effect: the change in per unit of with the other features held constant.
A feature can look important alone but unimportant in a multivariate model, because another correlated feature already explains the same variation. With strongly correlated features (multicollinearity), individual weights become unstable and hard to interpret, even if predictions are fine.
Formula to remember
Least squares loss
Sum of squared residuals.
Quick check · +5 XP