Which of the following statements is true for Ridge Regression?
The regularizer in the objective function of Ridge Regression is used to guard against scenarios where the model works well for the test data, but poorly for the training data.
The regularizer of Ridge Regression uses $L_1$ norm.
Ridge Regression aims to reduce the number of parameters that have negative values.
The regularizer of Ridge Regression may increase the bias of the model, but it helps in reducing the variance in predictions.
Correct answer: (D) The regularizer of Ridge Regression may increase the bias of the model, but it helps in reducing the variance in predictions.
Explanation
Ridge regression adds a penalty on the squared $L_2$ norm of the weights. It shrinks the weights, which adds a little bias but makes the model less sensitive to the training sample, so the variance falls. It guards against overfitting, which is the opposite of the case in A. The $L_1$ norm is used in lasso, and ridge does not care about the signs of the weights.
More Supervised learning: regression questions
GATE 2026 DA Q55– Consider that Linear Ridge Regression is being used to learn a prediction function y pred…
GATE 2025 DA Q34– Given data \(-1, 1), (2, -5), (3, 5)\ of the form (x, y), we fit a model y = wx using…
GATE 2026 DA Q29– Consider that for a supervised learning task, the objective function being minimized is f…