Question Details

Which one of the following is true for Ridge Regression (RR)

Options

A

The regularizer of RR may increase the bias of the model, but it helps in reducing the variance in prediction.

B

The reg. of RR uses L1 norm

C

RR aims to reduce the num. of parameters that have –ve value.

D

The reg. in the objective fn. of RR is used to guard against scenarios where the model works well for the test data but poorly for the training data.

Show Answer
Correct Answer
A The regularizer of RR may increase the bias of the model, but it helps in reducing the variance in prediction.

Solution :

The correct option is: The regularizer of RR may increase the bias of the model, but it helps in reducing the variance in prediction.

Here is the step-by-step explanation of why this statement is correct and why the other options are incorrect:

1. Understanding Ridge Regression and Regularization:
Ridge Regression is a variant of linear regression that introduces a regularization term (penalty) to the ordinary least squares (OLS) loss function. The objective function of Ridge Regression is given by:

L(β)=∑i=1n(yi−xiTβ)2+λ∑j=1pβj2L(\beta) = \sum_{i=1}^{n} (y_i - x_i^T\beta)^2 + \lambda \sum_{j=1}^{p} \beta_j^2

where λ\lambda (lambda) is the regularization parameter that controls the penalty strength, and β\beta represents the model coefficients.

2. Analysis of the Correct Statement (Bias-Variance Trade-off):
The penalty term λ∑βj2\lambda \sum \beta_j^2 shrinks the estimated coefficients towards zero. By constraining the size of the coefficients, Ridge Regression prevents the model from fitting noise in the training data too closely.
This constraint introduces a restriction (bias) on the model's capacity, meaning the model's predictions might deviate slightly from the true average relationship (increased bias). However, because the coefficients are smaller and more stable, the model becomes much less sensitive to fluctuations in the training dataset, significantly reducing the variance of its predictions. This is a classic example of the bias-variance trade-off, where we accept a small increase in bias in exchange for a substantial decrease in variance.

3. Why the other options are incorrect:
- "The reg. of RR uses L1 norm": Incorrect. Ridge Regression uses the L2 norm (squared sum of coefficients). Lasso Regression is the technique that uses the L1 norm (absolute sum of coefficients).
- "RR aims to reduce the num. of parameters that have -ve value.": Incorrect. Ridge Regression shrinks all parameters toward zero regardless of whether they are positive or negative.
- "The reg. in the objective fn. of RR is used to guard against scenarios where the model works well for the test data but poorly for the training data.": Incorrect. Regularization is used to prevent overfitting, which is a scenario where the model performs exceptionally well on the training data but poorly on unseen test data, not the other way around.

Transparent Access on Mindyard

Built for Learners & Educators Alike

Completely free for students. Educators & coaching institutes get 2 months free Pro trial to create tests.

FREE FOR STUDENTS

Practice & Learn Free for Students

Access unlimited practice questions, detailed step-by-step solutions, and exam study materials — completely free for students.

  • Unlimited mock tests & question bank practice
  • Full access to curated study library & formula notes
  • 100% free for students • No credit card required
2 MONTHS FREE TRIAL

Educators & Coaching Institutes

Create and conduct professional online assessments with AI question generation, tab proctoring, and comprehensive batch management.

  • AI question uploader & rapid test generator
  • Anti-cheating tab proctoring & performance reports
  • Full Pro access free for 60 days • No upfront commitment
Discover more resources

You may also like

Mock Tests

View All
  • GATE
  • beginner
  • 3 hours
  • civil engineering

Prepare for GATE 2026 Civil Engineering with the latest question papers, previous year papers, detailed solutions, syllabus, exam pattern, preparation tips, mock tests, and subject-wise study material. Download GATE 2026 CE question papers with solutions in PDF format and boost your preparation for top engineering institutes and PSU recruitment.

  • GATE
  • beginner
  • 3 hours
  • electronics and communication engineering

Prepare effectively for GATE 2026 Electronics & Communication Engineering (EC) with this comprehensive Question Paper with Solutions. This resource includes detailed explanations, concept-wise solutions, previous year paper analysis, and exam-oriented practice to help aspirants strengthen core subjects like Electronic Devices, Analog Circuits, Digital Circuits, Signals & Systems, Network Theory, Control Systems, Electromagnetics, Communications, and more. Perfect for revision, self-assessment, and boosting your GATE 2026 EC preparation strategy.

Ask AI Tutor
5 left
Q1 View Question & Options
AI Tutor is solving this question...
Reading question context & options...
Ask your own doubt or choose a quick prompt: