The GATE Grind

GATE 2025 ST – Question 54

Regression Analysis · Linear Models and Estimation · 2 marks · Multiple select

For Y=Xβ+ε with ε~N_n(0,I),X real n×p and λ>0, let β̂=(XᵀX+λI_p)⁻¹XᵀY. Which hold?

  1. β̂ is unbiased for β.
  2. XᵀX+λI_p is positive definite.
  3. β̂ is multivariate normal.
  4. Var β̂=(XᵀX+λI_p)⁻¹

Practise this question in The GATE Grind →

Show answer and explanation

Correct answer: (B) XᵀX+λI_p is positive definite.; (C) β̂ is multivariate normal.

Explanation

For nonzero v, vᵀ(XᵀX+λI)v=‖Xv‖²+λ‖v‖²>0, proving B. A fixed linear transform of normal Y is normal, possibly degenerate, proving C. Writing H=XᵀX+λI gives Eβ̂=H⁻¹XᵀXβ=(I−λH⁻¹)β, generally biased, and Var β̂=H⁻¹XᵀXH⁻¹ rather than H⁻¹. **B,C**.

More Linear Models and Estimation questions

All Linear Models and Estimation questions →