The GATE Grind

GATE 2017 EC – Question 31

Communications · Information Theory · 1 mark · Numerical answer

Let $(X_1, X_2)$ be independent random variables. $X_1$ has mean 0 and variance 1, while $X_2$ has mean 1 and variance 4. The mutual information $I(X_1; X_2)$ between $X_1$ and $X_2$ in bits is ________.

Practise this question in The GATE Grind →

Show answer and explanation

Correct answer: 0

Explanation

Mutual information $I(X_1;X_2)=H(X_1)-H(X_1|X_2)$ measures how much knowing one variable reduces uncertainty about the other.

For independent variables, $H(X_1|X_2)=H(X_1)$, so $I=0$. The given means and variances do not matter.

More Information Theory questions

All Information Theory questions →