Home › Previous year questions › GATE 2017 EC › Question 31GATE 2017 EC – Question 31 Communications · Information Theory · 1 mark · Numerical answer
Let $(X_1, X_2)$ be independent random variables. $X_1$ has mean 0 and variance 1, while $X_2$ has mean 1 and variance 4. The mutual information $I(X_1; X_2)$ between $X_1$ and $X_2$ in bits is ________.
Practise this question in The GATE Grind →
Show answer and explanation Correct answer: 0
Explanation Mutual information $I(X_1;X_2)=H(X_1)-H(X_1|X_2)$ measures how much knowing one variable reduces uncertainty about the other.
For independent variables, $H(X_1|X_2)=H(X_1)$, so $I=0$. The given means and variances do not matter.
More Information Theory questions GATE 2014 EC (EC1) Q33 – Find the capacity of a binary symmetric channel with crossover probability 0.5. GATE 2014 EC (EC1) Q62 – A fair coin is tossed until the first head. L is the number of tosses. Find entropy H(L)… GATE 2014 EC (EC2) Q32 – AWGN capacity is C=W 2(1+P/(2W)) bps, where W is bandwidth, P average received power and 2… GATE 2014 EC (EC3) Q62 – A binary X has P(X = 1) = 1/3 and enters the shown cascade of two independent identical… GATE 2014 EC (EC4) Q60 – The Z-channel shown has equiprobable inputs 0,1. Given that output is 0, find the… GATE 2017 EC (EC2) Q31 – Which of the following graphs shows the Shannon capacity (channel capacity), in bits, of a… All Information Theory questions →