The GATE Grind

GATE 2024 EC – Question 34

Communications · Information Theory · 1 mark · Numerical answer

A source transmits symbols from an alphabet of size 16. The value of maximum achievable entropy (in bits) is ______.

Practise this question in The GATE Grind →

Show answer and explanation

Correct answer: 4

Explanation

Entropy is maximum when all symbols are equally likely, $H_{max}=\log_2M=\log_216=4$ bits.