GATE 2024 EC – Question 34
Communications · Information Theory · 1 mark · Numerical answer
A source transmits symbols from an alphabet of size 16. The value of maximum achievable entropy (in bits) is ______.
Practise this question in The GATE Grind →
Show answer and explanation
Correct answer: 4
Explanation
Entropy is largest when all symbols are equally likely, and then $H_{max}=\log_2M=\log_216=4$ bits.
More Information Theory questions
- GATE 2024 EC Q47 – The information bit sequence \1\ 1\ 1\ 0\ 1\ 0\ 1\ 0\ 1\ is to be transmitted by encoding…
- GATE 2023 EC Q65 – The frequency of occurrence of 8 symbols (a-h) is shown in the table below. A symbol is…
- GATE 2022 EC Q29 – Let H(X) denote the entropy of a discrete random variable X taking K possible distinct…
- GATE 2022 EC Q61 – The transition diagram of a discrete memoryless channel with three input symbols and three…
- GATE 2022 EC Q62 – Consider communication over a memoryless binary symmetric channel using a (7, 4) Hamming…
- GATE 2021 EC Q33 – A speech signal, band limited to 4 kHz, is sampled at 1.25 times the Nyquist rate. The…
All Information Theory questions →