A binary random variable $X$ takes the value $+2$ or $-2$. The probability $P(X=+2)=\alpha$. The value of $\alpha$ (rounded off to one decimal place), for which the entropy of $X$ is maximum, is ________.
The entropy of a binary variable is $H=-\alpha\log\alpha-(1-\alpha)\log(1-\alpha)$. It measures uncertainty and is largest when the two outcomes are equally likely, so $\alpha=0.5$. (The values $\pm2$ are irrelevant; only the probabilities matter.)
More Information Theory questions
GATE 2019 EC Q17– A linear Hamming code is used to map 4-bit messages to 7-bit codewords. The encoder…
GATE 2018 EC Q26– Consider a binary channel code in which each codeword has a fixed length of 5 bits. The…
GATE 2016 EC Q58– Consider a discrete memoryless source with alphabet S = \s 0, s 1, s 2, s 3, s 4, \ and…
GATE 2015 EC Q59– The input X to the Binary Symmetric Channel (BSC) shown in the figure is '1' with…
GATE 2017 EC Q31– Let (X 1, X 2) be independent random variables. X 1 has mean 0 and variance 1, while X 2…
GATE 2014 EC (EC1) Q33– Find the capacity of a binary symmetric channel with crossover probability 0.5.