Comment on Understanding Shannon's Entropy metric for Information [pdf]parentComments−canjobear4yNo, the interesting thing about Shannon entropy is that it is totally independent of how information is represented (as symbols, alphabets, numbers, structured objects, whatever).−dr_dshiv4yIt is based on the symbol set exchanged, so how is it independent?−canjobear4yInformation is a function only of the probabilities, not of the symbols.
Comments
No, the interesting thing about Shannon entropy is that it is totally independent of how information is represented (as symbols, alphabets, numbers, structured objects, whatever).
It is based on the symbol set exchanged, so how is it independent?
Information is a function only of the probabilities, not of the symbols.