Comment on Understanding Shannon's Entropy metric for Information [pdf]parentComments−dr_dshiv4yThat seems like a strong claim. Any proof?−SAI_Peregrinus4ySure. https://people.math.harvard.edu/~ctm/home/text/others/shanno...Particularly part 4, The Continuous Channel. No discrete symbols there!−dr_dshiv4yMaybe I’m not reading it properly, but in part 5, where he deals with transmission of continuous signals he doesn’t use his entropy formulation. He uses a distance metric, showing the difference between the sent signal and the received.
Comments
That seems like a strong claim. Any proof?
Sure. https://people.math.harvard.edu/~ctm/home/text/others/shanno...
Particularly part 4, The Continuous Channel. No discrete symbols there!
Maybe I’m not reading it properly, but in part 5, where he deals with transmission of continuous signals he doesn’t use his entropy formulation. He uses a distance metric, showing the difference between the sent signal and the received.