On 17/07/2015, robert bristow-johnson <r...@audioimagination.com> wrote: > > in your model, is one sample (from the DSP semantic) the same as a > "message" (from the Information Theory semantic)?
A "message" can be anything - it can be a sample, a bit, a combination of samples or bits, a set of parameters representing a square wave, whatever. > is your measure the same as > > SUM{ prob(message) * -log2(prob(message)) } > all messages > > ? Yes. In this particular example, a "message" means "a set of parameters that describe a parametric square wave". To distinguish between two or more messages, at least 1 bit is needed. -- dupswapdrop -- the music-dsp mailing list and website: subscription info, FAQ, source code archive, list archive, book reviews, dsp links http://music.columbia.edu/cmc/music-dsp http://music.columbia.edu/mailman/listinfo/music-dsp