information-theory

21 entries in Information Theory & Coding.

• Shannon entropy estimationMaximum likelihood plug-incanoninformation-theory
• Miller-Madow correctionBias-corrected entropyspecialistinformation-theory
• NSB entropy estimatorBayesian mixture priorspecialistinformation-theory
• KSG mutual informationK-nearest-neighbor estimationstandardinformation-theory
• MINENeural lower boundspecialistinformation-theory
• Blahut-ArimotoAlternating capacity iterationstandardinformation-theory
• Blahut-Arimoto rate-distortionstandalonespecialistinformation-theory
• Slepian-Wolf codingSyndrome binningspecialistinformation-theory
• Wyner-Ziv codingSide-information quantizationspecialistinformation-theory
• Lempel-Ziv complexitystandalonestandardinformation-theory
• Kolmogorov complexity approximationCompression-length proxyspecialistinformation-theory
• Normalized compression distancestandalonespecialistinformation-theory
• Transfer entropyConditional mutual informationspecialistinformation-theory
• Information bottleneckCompression-relevance tradeoffspecialistinformation-theory
• Maximum entropy modelingLagrange-constraint fittingstandardinformation-theory
• Kullback-Leibler estimationDensity-ratiostandardinformation-theory
• Jensen-Shannon divergencestandalonestandardinformation-theory
• Typical set decodingstandalonespecialistinformation-theory
• Arithmetic-coding entropy boundstandalonespecialistinformation-theory
• Chow-Liu treeMax-weight mutual-information spanning treestandardinformation-theory
• Rate-distortion optimizationLagrangian bit allocationspecialistinformation-theory