Entropy and information estimation
9 methods in the atlas attack this one problem. They are rivals: each wins something the others do not.
Phrasings that mean this problem
Entropy estimationMutual information estimationDivergence estimationDistribution comparisonDirected information flow
information-theory
- Shannon entropy estimationMaximum likelihood plug-incanoninformation-theory
- Miller-Madow correctionBias-corrected entropyspecialistinformation-theory
- NSB entropy estimatorBayesian mixture priorspecialistinformation-theory
- KSG mutual informationK-nearest-neighbor estimationstandardinformation-theory
- MINENeural lower boundspecialistinformation-theory
- Transfer entropyConditional mutual informationspecialistinformation-theory
- Kullback-Leibler estimationDensity-ratiostandardinformation-theory
- Jensen-Shannon divergencestandalonestandardinformation-theory
kernel-methods
- Kernel two-sample teststandalonespecialistkernel-methods