Entropy Calculator

Calculates entropy for data (probability of events) in an array.
766 Downloads
Updated 14 Mar 2012

View License

In information theory, entropy is a measure of the uncertainty associated
with a random variable. In this context, the term usually refers to the
Shannon entropy, which quantifies the expected value of the information
% contained in a message, usually in units such as bits. In this context, a
'message' means a specific realization of the random variable.
Shannon denoted the entropy H of a discrete random variable X with possible
values {x1, ..., xn} as,

H(X) = E(I(X)).

E is the expected value,
I is the information content of X

Example usage
-------------
in = [.25 .25 .25 .25];
b = 'bit';
Entropy = info_entropy (in, b)

Cite As

Vallabha Hampiholi (2024). Entropy Calculator (https://www.mathworks.com/matlabcentral/fileexchange/35611-entropy-calculator), MATLAB Central File Exchange. Retrieved .

MATLAB Release Compatibility
Created with R2008a
Compatible with any release
Platform Compatibility
Windows macOS Linux
Categories
Find more on Error Detection and Correction in Help Center and MATLAB Answers

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!
Version Published Release Notes
1.1.0.0

It now handles 0 as entry in the probability array.

1.0.0.0