Entropy estimation tool

This high performance tool outputs on demand of its input:

The Shannon entropy estimation (through stdout).
The minimum, medium and maximum frequencies (through stderr).
The frequency of possibilities (through entropy.freq file).
The frequency of frequencies (through entropy.gaus file).

These outputs are useful to measure the equiprobability regardless of the unpredictability: Definition of ubit (unpredictable bit).

You may perform an online test of up to 8GB using Entropy and Randomness Online Tester.

Use

#entropy estimation test

entropy 1 input


#standard deviation test

entropy 2 input


#frequency test

entropy 5 input

gnuplot -e "plot 'entropy.freq' with lines" -p


#gaussian distribution test

entropy 7 input

gnuplot -e "plot 'entropy.gaus' with lines" -p


#frequency and gaussian distribution tests

entropy 9 input

gnuplot -e "plot 'entropy.freq' with lines" -p

gnuplot -e "plot 'entropy.gaus' with lines" -p

Install

#ncomputers.org/debian

apt-get install entropy

#makefile as su

make install

Compile

g++ -O3 -std=c++11 entropy.cpp -o entropy

Experimental purposes

g++ -O3 -std=c++11 entropy.cpp -o entropy-08 -D Bits=8

g++ -O3 -std=c++11 entropy.cpp -o entropy-32 -D Bits=32

Sample output

Size	Entropy	Min	Med	Max
1M	15.907677	0	8	23
2M	15.954388	1	16	37
4M	15.977415	10	32	62
8M	15.988717	36	64	110
16M	15.994361	83	128	175
32M	15.997176	186	256	330
64M	15.998602	407	512	605
128M	15.999300	900	1024	1159
256M	15.999649	1852	2048	2237
512M	15.999824	3811	4096	4383
1G	15.999912	7799	8192	8589
2G	15.999956	15791	16384	16992
4G	15.999978	32038	32768	33494
8G	15.999989	64448	65536	66623
16G	15.999995	129571	131072	132551
32G	15.999997	259881	262144	264277
64G	15.999999	521129	524288	527409
128G	15.999999	1044291	1048576	1052872
256G	16.000000	2091004	2097152	2103918
512G	16.000000	4185645	4194304	4204292