Information Theory

Shannon entropy, complexity, redundancy
distributionaldim information1 metrics

What It Measures

How compressible is the signal — a direct proxy for algorithmic randomness.

The geometry once carried Shannon block entropies and mutual-information channels at multiple lags. Those were pruned (|r| > 0.9 with ordinal/spectral metrics) and the geometry now ships a single workhorse: Lempel-Ziv compression ratio. Entropy and mutual-information signals continue to live in OrdinalPartition, Predictability, and SpectralAnalysis.

Metrics

compression_ratio

Lempel-Ziv compression ratio: compressed_size / original_size. 1.0 means incompressible (Wichmann-Hill, MINSTD, XorShift32 — good PRNGs are incompressible). 0.0 means trivially compressible (constants). Logistic period-2 scores 0.002 (alternating between two values compresses almost completely). This is a direct proxy for Kolmogorov complexity.

Atlas Rankings

compression_ratio
SourceOriginValue
Bzip2 (level 9)algorithmic-bytes1.0000
AES Encryptedalgorithmic-bytes1.0000
e Digitsnumber-theory1.0000
···
Logistic r=3.2 (Period-2)iterated-maps0.0022
Square Wavesignal-synthesis0.0023
Periodic Wordsymbolic-dynamics0.0024

When It Lights Up

Compression ratio alone separates PRNGs and crypto (incompressible, ~1.0) from every other class of signal in the atlas. In the distributional view it anchors the noise/structure axis: anything that lands near 1.0 has no exploitable redundancy at the byte level, regardless of what shape its dynamics take.

Open in Atlas
← Spherical S²Torus T^2 →