Information Theory

Shannon entropy, complexity, redundancy
distributionaldim information1 metrics

What It Measures

How compressible is the signal — a direct proxy for algorithmic randomness.

The geometry once carried Shannon block entropies and mutual-information channels at multiple lags. Those were pruned (|r| > 0.9 with ordinal/spectral metrics) and the geometry now ships a single workhorse: Lempel-Ziv compression ratio. Entropy and mutual-information signals continue to live in OrdinalPartition, Predictability, and SpectralAnalysis.

Metrics

compression_ratio

Lempel-Ziv compression ratio: compressed_size / original_size. 1.0 means incompressible (Wichmann-Hill, MINSTD, XorShift32 — good PRNGs are incompressible). 0.0 means trivially compressible (constants). Logistic period-2 scores 0.002 (alternating between two values compresses almost completely). This is a direct proxy for Kolmogorov complexity.

Atlas Rankings

compression_ratio
SourceDomainValue
ln(2) Digitsnumber_theory1.0000
Euler-Mascheroni γ Digitsnumber_theory1.0000
Pi Digitsnumber_theory1.0000
···
Logistic r=3.2 (Period-2)chaos0.0022
Square Wavewaveform0.0023
Logistic r=3.83 (Period-3 Window)chaos0.0028

When It Lights Up

Compression ratio alone separates PRNGs and crypto (incompressible, ~1.0) from every other class of signal in the atlas. In the distributional view it anchors the noise/structure axis: anything that lands near 1.0 has no exploitable redundancy at the byte level, regardless of what shape its dynamics take.

Open in Atlas
← Spherical S²Torus T^2 →