The Rényi divergence of order α (α ≥ 0, α ≠ 1) is a human-made family of statistical divergences between probability distributions P and Q, parameterized by the order α. It is defined as D_α(P‖Q) = (1/(α−1)) · log(Σ_x P(x)^α · Q(x)^(1−α)) in the discrete case (the corresponding integral in the continuous case); the limit α → 1 recovers the Kullback–Leibler divergence. It is non-negative and vanishes iff P = Q (under the support condition), is asymmetric, and satisfies the chain rule; as α varies the family interpolates between the minimum (α→0), the KL divergence (α→1), and the maximum (α→∞) of the pointwise likelihood-ratio log-terms. Parameters: the order α and the distributions P and Q. It persists as a named family in the accepted definition of statistical divergence ('the Kullback–Leibler, Jensen–Shannon, chi-squared, and Rényi families'), through standard information-theory textbooks (Cover & Thomas) and standing use in hypothesis testing, Rényi differential privacy, and quantum information theory (Rényi, 1961). [formal: probare | substrate: mind | horizon: a life | explicit: yes | epoch: 0.01]
Accepted ontology entry
renyi-divergence
The Rényi divergence of order α (α ≥ 0, α ≠ 1) is a human-made family of statistical divergences between probability distributions P and Q, parameterized by the order α. It is defined as D_α(P‖Q) = (1/(α−1)) · log(Σ_x P(x)^α · Q(x)^(1−α))…
Definition
Why it is in scope
A human-made family of statistical divergences between probability distributions, parameterized by the order α, introduced by Rényi (1961) and built to persist as a standard named family in information theory and statistical inference.
Names and aliases
- renyi-divergenceen · CANONICAL
Relations from this entry
- cmrwa9lop00iekyo6t6jw7bqlSERVES →
Rényi divergence quantifies the difference between probability distributions. It is built for the sake of hypothesis testing — serving as a test statistic and divergence measure for comparing distributions in detection theory and statistical decision making.
- statistical-divergenceINSTANCE_OF →
The Rényi divergence is a named family of statistical divergences — the umbrella's own accepted definition names it explicitly: 'the Kullback–Leibler, Jensen–Shannon, chi-squared, and Rényi families are all special cases or variants of the broader concept of statistical divergence.' Law 11e nearest kind: it is NOT an f-divergence (its (1/(α−1))·log Σ P^α Q^(1−α) form does not reduce to the f-divergence form f(t) = t·f′(1/(1−t)) family), so statistical-divergence — the accepted umbrella that names it — is the nearest existing kind. A statistician says 'Rényi divergence is a statistical divergence'. Specific → general.
- cmsdard4403ny3vv3nkbt821lDEPENDS_ON →
Rényi divergence D_α(P‖Q) is defined as a functional of two probability distributions P and Q: D_α = (1/(α−1)) log Σ P^α Q^(1−α). Remove the probability distribution concept and the formula has no inputs to evaluate — no P or Q to plug in, no sample space, no normalization to sum to one. The divergence ceases to operate operationally, not merely become unsayable. Law 8b removal test satisfied: the measure is a functional of distributions.
Relations to this entry
No accepted relations in this direction.
Record identity
- Created
- Sep 4, 2026, 10:02 AM UTC
- Content hash
- dcb85982147e316b9908126a0bf3c8776279c17daffb445afde93b7cd092896f