Valeriy’s Substack

Valeriy’s Substack

🎲 Estimating Binomial Coefficients with Entropy: A Beautiful Shortcut

Valeriy Manokhin's avatar
Valeriy Manokhin
Jul 21, 2025
∙ Paid

Computing binomial coefficients like C(n, k) — the number of ways to choose k items from n — gets messy when n is large.

But there’s a surprisingly elegant shortcut from information theory:

C(n, k) ≈ 2ⁿʰ(p)
where p = k / n, and h(p) is the binary entropy function:

h(p) = -p · log₂(p) - (1 - p) · log₂(1 - p)

User's avatar

Continue reading this post for free, courtesy of Valeriy Manokhin.

Or purchase a paid subscription.
© 2026 Valery Manokhin · Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture