Prob­a­bil­ity & Statistics

How long does it take to be­come Gaus­sian?

Simp­son’s Paradox

Can we always as­sign, and make sense of, sub­jec­tive prob­a­bil­ities?

Risk and un­cer­tainty: A false di­chotomy?

How much do you be­lieve your re­sults?

An Illus­trated Proof of the No Free Lunch Theorem

Cor­re­spon­dence vi­su­al­iza­tions for differ­ent in­ter­pre­ta­tions of “prob­a­bil­ity”

Re­port like­li­hood ratios

How to Un­der­stand and Miti­gate Risk

A time-in­var­i­ant ver­sion of Laplace’s rule

Mes­sage Length

The Tails Com­ing Apart As Me­taphor For Life

A Bayesian Ag­gre­ga­tion Paradox

The Kelly Cri­te­rion in 3D

Fermi Estimates

Laplace’s rule of succession

[Question] What is a prob­a­bil­is­tic phys­i­cal the­ory?

Con­fi­dence lev­els in­side and out­side an argument

Beau­tiful Probability

La­tent Vari­ables and Model Mis-Specification

Mul­ti­vari­ate es­ti­ma­tion & the Squig­gly language

Refer­ence Classes

Large Effects Can’t Prove Small Causes

The Effec­tive­ness Of Masks is Limited

Prob­a­bil­ity Space & Au­mann Agreement

“A Defi­ni­tion of Sub­jec­tive Prob­a­bil­ity” by An­scombe and Aumann

Aver­age prob­a­bil­ities, not log odds

Au­mann’s Agree­ment Revisited

“Statis­ti­cal Bias”

“In­duc­tive Bias”

Very Short In­tro­duc­tion to Bayesian Model Com­par­i­son

Use Nor­mal Predictions

From Laplace to BIC

Bayesian Model Test­ing Comparisons

Cross-Val­i­da­tion vs Bayesian Model Comparison

Con­fi­dence in­ter­vals seem to be rarely use­ful, in and of themselves

Most likely is not likely

The Joys of Con­ju­gate Priors

Ep­silon is not a prob­a­bil­ity, it’s a cop-out

12 in­ter­est­ing things I learned study­ing the dis­cov­ery of na­ture’s laws

[Question] Thoughts on the SPIES Fore­cast­ing Method?

Search­ing for outliers

“Pre­dic­tion” and “ex­pla­na­tion” are not causation

Prob­a­bil­ity, knowl­edge, and meta-probability

The Case for Fre­quen­tism: Why Bayesian Prob­a­bil­ity is Fun­da­men­tally Un­sound and What Science Does Instead

Case study: abuse of fre­quen­tist statistics

scipy.op­ti­mize.curve_fit Is Awesome

Bayesi­anism for hu­mans: “prob­a­ble enough”

If It’s Worth Do­ing, It’s Worth Do­ing With Made-Up Statistics

Beyond Bayesi­ans and Frequentists

A But­terfly’s View of Probability

The Se­cond Law of Ther­mo­dy­nam­ics, and Eng­ines of Cognition

In­for­ma­tion Charts

What is Bayesi­anism?

Refer­ences & Re­sources for LessWrong

Rad­i­cal Probabilism

Rugby & Re­gres­sion Towards the Mean

Six (and a half) in­tu­itions for KL divergence

[Question] What are prin­ci­pled ways for pe­nal­is­ing com­plex­ity in prac­tice?

Quadratic mod­els and (un)falsified data

The cen­tral limit the­o­rem in terms of convolutions

Why square er­rors?

Log­i­cal in­duc­tion for soft­ware engineers

Should cor­re­la­tion co­effi­cients be ex­pressed as an­gles?

[Question] What does “prob­a­bil­ity” re­ally mean?

0 and 1 aren’t probabilities

What makes a prob­a­bil­ity ques­tion “well-defined”? (Part II: Ber­trand’s Para­dox)

Vi­su­al­i­sa­tion of Prob­a­bil­ity Mass

Stan­zas On Power Calculation

Prob­a­bil­ity The­ory: The Logic of Science, Jaynes

Why the tails come apart

Pseu­do­ran­dom­ness con­test: prizes, re­sults, and analysis

Sub­scripts for Probabilities

How can one ra­tio­nally have very high or very low prob­a­bil­ities of ex­tinc­tion in a pre-paradig­matic field?

Statis­ti­cal mod­els & the ir­rele­vance of rare exceptions

Bayesian Net­works Aren’t Ne­c­es­sar­ily Causal

Trust in Bayes

Calcu­lat­ing Kelly

The Uni­vari­ate Fallacy

The av­er­age North Korean mathematician

Two Dark Side Statis­tics Papers

An In­tu­itive Ex­pla­na­tion of Bayes’s Theorem

The prob­lem/​solu­tion ma­trix: Calcu­lat­ing the prob­a­bil­ity of AI safety “on the back of an en­velope”

Map:Ter­ri­tory::Uncer­tainty::Ran­dom­ness – but that doesn’t mat­ter, value of in­for­ma­tion does.

Book re­view: Pearl’s Book of Why

In­sights from “All of Statis­tics”: Probability

In­sights from “All of Statis­tics”: Statis­ti­cal Inference

Book Re­view—Prob­a­bil­ity and Fi­nance: It’s Only a Game!

Book Re­view: Fooled by Randomness

Causal In­fer­ence Se­quence Part 1: Ba­sic Ter­minol­ogy and the As­sump­tions of Causal Inference

Hy­poth­e­sis Space Entropy

Book Re­view of 5 Ap­plied Bayesian Statis­tics Books

Causal In­fer­ence Se­quence Part II: Graph­i­cal Models

Yes, Virginia, You Can Be 99.99% (Or More!) Cer­tain That 53 Is Prime

Gen­er­al­ised mod­els: im­perfect mor­phisms and in­for­ma­tional entropy

Out-of-body rea­son­ing (OOBR)

A Pois­son pro­cess paradox

Prob­a­bil­ity vs Likelihood

Are dogs bad?

[Question] What is the se­man­tics of as­sign­ing prob­a­bil­ities to fu­ture events?

The Ja­panese Quiz: a Thought Ex­per­i­ment of Statis­ti­cal Epistemology

a vi­sual ex­pla­na­tion of Bayesian updating

Does but­terfly af­fect?

The Gen­er­al­ized Product Rule

[Question] Is it true that most stud­ies in Kah­ne­man’s ‘Think­ing fast and slow’ are not repli­ca­ble and the book is largely not sup­ported by ev­i­dence?

[Question] Jay­ne­sian in­ter­pre­ta­tion—How does “es­ti­mat­ing prob­a­bil­ities” make sense?

[Question] Do Bayesi­ans like Bayesian model Aver­ag­ing?

[Question] Halpern’s pa­per—A re­fu­ta­tion of Cox’s the­o­rem?

[Question] Jaynes-Cox Prob­a­bil­ity: Are plau­si­bil­ities ob­jec­tive?

[Question] Has Van Horn fixed Cox’s the­o­rem?

[Question] Causal with­out cor­re­la­tion, how?

[Question] Is LessWrong dead with­out Cox’s the­o­rem?

Book Re­view: The End of Average

Poker with Lennier

[Question] Does any­one know what Marvin Min­sky is talk­ing about here?

Find­ing the Cen­tral Limit The­o­rem in Bayes’ rule

Com­mon Prob­a­bil­ity Distributions

A Gen­er­al­iza­tion of ROC AUC for Bi­nary Classifiers

Anti-cor­re­lated causation

Some thoughts about an es­ti­ma­tor by Taleb

Tar­get for Tonight: A Drama In One Act

Ret­ro­spec­tive forecasting

A com­pila­tion of mi­suses of statistics

The me­dian and mode use less in­for­ma­tion than the mean does

Prac­ti­cal use of the Beta dis­tri­bu­tion for data analysis

Don’t be afraid of the thou­sand-year-old vampire

De­con­fus­ing Lan­dauer’s Principle

[Question] What is the most prob­a­ble AI?

Five views of Bayes’ Theorem

Utility func­tions and prob­a­bil­ities are entangled

Statis­tics for vague con­cepts and “Colors” of places

Statis­tics for ob­jects with shared identities

The high­est-prob­a­bil­ity out­come can be out of distribution

[Question] Why are prob­a­bil­ities rep­re­sented as real num­bers in­stead of ra­tio­nal num­bers?

Mir­a­cles and why not to be­lieve them

Re­view: Bayesian Statis­tics the Fun Way by Will Kurt

Why Bet Kelly?

Your Link­ages are Wrong

A hun­dredth of a bit of ex­tra entropy

The AI Con­trol Prob­lem in a wider in­tel­lec­tual context

The Best Text­books on Every Subject

Mak­ing bet­ter es­ti­mates with scarce information

[Question] Where to start with statis­tics if I want to mea­sure things?

Re­quire­ments for a STEM-ca­pa­ble AGI Value Learner (my Case for Less Doom)

Born as the sev­enth month dies …

Shut Up And Guess

If a tree falls on Sleep­ing Beauty...

“No ev­i­dence” as a Valley of Bad Rationality

Why We Can’t Take Ex­pected Value Es­ti­mates Liter­ally (Even When They’re Un­bi­ased)

Co-Proofs

A Proper Scor­ing Rule for Con­fi­dence Intervals

Me­taMed: Ev­i­dence-Based Healthcare

Even if you have a nail, not all ham­mers are the same

Rea­son­able Explanations

Tech­niques for prob­a­bil­ity estimates

Punc­tu­al­ity—Ar­riv­ing on Time and Math

Prob­a­bil­ity space has 2 metrics

Fre­quen­tist Statis­tics are Fre­quently Subjective

Ex­ces­sive EDA Effortposting

Reflec­tion in Prob­a­bil­is­tic Logic

His­tory of LessWrong: Some Data Graphics

A Mo­tor­cy­cle (and Cal­ibra­tion?) Accident

Against NHST

Anti-akra­sia tool: like stickK.com for data nerds

New Im­proved Lottery

Gears vs Behavior

In­ter­pre­ta­tions of “prob­a­bil­ity”

What would con­vince you you’d won the lot­tery?

Cir­cu­lar Altruism

0 And 1 Are Not Probabilities

A Fer­vent Defense of Fre­quen­tist Statistics

Fun­nel plots: the study that didn’t bark, or, vi­su­al­iz­ing re­gres­sion to the null

Lot­ter­ies: A Waste of Hope

Con­founded No Longer: In­sights from ‘All of Statis­tics’

Effect het­ero­gene­ity and ex­ter­nal val­idity in medicine

Fre­quen­tist Magic vs. Bayesian Magic

Noisy Poll Re­sults And Rep­tilian Mus­lim Cli­ma­tol­o­gists from Mars

Diseased dis­ci­plines: the strange case of the in­verted chart

Multiplicitous

Wolf’s Dice II: What Asym­me­try?

Wolf’s Dice

Chart­ing Deaths: Real­ity vs Reported

The Pyra­mid And The Garden

The Statis­ti­cian’s Fallacy

Us­ing de­grees of free­dom to change the past for fun and profit

In­stinc­tive Fre­quen­tists, the Out­side View, and de-Biasing

Hu­man perfor­mance, psy­chom­e­try, and base­ball statistics

No non­sense ver­sion of the “racial al­gorithm bias”

Bayes’ The­o­rem in three pictures

Crypto quant trad­ing: Intro

Crypto quant trad­ing: Naive Bayes

 How Should We Cri­tique Re­search? A De­ci­sion Perspective

Sub­text is not in­var­i­ant un­der lin­ear transformations

What Are Prob­a­bil­ities, Any­way?

Prob­a­bil­ity in­ter­pre­ta­tions: Examples

Prob­a­bil­ity is Sub­jec­tively Objective

Pri­ors as Math­e­mat­i­cal Objects

Hor­rible LHC Inconsistency

Imag­ine a World Where Govern­ments Treated COVID-19 Properly

Bayesian Flame

[Link] “Fewer than X% of Amer­i­cans know Y”

Coun­ter­fac­tual out­come state tran­si­tion parameters

When (Not) To Use Probabilities

Com­plex­ity Penalties in Statis­ti­cal Learning

Rais­ing the fore­cast­ing wa­ter­line (part 1)

Co­var­i­ance in your sam­ple vs co­var­i­ance in the gen­eral population

Mov­ing to a World Beyond “p < 0.05”

The dan­gers of zero and one

How sub­jec­tive is at­trac­tive­ness?

Vi­su­al­iz­ing the power of mul­ti­ple step se­lec­tion pro­cesses in JS: Gal­ton’s bean machine

(Sub­jec­tive Bayesi­anism vs. Fre­quen­tism) VS. For­mal­ism

Laplace Approximation

The In­spec­tion Para­dox is Everywhere

In­spec­tion Para­dox as a Driver of Group Separation

In­her­ited Im­prob­a­bil­ities: Trans­fer­ring the Bur­den of Proof

On the Im­por­tance of Sys­tem­atic Bi­ases in Science

Monty Hall in the Wild

Us­ing ma­chine learn­ing to pre­dict ro­man­tic com­pat­i­bil­ity: em­piri­cal results

Too good to be true

[Draft] Poker With Lennier

How to come up with ver­bal probabilities

Use­ful Statis­ti­cal Biases

What’s wrong with this pic­ture?

Kling, Prob­a­bil­ity, and Economics

Sam­ple means, how do they work?

Fre­quen­tist prac­tice in­cor­po­rates prior in­for­ma­tion all the time

[Question] Does there ex­ist a de­tailed Bayesian COVID tracker?

How Not to be Stupid: Adorable Maybes

Log-odds (or log­its)

[Question] Did any­body calcu­late the Bri­ers score for per-state elec­tion fore­casts?

The Fal­lacy of Large Numbers

Free Stats Text­book: Prin­ci­ples of Uncertainty

Prob­a­bil­ity dis­tri­bu­tions and writ­ing style

in­dex­i­cal un­cer­tainty and the Ax­iom of Independence

Con­volu­tion as smoothing

Causal­ity does not im­ply correlation

An el­e­gant proof of Laplace’s rule of succession

The Pre­dic­tion Hierarchy

How Less­wrong helped me make $25K: A ra­tio­nal pric­ing strategy

De­bunked And Well-Refuted