Skip to the content
five peers
Journal · Method

Base rates: how often does this actually work?

Before asking whether your plan will work, ask how often plans of this kind work. The answer is usually available, usually sobering, and usually ignored.

Method · 6 min read
What is base rate neglect? The tendency to judge a specific case on its vivid particulars while ignoring how often cases of that type turn out a given way. It is one of the most consistently replicated findings in judgement research and one of the easiest to correct deliberately.

The inside view builds a forecast from the details of your situation: your team, your plan, your reasons for confidence. The outside view asks what happened to the reference class of things like this. The inside view is more engaging, more specific, and reliably more optimistic.

What it looks like in practice

"Our first sales leader will work out because we have a strong process and a clear brief." The outside view asks how often first sales leaders work out, and the honest answer across most sources is somewhere around a third, with failures clustered early. That does not mean do not hire. It means budget for the median outcome rather than the one you are picturing, and design for the failure mode with the highest frequency.

Your situation is genuinely different. So was everyone else's.

Building a reference class when there is no dataset

Why this is trainable

In the largest forecasting tournament run on the question, roughly an hour of training in probabilistic reasoning improved accuracy by about 10% on Brier scores, and the effect persisted across four years. Part of that training was explicitly about reference classes and stating coherent probabilities. It is a method, not a talent.

Five Peers editorial note. Sources named in the text.

One of the five you get if you tend to argue from the vivid example.

Compose my board