Trapped Prior

mechanism

A trapped prior is a belief that has become resistant to correction: it filters, dismisses, or reinterprets incoming evidence so that the belief itself never has to change.

Some beliefs become more secure when challenged. Wrap a prior in sacredness—a “halo”—and arguments against it no longer count as reasons to reconsider; they become proof that the belief must be defended.

When the filter protects itself

Ordinary priors give new information a starting context and can then be revised. A trapped prior closes that loop. Once it is strong enough, it colors the evidence arriving afterward: supportive observations look credible, while contradictions are ignored, recoded, or prevented from registering as evidence at all. The result is not merely refusing to change your mind after seeing the facts. You may never experience the contradiction as a fact in the first place. Bayesian updating fails because the input has already been filtered by the belief it was supposed to test.

E1 E2

Where it shows up

Sacred beliefs

Sacredness adds moral protection to a prior. Counterarguments can then feel like violations rather than information, making revision nearly impossible regardless of how much evidence accumulates.

The online picture

Online, a protected belief can keep selecting and interpreting signals until you acquire a coherent but false picture of events. Reality remains unchanged; your representation of it drifts away.

Perception before reasoning

A sufficiently strong expectation colors future evidence while remaining untouched itself. This is believing is seeing at its most rigid: the prior shapes what appears available for judgment.

Conviction is not automatically captivity

A belief is not trapped merely because it is strong or survives disagreement. The failure begins when contrary evidence is systematically denied entry or reinterpreted in ways that make revision impossible. The test is not how firmly you believe, but whether any conceivable observation could lower your confidence.

E1 E3

Name the evidence that would move you

Choose one important belief and write down, in advance, a specific observation that would reduce your confidence in it. Then seek that observation from a source you do not control. If every possible result can be explained away without changing the belief, you have located the trap.

E1 E2 E3

Episodes that teach this

From Instinct to Insight - How Do We Really Decide? Bayesian Thinking - Future IQ · explained at 7:19 7,456 views
"A very important special case called trapped prior which prevent you from ever seeing any evidence."
Believing is Seeing - How Bayesian Priors Trick Your Senses - Future IQ · explained at 7:34 6,488 views
"when a prior is strong enough, it will color all future evidence and it itself... will not change"
Exploring The Idea Of "Sacredness" - Future IQ · explained at 3:54 6,448 views
“It is a trapped prior with a halo around it… no amount of evidence, no amount of arguments against it are going to change your mind.”
How The Human Brain Is Getting Dumber Online | Future IQ · explained at 6:33 6,239 views
"Reality does not care about your trapped prior... you are getting a very false picture of what is really happening."