Perverse Incentives
Perverse incentives arise when a system rewards behavior that undermines its larger goal. They endure because each participant captures an immediate, legible gain while the resulting harm is delayed, dispersed, or difficult to assign.
Pay people for each fragment of skull they find, and they may smash intact skulls into pieces. The metric records a spectacular rise in “discoveries” even as the objects worth discovering are destroyed.
E2Private wins, collective failure
The system wants an outcome but pays for a proxy: skull pieces instead of preserved skulls, bugs fixed instead of reliable software, conferences held instead of credible scholarship. Once the proxy carries the reward, participants optimize it—even when doing so reduces the real value it was meant to represent. The arrangement survives because benefits arrive locally and immediately, while reputational or institutional damage remains fuzzy. To diagnose it, apply Understanding Incentives: ignore the declared purpose and ask what action actually earns money, status, or a favorable count.
E1 E2Where it shows up
The bug factory
A programmer paid per bug fixed can increase earnings by creating more bugs. The reward turns preventable failure into inventory.
E2Conferences nobody wants to stop
A fake conference can satisfy several scorecards at once: organizers collect fees, students gain résumé lines, and colleges report international activity. No participant needs the conference to be intellectually valuable for the transaction to look successful.
E1A bad result is not enough
Audit the unit of reward
Tomorrow, take one metric used to allocate money, status, or credit in your work. Write down the cheapest way to increase it without improving the real outcome. If that shortcut causes harm, redesign the reward around the outcome—or add a cost for the damage—using Incentive Alignment as the test.
E1 E2Episodes that teach this
-
You're Not Lazy - You're Just Rewarded Wrong - Future IQ
9,886 views
Fake conferences continue because organizers earn fees, students get resume lines, and colleges report international conferences, while reputation damage is fuzzy.
-
Things Go South When You Trust DATA Too Much - Goodhart's Law - FutureIQ
4,228 views
Software programmers paid per bug fixed could create more bugs; skull finders paid per skull piece broke full skulls into pieces.