Who Comes Back to Court?

datawithaplot.org · clinical vs. actuarial prediction

1The morning stack
2Your calls
3The score
A prediction exercise

Ten people, ten court dates.

You are running pretrial intake this morning. Ten people were arrested, released, and given a court date. Your job: for each file, predict whether they return to court or miss it.

Read however you like. The history, the job, the notes, the vibe. Use everything.

No takebacks. Once you call a file, it's called. When you finish, a simple checklist makes the same ten calls, and you see where each one does better.

All ten files are fictional composites. Nothing you enter leaves your browser.

File 1 of 10

Make the call, then the next file opens.

The score
–
You, reading full files
–
The checklist, two facts
–
Guessing "returns" every time

The Whole Checklist

This is everything it looked at. It never read the notes.

File by File

Why Two Facts Go So Far

In 1954, the psychologist Paul Meehl compared expert predictions with simple statistical rules across every study he could find, and the rules held up in comparison after comparison. Almost fifty years later, a meta-analysis of 136 studies reached the same conclusion, in medicine, education, and courtrooms alike.

The reason is not that experts know too little. It is that files like these are full of vivid, useless detail. The apology letter, the anger, the exhaustion: they feel like signal and behave like noise. Two boring facts carry most of the real information, and the checklist weighs them the same way on every file, whether it is the first of the morning or the tenth.

There is also a quieter trap in the stack: most people return to court. Guess "returns" every time and you score of 10 here without opening a single file. A gut that calls a lot of misses has to be very good just to beat doing nothing.

Teaching Prompt: Clinical vs. Actuarial Judgment

Judgment is not worthless: someone had to pick the two variables. The lesson is where judgment belongs: building the checklist, auditing it, and studying the cases it gets wrong, which puts expertise to better use than second-guessing it file by file. When intuition and a validated rule disagree, the rule is the better bet.

Sources & Method Notes

More exercises →