DISPATCHES · Summit Cognitive

← All dispatches

EvidenceJuly 27, 20264 min read

The receipt and the rebuttal

A record that cannot be argued against is not evidence; it is just a claim with better production values.

There is a particular kind of document that organizations love to produce after something goes wrong. It is clean. It is confident. It has a logo at the top and a signature at the bottom, and it walks you through what happened in calm, complete sentences. It is designed, above all, to make you stop asking. And it is worth noticing that almost none of these documents are built to survive contact with someone who disagrees. They are built to reassure, which is a different thing entirely — sometimes the opposite thing.

A decision record is only evidence if it is built to be contested. That sounds backward. We tend to think of a good record as one that settles the matter, that closes the loop, that leaves nothing further to say. But a record whose only function is to close the loop has no way of proving it deserves to. The value of a record is not in how reassuring it is. It is in how cleanly it could be shown to be wrong — and survives the attempt, or doesn't.

This is the test I want to propose for any record that claims to account for a consequential decision: imagine the most motivated possible adversary, the party with the most to lose, who wants nothing more than to prove the decision was mistaken. What does the record owe that person? Not a soothing narrative. A surface to fight on.

A summary asks you to accept its account. Evidence dares you to break it. Only one of those is worth signing.

What a record owes the party who wants to fight it

Three things, concretely. First, the actual evidence that was in front of the decision at the moment it was made — not a flattering selection of it, not a paraphrase, not "the relevant factors were considered." The real sources, in the order they were consulted, because order frames meaning: a fact read before a contradicting fact does different work than the same fact read after. A record that hands you a tidy summary of the evidence has already done your opponent's editing for them. You cannot contest a summary; you can only resent it.

Second, the rules that were actually active at the time — frozen, in full, as they stood at the instant of decision. Not a pointer to a policy document that may have been amended since, not "in accordance with applicable guidelines." The text of the rules as they were, carried inside the record itself, so that the question did this decision follow the rules it was bound by can be answered without anyone deciding which version of the rules to quote after the fact. Policies drift. A record that depends on the current policy to explain a past decision is a record that can be quietly rewritten by changing nothing about itself.

Third, enough state to replay the decision — to feed the same inputs back through the same process and watch where it lands. This is the part that turns a record from a story into a claim that can be falsified. A genuine rebuttal does not argue with the conclusion; it reruns the inputs and shows the conclusion does not follow. If the replay reproduces the original outcome, the record has earned its standing. If it does not, the divergence is itself the finding — it tells you, exactly, what changed.

Production values are not evidence

The contrast at the heart of this is between two kinds of record that can look almost identical at a glance. One is designed to reassure. It is fluent, well-formatted, internally consistent, and structurally unfalsifiable — there is nothing in it you could grab hold of and pull. The other is designed to be refuted. It exposes its inputs, its rules, and its reproducibility precisely so that someone can try to knock it over. The first has production values. The second has a rebuttal surface. They are not on a spectrum; they are different objects with different purposes.

And here is the uncomfortable implication: a record that offers nothing to argue with is not neutral, it is suspect. If a decision genuinely happened the way the record says, then exposing the evidence and the rules and the replayable state costs the author nothing — the record will hold. The only reason to withhold those things is that they might not hold. So a polished account that cannot be tested is not the absence of a weakness; it is the concealment of one. The smoother it is, the more you should want to see underneath.

None of this is an argument against confidence. A decision can be right, and a record can prove it — that is the whole point. A Decision Receipt that carries its real evidence, its frozen rules, and its replay metadata is more authoritative than any memo precisely because it invites the attack and withstands it. Authority earned by surviving scrutiny is the only kind that lasts. Authority asserted by foreclosing scrutiny lasts exactly until someone declines to stop talking.

So the next time an institution hands you a clean account of a decision that affected you, ask the one question its production values are designed to forestall: what would it take to prove this wrong, and have you given me what I'd need to try? If the answer is everything, you are holding evidence. If the answer is a shrug and a logo, you are holding a claim — and you should treat it like one.

— Dispatches · Summit Cognitive

Continue from here

Turn the argument into a practice.

Get new dispatches, assess how your organization handles consequential decisions, or explore Summit Cognitive.