DISPATCHES · Summit Cognitive

← All dispatches

StandingJuly 27, 20265 min read

Who watches the reconstruction

A replay is supposed to settle the question of whether a decision was sound. But a replay is itself a thing produced by a system, and a thing produced by a system can be wrong about itself.

Suppose you have done the hard part. The decision that mattered can be reconstructed: the evidence it ran against, the rule it applied, the state of the world it assumed. You can run it again and watch it reach the same conclusion for the same reasons. This is a real achievement, and most systems cannot do it. But it invites a question that has a way of spoiling the satisfaction. The reconstruction is itself an artifact produced by machinery. It was assembled, stored, retrieved, and rendered by software that could have been wrong at any of those steps. So why, exactly, do you trust the replay?

The honest answer is that a replay does not prove a decision was sound. It proves that a particular account of the decision is internally consistent. Those are not the same thing. If the record was captured by a system that quietly dropped the awkward evidence, the replay will faithfully reconstruct a decision made on a flattering subset and pronounce it coherent. The reconstruction inherits whatever the capture left out. It cannot reach behind itself to check the hand that fed it. A clean replay of a corrupted record is not assurance. It is a forgery with good production values.

This is the recursion, and it is genuinely uncomfortable. Every layer you build to certify the one below it is itself a system, and so it raises the same demand it was meant to answer. The replay needs provenance. The thing that establishes the replay's provenance needs provenance. You can feel the floor giving way. If the only way to trust a reconstruction is another reconstruction, the question of trust has not been answered. It has been relocated, one level up, where it sits waiting with exactly the same face.

Every instrument that certifies a decision is itself a thing that decided. You do not escape the question of trust by adding a layer. You only choose where to stop asking it out loud.

Engineers reach instinctively for a technical floor here, and there is a good one. You can make a record tamper-evident, so that altering it after the fact breaks a seal that anyone can check. You can bind the rule and the inputs into the same sealed object, so the replay cannot quietly run a different decision than the one it claims. These are not nothing. They collapse a wide class of failures — the silent edit, the swapped input, the convenient re-run — into something visible. But notice what they actually do. They do not prove the original capture was complete or honest. They prove that what was captured has not changed since. The seal certifies fidelity to the record, not fidelity of the record to the world. That gap is where the recursion lives, and no cryptographic primitive closes it, because the question is no longer mathematical.

Where the regress actually stops

The regress does not stop on a technical floor. It stops on a social one, and pretending otherwise is the characteristic error. At some layer you arrive at a thing that is trusted not because a further system vouched for it but because a person, or an institution, or a court has agreed to treat it as the place where asking stops. Standards bodies do this. Certificate authorities do this. The rules of evidence do this — they name the conditions under which a record is admitted without requiring that its entire provenance be re-litigated each time. The foundation of an assurance chain is never another link. It is a decision by some accountable party to stand behind a link, and to be answerable if it fails.

This is worth saying plainly because the engineering instinct is to push the floor down one more level, and one more, in search of a layer that needs no trust at all. There is no such layer. The most rigorous system in the world bottoms out in a clock someone calibrated, a key someone generated, a process someone attested to. What changes between a trustworthy system and an untrustworthy one is not whether it rests on human judgment — both do — but whether the place it rests is named, exposed, and accountable, or hidden so that no one can see what they are being asked to take on faith.

The honest version of the claim

So the right claim for a reconstruction to make is narrower and sturdier than the one people want to make for it. Not: this proves the decision was correct. Rather: this is a sealed, tamper-evident account of what the system actually had and actually did, and here is the named party who stands behind the capture. That claim is recursion-proof in the only way that matters, because it does not pretend the chain terminates in something self-justifying. It terminates in someone who can be asked, and held to the answer.

The failure mode to fear is not the infinite regress. It is the regress that is quietly truncated and dressed up as a proof — a replay presented as final because the recursion was hidden rather than resolved. A reconstruction that points honestly at its own foundation, and at the party accountable for it, is doing the most that any instrument of assurance can do. The ones that claim to need no such foundation are not more rigorous. They have simply stopped telling you where they stopped asking.

— Dispatches · Summit Cognitive

Continue from here

Turn the argument into a practice.

Get new dispatches, assess how your organization handles consequential decisions, or explore Summit Cognitive.