The witness you can subpoena

The power to compel a witness is one of the quiet foundations of every system that aspires to find the truth. A person who knows something relevant can be summoned — required, under penalty, to appear, to be sworn, to answer questions they would rather not answer, and to be held to those answers afterward. The witness does not get to decide whether to participate. That is the whole point. Accountability begins where the convenience of the powerful ends, and the subpoena is the instrument that ends it.

When a machine makes a consequential decision, we reach instinctively for the same instrument, and find it grasps nothing. We want to summon the system that decided, put it under oath, and ask it the question that matters: why this, and not something else? But there is no one to summon. The model produced an output and the output is all there is. It cannot be sworn, because it does not persist in a state from which it could be questioned. It cannot be held to its answer, because it has no further answers to give. It has already spoken, and it will not elaborate, and pressing it only produces a new utterance, freshly generated, with no greater claim to fidelity than the first.

Why the model cannot be called

This is the trap of treating a model's output as testimony. Testimony is something a witness stands behind — a fixed account that can be returned to, probed, and contradicted, with the witness still present to defend or revise it. A model's output is not an account; it is a result. Ask the same system the same question again and you do not get clarification of the original answer. You get a second answer, possibly different, with no privileged relationship to the first. There is no thread connecting the two that you could pull on. The system is not lying and it is not telling the truth. It is simply not a witness, because a witness is something that can be re-examined, and the live model offers only the perpetual present of another fresh assertion.

You can see why this matters most precisely when the stakes are highest. The cases that demand cross-examination are the contested ones — the decision someone wants to challenge, the outcome that needs to be defended or overturned. In exactly those cases, the live system is useless as a witness. It will answer your question, fluently, and its answer will tell you nothing reliable about what actually happened when the original decision was made. You are not interrogating the decision. You are generating a new one and mistaking it for memory.

You cannot cross-examine a sentence. You can only cross-examine something that was written down before the question was asked.

The record is the witness

The thing that can be subpoenaed is the record. Not the model, which has moved on, but the durable account the decision left behind — the evidence it actually consulted, the rule it was operating under, the state from which its conclusion followed. That account has the properties testimony requires and the model lacks. It is fixed: it says the same thing every time you call it, because it was committed at the moment of decision and does not regenerate when questioned. It can be produced on demand: the whole force of a subpoena is that it compels production, and a record is a thing that can be produced. And it can be examined and held to its account, because it does not change its story under pressure. It cannot, because it is a record and not a speaker.

This is the difference between asking the system and reading the receipt. When you ask the system, you get an answer that is generated now and tells you about now. When you read the receipt, you get an account that was committed then and tells you about then. Only the second can settle a dispute about a past decision, because only the second is anchored to the past. A Decision Receipt is, in this exact sense, the witness you can subpoena — the artifact that can be called, produced, sworn to by its provenance, and held to what it says, in place of a model that can do none of those things.

The practical consequence is a design instruction, and it is unambiguous. Do not rely on being able to ask the model later, because the model later is a different witness answering a different question. Build, at the moment of decision, the record that will be able to testify in the model's place — the record that fixes what was considered and what rule applied while it is still true to fix it. Capture the testimony before the trial, because by the time anyone wants it, the only witness left will be the one you wrote down.

A system that decides without leaving such a record has not produced a private witness who might be persuaded to speak. It has produced no witness at all. The decision will have happened, and there will be no one to call. The record is how you keep someone available to answer for it — the one party in the whole arrangement that can be compelled, because it is the only one built to be.

— Dispatches · Summit Cognitive