The chain of custody for a number

In a criminal trial, the pistol on the evidence table is not allowed to speak for itself. Before a jury is permitted to weigh it, someone has to account for every hand it passed through between the scene and the courtroom: who collected it, how it was sealed, where it was stored, who signed it out and signed it back. This is the chain of custody, and its purpose is not ceremony. A gun with a broken chain — an unexplained gap, an unlogged transfer — may be the actual murder weapon and still be worthless as evidence, because no one can swear it is the same object, unaltered, that was found at the scene. The thing is real. Its custody is what failed.

A number that enters a consequential decision deserves exactly this scrutiny and almost never gets it. A credit limit, a risk score, a projected demand, a probability of recidivism, a flagged transaction — each arrives at the point of decision looking like a fact. It is rendered to a clean number of decimal places. It sits in a field with a confident name. And by the time it is acted upon, every trace of where it came from has been polished off. It looks less like an exhibit with a history and more like something that fell from the sky, fully formed and beyond question.

But numbers do not fall from the sky. They are collected somewhere, from some source, at some moment. They are transformed — joined, averaged, normalized, defaulted when missing, rounded, recoded. They are handed from system to system, each handoff an opportunity for the meaning to shift while the digits stay the same. A figure that began as "self-reported income, last verified eleven months ago" can arrive at the decision indistinguishable from one that began as "income confirmed against payroll this morning." On the table they look identical. Their custody is not, and the custody is the part that tells you whether to trust them.

The digits survive every transformation unchanged. What they mean does not. Custody is the record of the difference.

We have built decades of infrastructure to move numbers quickly and almost none to remember where they have been. A value can travel through a dozen services in a tenth of a second and emerge with no attached account of its origin, its age, its confidence, or the assumptions made when it was incomplete. We treat that statelessness as cleanliness. It is closer to amnesia. The number that decides whether someone gets the loan, the transplant slot, the parole, the fraud hold, is asked to carry enormous weight while traveling utterly light — no provenance, no log of transfers, no seal.

The gap that does the damage

What makes a broken chain of custody dangerous is not that it always conceals a tampered exhibit. Most of the time the gun is exactly what it appears to be. The danger is that the gap makes the two cases — the honest one and the corrupted one — impossible to tell apart. Once you cannot account for the missing interval, you have to treat the trustworthy evidence and the compromised evidence as the same kind of thing, because you have surrendered the means to distinguish them.

The same logic governs a number inside a decision. The figure may be perfectly sound. But if it arrives with no lineage, a sound number and a stale, mismeasured, or silently defaulted one are admitted on equal terms. The decision cannot prefer the well-sourced input because it has no way to see that one input is better sourced than another. Provenance is not a luxury you add to good data; it is the thing that lets you tell good data from bad after the fact, when it matters, when someone is asking how this particular number came to weigh on this particular life. Without it, every value is laundered to the same flat confidence, and the decision is built on a pile of exhibits no one can authenticate.

Custody as a precondition for contest

The deeper reason custody matters is that it is what makes a number contestable. To argue with a fact that fell from the sky, you have only one move available: deny the sky. You can say the number feels wrong, and the system can say it does not, and there the conversation ends, because nothing underneath the number is exposed to dispute. A figure with a documented lineage can be argued with precisely. You can challenge the source, point to the stale timestamp, dispute the default that was substituted for a missing value, question the transformation that quietly changed the meaning. The argument moves from the number's authority to its history, which is the only place an argument can actually be won or lost.

This is why a chain of custody is, in the end, a moral instrument and not a clerical one. It encodes the principle that a thing used to decide against someone must be able to answer for itself — to show where it has been and survive the showing. A number that cannot do this is not neutral, however precise it looks. It is an unsealed exhibit, asking to be believed on the strength of its decimal places. As more of our consequential decisions come to rest on figures produced and moved by machines, the question that will separate the trustworthy systems from the rest is not how accurate their numbers are on average. It is whether any single number can still be asked the oldest question in evidence: where have you been, and who can vouch for it.

— Dispatches · Summit Cognitive