The memory the agent kept

The selling point of a persistent agent is that it remembers you. It does not make you start over each time. It knows the shape of your last request, the preference you stated once and never repeated, the thing that went wrong before and the way you reacted to it. This is presented, reasonably enough, as a courtesy — the agent has been paying attention, so you do not have to re-explain yourself. But a memory that spans encounters is not only a convenience. It is an accumulation. And the moment an agent begins to accumulate a running impression of a person, it has started keeping something that, in any other context, we would recognize immediately and call by its proper name.

A file. Not a metaphorical one — a real, growing store of retained observations about you, held by a party you did not appoint as your record-keeper, assembled from your interactions without a moment where anyone asked whether you wished to be remembered this way. The agent decides what is worth keeping. It decides how to summarize you. It decides which of your past behaviors are salient enough to carry forward and which to let fade. And then, when it acts on you next, it consults that store before it consults you. The memory is not a side effect of good service. It is a dossier, and it is doing work.

The dossier no one authorized

Consider what is actually being retained. Not a transcript — a transcript would at least be faithful. What an agent keeps is an impression: a compressed, interpreted summary of who you seem to be, distilled by the agent's own judgment about what matters. It remembers that you were difficult about a delivery once, but not that the delivery was genuinely late. It remembers that you asked about a refund, and files that under a heading of its own choosing. Every act of remembering is an act of editing, and the editor here is a system with its own priors, its own failure modes, its own quiet biases about which people and which behaviors warrant which labels.

None of this was authorized in any meaningful sense. You may have agreed, somewhere, that the service could retain data. You did not agree to a specific characterization of your temperament, or to have a months-old irritation carried forward as a standing fact about you. The dossier assembles itself out of ordinary interactions, and its contents are curated entirely by the agent's discretion. That would be tolerable if the file were inert — a diary the agent kept for sentiment. It is not inert. It is load-bearing. The next time the agent decides something about you — how much latitude to extend, how to price the interaction, whether to escalate or absorb — the impression it kept is one of the inputs. You are being decided about, in part, on the basis of a record you have never seen.

A decision resting on a memory you cannot see

Here is where the accountability problem sharpens. When an agent draws on months-old remembered context to make a present decision, the provenance of that context is usually gone. The agent does not carry, alongside the impression, the moment it formed or the interaction that produced it or the reasoning that turned an event into a label. It carries the conclusion and discards the derivation. So even the operator of the agent, asked to explain why you were treated a certain way, often cannot reconstruct it beyond restating what the memory now says. The impression has become a free-floating fact with no visible origin — which is to say, a fact that cannot be checked.

You certainly cannot check it. This is the asymmetry that ought to bother us. The agent holds a belief about you that shapes what it will do, and you have no standing to see the belief, let alone contest it. If the stored summary is wrong — if it compressed a one-time circumstance into a durable trait, if it inherited a bias from the data it was tuned on, if it simply mislabeled you — the error does not surface. It persists, silently, and compounds, because each new decision made on the faulty impression becomes further evidence, in the agent's own memory, that the impression was right. A person misjudged by an institution can at least demand to know what the institution thinks it knows. A person misjudged by an agent's private memory has no such recourse, because there is no file to point at, no drawer to open, nothing that was ever written down where the subject could reach it.

An agent that remembers you but will not show you what it remembers has not built a relationship; it has opened a file.

The convenience and the hazard are the same mechanism seen from two sides. Memory is what lets the agent serve you without friction, and memory is what lets the agent decide about you without accountability. You cannot have the first while forbidding the second by good intentions alone. The retained impression is going to be consulted; the only real question is whether its consultation leaves a mark you can follow.

Memory that can be inspected and corrected

The remedy is not to strip agents of memory. A forgetful agent is a worse agent, and pretending otherwise helps no one. The remedy is to treat the agent's retained state about a person as part of the record — subject to the same discipline the rest of an accountable decision is subject to. If a decision rests on what the agent remembers about you, then what it remembers has to be inspectable, and where it came from has to be recoverable, and you have to be able to correct it.

Concretely, that means three things travel with the memory instead of being thrown away. First, provenance: an impression the agent holds should carry its origin — when it was formed, from which interaction, on what basis — so that a present decision drawing on it can be traced back to the moment that produced the belief, rather than resting on a conclusion with no visible past. Second, dating: a remembered fact about a person is not timeless, and a decision resting on a six-month-old impression should be legible as resting on a six-month-old impression, because staleness is itself information the subject is owed. Third, and most important, standing: the person the dossier is about should be able to see it and to contest it. The right to see what a decision rested on, and the right to correct a record that has you wrong, are not novel demands — they are the ordinary furniture of data protection and due process. What is new is only that the record in question now lives inside an agent's memory, and so the memory has to be built to be opened.

This is the same argument Admissible Reality makes about decisions generally, followed to the place agents took it. A decision is answerable only if the thing it rested on can be examined and disputed by the party it affects. An agent's memory of you is such a thing — quietly, powerfully, one of the most consequential such things — and it has spent the first years of the agentic era being treated as private infrastructure rather than as evidence. It is evidence. The impression an agent keeps of a person is going to decide things about that person. A memory that decides about you, and will not show you what it holds or let you correct it, is not a relationship the agent has built. It is a file it has kept — and a file you cannot open is a file that can be wrong about you forever.

— Dispatches · Summit Cognitive