Priced by a model you cannot see

You open the app to book the flight you looked at yesterday, and the fare has moved. You refresh, and it moves again. You cannot tell whether the seat is scarcer, the day is busier, or something about you has been reconsidered. The number on the screen presents itself the way numbers always do — flatly, as a fact — and you either pay it or you don't. What you never see is the small deliberation that produced it: a model that took what it knows about you and returned the figure it expects you, in particular, to accept. You are not looking at the price of the flight. You are looking at the price of being you, to them, today.

This is the quiet strangeness of personalized pricing, and it is worth naming precisely because it is engineered to go unnoticed. A price feels like a property of the good — the cost of the thing, the same for everyone, a fact about the world you can take or leave. A personalized price is nothing of the kind. It is a property of the seller's model of you: your inferred willingness to pay, your estimated risk, your probability of walking away, your likelihood of coming back later and paying more. Those are judgments about a person. And when a judgment about a person determines what happens to that person, we usually call it a decision, and we attach obligations to it. Here the obligations quietly fall away, because the whole transaction has been dressed as commerce rather than judgment.

The verdict wearing a price tag

Consider what the number actually encodes. To set the rate on a loan, a model forms a view of your risk. To set a premium, it forms a view of your exposure. To set a fare, a ride, a subscription, a retention offer, it forms a view of how much you will bear before you balk. Each of these is a verdict — an assessment of you, arrived at by a process, resting on inputs you did not choose and cannot inspect. But the verdict is never delivered as a verdict. It is delivered as a price, and a price asks nothing of you except a yes or a no. You experience a cost where a decision occurred. The judgment has been laundered through the most ordinary object in commercial life.

The receiving end of this is peculiar. When a bank denies you a loan, the denial is at least an event — it announces itself, it invites the question why, it triggers, in many systems, a duty to give a reason. A personalized price triggers none of that machinery, because from the outside it does not look like anything happened to you at all. You were quoted a number. Numbers are not adverse actions. And so the assessment that produced it — which may turn on far more about you than a denial ever would — arrives with less accountability than the denial, not more. The more consequential framing hides inside the less consequential one.

A denial at least admits it is a decision. A personalized price is a verdict that has learned to pass for the weather.

Invisible by design

The deeper problem is not that the price is personalized. It is that you cannot know it was. You are shown one number. You never see the numbers others were shown, so you have no counterfactual — no way to notice that the person beside you was quoted something else, or that you yesterday were quoted something else. There is no notice that a model ran. There is no line that reads this offer was set for you specifically. And without that notice, the standing to object never even arises, because objection requires knowing there is something to object to. You cannot appeal an assessment you were never told occurred. You cannot contest a judgment you cannot see was made.

This is a stranger kind of opacity than a bad decision. A bad denial is at least a denial: it has a shape, a moment, a surface you can push against. A personalized price is structurally hidden in a way even an unjust refusal is not, because it declines to present as a decision. The refusal says, at minimum, I have decided against you. The price says only, this is what it costs. One admits it is a verdict and can therefore be argued with. The other conceals that a verdict exists, and in doing so forecloses the argument before it can begin. The harm is not merely that you might be treated unfairly; it is that the ordinary route to noticing unfairness has been designed out of the encounter.

None of this depends on the model being wrong, or malicious, or even inaccurate. It could be perfectly calibrated and the objection would stand, because the objection is not about the quality of the assessment. It is about the fact that a consequential judgment about a person is being made and withheld at the same time — assessed and unannounced, decided and undisclosed. Accuracy is a virtue of the model. What the person on the receiving end lacks is not a better model. It is any acknowledgment that a decision about them happened at all.

What the receiving end is owed

The remedy is not a ban on personalization. Prices have always varied — by time, by volume, by channel — and much of that variation is benign and useful. The argument is narrower and, I think, harder to refuse: a price set by a judgment about you is an adverse decision when it goes against you, and it should carry an adverse decision's obligations. Three of them, at the minimum the current framing denies. First, notice — that a personalized decision was made, so the person at least knows an assessment occurred and is not left mistaking a verdict for the neutral cost of a thing. Second, the kind of factors that drove it, rendered in a form the person can actually act on rather than a legal recitation that changes nothing. Third, a way to contest the price the way one could contest any other decision that went against them — a channel, a human, a reconsideration.

This is the standing move the series keeps returning to. Contestability is not a courtesy you extend to people who complain; it is a property a decision either has or lacks, and a decision built to be invisible has deliberately been built to lack it. A Decision Receipt for a price would carry the same things a receipt for any adverse decision carries: notice that a decision was made, the provenance of what it rested on, and enough of an account that the person could bring their own facts to bear against it. The point is not to make personalization impossible. It is to make it answerable — to drag the verdict back out of the disguise and let it stand as what it is.

Because the alternative is a world in which the most intimate decisions made about you arrive as the most anonymous objects imaginable, and you spend your life paying verdicts you were never told were being handed down. A price is a fine thing to be shown. A judgment about you is a fine thing to be told. What the receiving end is owed is simply the difference between the two — the small, dignifying admission that when the number was set for you specifically, a decision about you was made, and you are the party it was made about.

— Dispatches · Summit Cognitive