Let’s talk about the worst day of your life — and why the machine that logged it will never let you live it down.
Think about the person you were five years ago. Not the version you’d choose to show anyone. The version that made the mistake, said the wrong thing, missed the deadline, broke the promise. The version you’d rather forget.
Here’s the thing about human judgment. If a friend, a colleague, a landlord, a bank manager actually met you back then, and then met you again today, they could revise. They’d watch you for six months. They’d see the change. They’d say, people grow, and they’d mean it. Human beings are the only machines on earth that can be wrong about someone and then be corrected by the evidence of who that person became.
That capacity — to revise a judgment about a person — is one of the most human things we do. It’s the entire basis of forgiveness. Of second chances. Of redemption actually meaning something in the real world instead of just in sermons.
The algorithm doesn’t do any of that.
The score that was written about you on your worst day doesn’t age. It doesn’t watch you change. It doesn’t get embarrassed about how wrong it was. It just sits there, in the file, as a variable — and every decision the machine makes about you from that day forward is computed against it.
Here is the detail most people never see, because it’s buried in how the systems actually work. Your current score isn’t your current behavior weighted fairly. It’s your entire recorded history, with the old data weighted in. The mistake from four years ago doesn’t get retired because you fixed it. It gets reinforced, because the machine sees the mistake and your subsequent correction and concludes, correctly, that people who make this kind of mistake tend to make it again. It’s not evil. It’s worse than evil. It’s statistically reasonable about the wrong thing.
So the person who got sober, or paid off the debt, or rebuilt the reputation, or left the bad job — that person’s improvement is real, and the machine has no category for it. It has a category for your history and a category for your current state, and it weights the history so heavily that the current state barely moves the number.
And here’s the cruelest part. A human judge can be persuaded. You can sit across from a person, explain yourself, show them what changed, and move them. That’s the whole point of a meeting, a reference, a conversation. The person can change their mind about you.
The algorithm can’t be persuaded. There’s no meeting. There’s no reference. There’s no “let me show you who I am now.” There’s just the score, computed from the file, applied silently to your loan, your rental application, your hiring screen, your insurance premium. You can’t argue with it because there’s nobody there to argue with.
That’s the part people miss about all this. We keep hearing about data brokers and invisible scores and algorithmic reputation, and we treat it like a surveillance problem. It’s not really a surveillance problem. Surveillance is about the machine watching you now. This is about the machine remembering the worst version of you forever, and refusing to be corrected.
A human judgment that’s frozen in time is a bias. A machine judgment that’s frozen in time is a score. And we’ve built an entire economy on the second one.
The quiet tragedy is that we built it in the name of fairness. The whole pitch of the scoring system was that it would be more objective than a biased human. No gut feelings. No first impressions. No prejudice. Just the data. And the data is just your history, mechanically weighted, with no mercy and no possibility of growth. We traded a judge who could be biased against you for a judge who could never be persuaded to change its mind.
Somewhere along the way we confused “objective” with “final.” And the difference between those two words is the whole difference between being judged and being sentenced.
Think about what this does to a person. If the machine never revises, then the rational move is to never risk anything. Don’t try the new thing, because failure gets logged and the log never expires. Don’t change careers, don’t start the business, don’t leave the bad situation, because every stumble along the way becomes a permanent scar on a score you can’t see and can’t argue with. The machine that never forgives teaches the human that change is pointless. And that is how you get a population that stops trying.
The scary part is, this isn’t some far-off scenario. The scaffolds are already there. Every correction you make to a model trains it. Every decision a risk model makes about you is retained as evidence. The systems don’t just score you — they remember being right about you, and they have no mechanism for being shown they were wrong.
So here’s the principle I think has to survive all of this. It’s not the right to be forgotten. Deletion is a favor someone can refuse. It’s the right to be revised. The right to have your past counted as what it is — past — and to have your present given a fair shot at changing the number. The right to argue with the score. The right to meet the judge.
Because a system that can score you but can’t be argued with isn’t a system that evaluates people. It’s a system that freezes them. And a society that freezes people at their worst moment has quietly given up on the entire idea that people can change.
That idea — that a person can become something better than their history — is maybe the most hopeful thing a society can believe. And we are building, right now, a layer of infrastructure that has decided not to believe it at all.
The machine remembers everything and forgives nothing. If we let that stand, we don’t just lose our privacy. We lose the one thing that makes a mistake survivable — the knowledge that it doesn’t have to be the last word on who we are.
Because you are not your worst day. But you will be, unless we make the machine learn to change its mind.