Let’s talk about the stamp the machine just got — and why it proves a lot less than it looks like it proves.
Thirteen days ago, the main body of the EU AI Act went live. And buried in that law is a detail almost nobody covered. From the second of August, high-risk AI systems can’t be placed on the market without a conformity assessment. And the ones that pass get the same mark your toaster has. The CE mark.
The machine that decides about you just got a quality stamp. That’s the headline. Here’s the part nobody is saying out loud.
For most of the systems that actually touch your life — the ones that screen your job application, price your credit, rate your insurance, rank your housing application — the conformity assessment is done by the company that built them. Internal control, the law calls it. Which is a polite legal way of saying: the builder tested itself, and passed.
Only a narrow slice of high-risk systems — the biometric identification ones — have to bring in an outside assessor. The rest get to grade their own homework and then print the sticker.
Picture the human scene. A hospital procurement committee, or a small bank. A vendor slides a sleek AI tool across the table. It screens scans, it scores loans, whatever. And somewhere in the deck, there it is: CE marked. Approved. The committee relaxes. The stamp just did the thinking for them.
Nobody asks who did the assessing. Nobody asks against what data. Because the stamp looks like an authority. It was designed to.
And that’s the trap. The CE mark was born in a world of physical products — toasters, machines, medical devices — where a thing gets tested once against a fixed standard and then stays that thing. An AI system is not a toaster. It doesn’t hold still. It changes when it’s updated, when it’s fine-tuned, when it meets new data. The assessment is a snapshot. The system keeps living.
Here’s another detail people are missing. For pure software — which is what most of these systems are — the CE mark doesn’t even go on the product. The law says it goes on the packaging, or the documentation. So the stamp of approval for the machine that decides your credit lives on a PDF.
Now add the grandfather clause. The systems already running before the second of August don’t need the stamp until 2027. So the machines that have been deciding your life the longest are exactly the ones without it. The new ones get the sticker. The old ones get a pass.
So what do we actually have? The most consequential machines in the economy are walking around with a mark that looks like independent proof and is, for most of them, a self-declaration. The stamp is not the problem. The trust we hand it is.
Because the moment a sticker becomes shorthand for “this machine is fine,” the sticker becomes the attack surface. We’ve seen this for decades with physical goods — counterfeit CE marks on everything from electronics to medical gear. The digital version is worse. A fake certificate is just metadata. And in an economy where a stamp opens doors, the stamp is the first thing that gets forged.
So here’s the operator lesson, and it applies to anyone buying AI in the next year. When a vendor says “it’s certified,” ask three questions. Who certified it — an independent body, or the company itself? Against what data, and what standard? And who watches it after the sale, because the model will change and the stamp won’t be reissued?
If the answer to the first question is “internal control,” you haven’t bought proof. You’ve bought a declaration. Fine as a floor. Useless as a verdict.
The principle underneath is old, and it survived every technology that tried to replace it. Proof cannot be delegated to a sticker. Somebody has to actually look.
The law gave the machine a stamp. It did not give you permission to stop paying attention. Somewhere right now, a committee is relaxing because a PDF said approved.
Be the one who asks who wrote it. What they checked. What happens when it changes. The stamp is a floor. The looking is the point.