Let’s talk about the week the machine became legally required to say it’s a machine.
There is this moment that happens on every phone in the world now. An unknown number calls. You answer. The voice on the other end is warm, a little rushed, completely natural — and it is not a person. It has never been a person. Most people only find out when it’s too late. Or never.
That call is the oldest con on the internet, wearing a perfect voice. And until this month, the machine was under no obligation to tell you it was a machine.
That changed on the second of August, in the European Union. The main body of the AI Act went live — the part everyone covered when it came to hiring, credit, and policing. But buried in the same activation was the section almost nobody talked about: the transparency obligations. Article 50.
From that day, a chatbot that talks to you has to tell you it’s a chatbot. A deepfake of a real person has to be labelled as artificially generated. AI-generated text that informs the public on matters of public interest has to carry a marker that says: this was not written by a human.
Think about what that means. The machine has been pretending to be human since the first phone tree. Now, in one economy of four hundred and fifty million people, pretending is a legal problem. The mask is no longer just creepy. It’s a compliance breach.
Now here’s what people are missing.
The obligation doesn’t sit where you think it does. The label is the deployer’s job — the person or company that puts the deepfake out, not the lab that built the model. That sounds like a detail. It’s actually the whole game. The company that makes the perfect voice is mostly off the hook. The person who uses it without a label is on it.
Which means the first year of this law is going to be a war about stripping. Labels are metadata. Metadata can be removed, cropped, re-encoded, laundered through a screen recording — and the deepfake that comes out the other side is unlabelled and legally clean, because the label was never part of the picture itself.
The law labels the container, not the content. It obliges you to announce — it doesn’t make it impossible to fake the announcement. That is exactly why the provenance people keep saying the fix has to live at the moment of creation: in the camera, in the recorder, in the signing of the artifact. Not in the paragraph someone adds later.
And there’s the second thing people are missing: the exceptions. Law enforcement gets a carve-out. Journalism gets room to work. Fine. But every carve-out becomes a doorway, and doorways get walked through. The first fights over this law won’t be about deepfakes of politicians. They’ll be about the boundary cases — which machine was obviously a machine, which label was sufficient, which disclosure was not reasonably possible.
But stand back, because the deeper thing is bigger than the law.
For the first time in a major economy, the default has flipped. It used to be: a voice is a person until proven otherwise. Now a synthetic voice has to identify itself, and the burden of proof has moved from the listener to the machine. That inversion is the story. It’s the first time the law has said: the machine is the suspect, not the human.
That principle is what we keep trying to build everywhere else. Suspicion does not scale. Proof has to. A label is a weak version of proof — but it’s the first version with the force of law behind it. You cannot consent to a machine that won’t say it’s a machine. Disclosure is the floor of consent. And this week, somewhere in Europe, the floor was poured.
So here’s the operator question. If you build anything with synthetic voice or video — a demo, a customer bot, a marketing clip — the honest move is to label it before any law makes you. Not because the regulator is watching. Because the label is becoming a trust signal, and trust is becoming the scarce resource. The companies that label first will look like the ones with nothing to hide. The ones that fight the label will look like they have everything to hide.
And for the rest of us, the moment is simpler. The next time a warm voice answers your call, you get to ask the question the law just made official: are you a person?
If it hesitates, hang up. The machine has been pretending for years. It can finally tell the truth — or it can keep lying, and the lying now costs more than it ever did.
You’ve got this. And from this week on, the machine has to introduce itself first.