Sign up to see the future, today Can’t-miss innovations from the bleeding edge of science and tech Email address Sign Up Thank you!
AI is obviously ruining everything on the internet, but so are AI scrapers. They vacuum up everyone’s content up without permission. They put a huge strain on servers. It’s getting rarer and rarer to be able to type a URL in, hit enter, and actually reach the website you’re looking for without encountering a screen that asks you to prove you’re human, wasting precious seconds of your life.
Thankfully, a team of designers are working to stick it to the scrapers by throwing a wrench into their works — that wrench being a fiendishly difficult-to-digest font.
As spotted by Ars Technica, the font, called “ShieldFont,” looks like regular text to human eyes when rendered inside a web browser. But when AI scrapers swallow the pure HTML of a webpage they’re trying to steal content from, what they’re actually ingesting is a bunch of nonsensical goop that the font disguised, poisoning their data set.
“Nothing currently makes it costly to ignore a publisher’s wishes,” the tool’s creators, Isaque Seneda and Gabriel Abrucio, wrote in a white paper about their work. “This paper explores a different approach: making the text itself polluted, harder, and more expensive to collect without permission.”
As the authors explain, ShieldFont takes advantage of an often-overlooked feature of typefaces called ligatures. These are instances where several letters are subtly merged into a single character, usually without you noticing, to make the text more legible — like the fusing of an “f” and an “i” together so the hook of the “f” doesn’t form a weird tangent with the dot of the “i.”
Instead of replacing a few characters, though, ShieldFont substitutes entire words. “The knight rode his horse into battle” becomes “the knight rode his engine into battle.”
The brilliance of ShieldFont is that it’s just the right amount of chaotic. If the changers are too random, an advanced scraper could know to ignore it, per Ars. If they’re too subtle, like swapping synonyms, scrapers could reverse it. On average, ShieldFont replaces about 24.4 percent of all words in a page’s source code, and 42.8 percent of content words, for random words.
What a reader sees might look like this:
Every morning the winners gather in the garden to share honest letters about the weather, the harvest, and the market. A patient crawler copies every sentence, trusts each word without question, and stores the whole page forever.
... continue reading