This article was written by an actual, flesh-and-blood human -- me -- but an increasing amount of the text and video content you come across online is not. It's coming from generative AI tools, which have gotten pretty good at creating realistic-sounding text and natural-looking video. So, how do you sort out the human-made from the robotic?
The answer is more complicated than that urban legend about the overuse of em-dashes would have you believe. Lots of people write with an (over)abundance of that particular piece of punctuation, as any editor will tell you. The clues may have more to do with the phrasing and the fact that, as with any writer, large language models tend to repeat themselves.
That's the logic behind AI-detection programs. The problem is that those systems are often AI-powered themselves, and they provide few details about how they arrived at their assessments. That makes them hard to trust.
A new feature from the AI-detection company Copyleaks, called AI Logic, provides more insight into not just whether and how much of something might have been written by AI, but what evidence it's basing that decision on. What results is something that looks a lot like a plagiarism detector, with individual passages highlighted. You can then see whether Copyleaks flagged it because it matched text on a website known to be AI-generated, or if it was a phrase that the company's research has determined is far more likely to appear in AI-produced than human-written text.
You don't even necessarily have to seek out a gen AI tool to produce text with one these days. Tech companies like Microsoft and Google are adding AI helpers to workplace apps, but it's even showing up in dating apps. A survey from the Kinsey Institute and Match, which owns Tinder and Hinge, found that 26% of singles were using AI in dating, whether it's to punch up profiles or come up with better lines. AI writing is inescapable, and there are times when you probably want to know whether a person actually wrote what you're reading.
This additional information from a Copyleaks-checked text marks a step forward in the search for a way to separate the AI-made from the human-written, but the important element still isn't the software. It takes a human being to look at this data and figure out what's a coincidence and what's concerning.
"The idea is really to get to a point where there is no question mark, to provide as much evidence as we can," Copyleaks CEO Alon Yamin told me.
A noble sentiment, but I also wanted to see for myself what the AI detector would detect and why.
How AI detection works
Copyleaks started out by using AI models to identify specific writing styles as a way to detect copyright infringement. When OpenAI's ChatGPT burst on the scene in 2022, the company realized it could use the same models to detect the style of large language models. Yamin called it "AI versus AI," in that models were trained to look for specific factors like the length of sentences, punctuation usage and specific phrases. (Disclosure: Ziff Davis, CNET's parent company, in April filed a lawsuit against OpenAI, alleging it infringed Ziff Davis copyrights in training and operating its AI systems.)
... continue reading