Skip to content
Tech News
← Back to articles

I Test-Drove Substack’s New AI Detection Tool, and It Mostly Worked

read original more articles
Why This Matters

Substack's new AI detection tool, Pangram, aims to increase transparency and trust by helping readers identify AI-generated content. This development is significant as AI-generated content continues to proliferate online, raising concerns about authenticity and authorship. By empowering both creators and consumers with detection capabilities, it fosters a more transparent digital environment for the tech industry and users alike.

Key Takeaways

More and more, we want to know: Is it human, or is it AI? Is that image real? That song? That video? The publishing platform Substack is trying to add some clarity by partnering with the AI detector Pangram to help readers understand just how much AI is in all the content they consume on the publishing platform.

The tool is available to all Substack subscribers and works on posts, notes, comments and replies published on or after Tuesday that are longer than 100 words. Creators will also be able to scan their drafts with Pangram to see how much AI is detected and can also provide a statement to explain their writing process, Substack said.

Web and iOS users can try the Pangram features now, and Android users will get access later.

In a blog post announcing the new feature, Substack co-founder and CEO Chris Best said his platform aims to avoid “Claudefishing,” meaning when a reader consumes content without realizing it was generated by AI.

“When readers have to wonder if what they’re reading is real, it undermines trust in authorship and threatens the livelihood of writers — including those who use AI tools thoughtfully to produce work they believe in,” Best wrote.

From CNET: AI Slop Is Destroying the Internet. These Are the People Fighting to Save It

Pangram estimates that roughly 40% of text on some social media platforms is AI-generated, with a stunning two-thirds of that on the networking site LinkedIn. And AI growth agency Graphite recently published a white paper saying that AI is now writing as many online articles as humans. A Gartner survey found that 68% of people wonder if the content they see is real, and that half of consumers prefer brands that aren’t using AI in their marketing.

Testing it for myself

I’ve only recently joined Substack, but I wanted to check out the new Pangram AI detection tool. The tool works on posts, notes, comments and replies, so I decided to use posts as my makeshift testing lab. First, I logged in to my Substack account and published a new post. I copied and pasted text from an article I had written — by myself, no AI — into the Substack post and published it.

After a few minutes, I clicked on the live post. On the three-dot menu at the upper right of the page, I saw a “Scan for AI text” option. I clicked on it, and a small window popped up accurately declaring that my article was “Fully Human-Written.” A line appears below this that indicates the percentage of the text that is AI, AI-assisted, or human.

... continue reading