GoKawiilPublishers won’t win AI by hiding from it. They’ll win by controlling access to the work that gives them authority. Media companies have gotten pretty good at blocking AI bots. They have been less good at deciding which ones should be allowed in. Reports say most major publications almost universally block crawlers from major AI companies like OpenAI and Anthropic, and many small to midsize publishers mirror that, configuring their robots exclusion protocol settings, or robots.txt, to keep them out.
Don’t block the bots. Build the gate
Why This Matters
This article highlights the importance for media publishers to strategically manage AI access rather than outright blocking bots, emphasizing control over their content to maintain authority and relevance in the evolving AI landscape. It underscores the need for a balanced approach that benefits both publishers and AI development. For the tech industry and consumers, this signals a shift towards more collaborative content ecosystems and responsible AI integration.
Key Takeaways
- Publishers should focus on controlling access to their content rather than blocking AI bots entirely.
- Managing AI access can help maintain publisher authority and influence in the digital landscape.
- A collaborative approach to AI and content access benefits both media companies and AI developers.
Get alerts for these topics