GoKawiilBots are taking over the web, according to Cloudflare CEO Matthew Prince. In an interview at the SXSW conference in Austin this week, he said that with the speed at which artificial intelligence is growing, AI bot traffic will exceed the amount of human traffic that’s online by 2027.
Prince explained that bots’ web usage has been increasing alongside the growth of generative AI technology because bots are capable of visiting far more sites to get answers for users’ chatbot queries.
“If a human were doing a task — let’s say you were shopping for a digital camera — and you might go to five websites. Your agent or the bot that’s doing that will often go to 1,000 times the number of sites that an actual human would visit,” Prince said. “So it might go to 5,000 sites. And that’s real traffic, and that’s real load, which everyone is having to deal with and take into account.”
Before the generative AI era, the internet was only about 20% bot traffic, with Google’s web crawler being the largest, according to Prince, whose infrastructure and security company is used by one-fifth of all websites. But beyond some other reputable crawlers, the only other bots were those used by scammers and bad actors.
“With the rise of generative AI, and its just insatiable need for data, we’re seeing a rise where we suspect that, in 2027, the amount of bot traffic online will exceed the amount of human traffic that’s online,” Prince said.
The executive also noted that this change to the web would require the development of new technologies, like sandboxes for AI agents that can be spun up on the fly and then torn down when their task has finished. These could come into play when consumers ask AI agents to perform certain tasks on their behalf, like planning a vacation.
“What we’re trying to think about is, how do we actually build that underlying infrastructure where you can — as easily as you open a new tab in your browser — you can actually spin up new code, which can then run and service the agents that are out there,” Prince said.
Techcrunch event Disrupt 2026: The tech ecosystem, all in one room Your next round. Your next hire. Your next breakout opportunity. Find it at TechCrunch Disrupt 2026, where 10,000+ founders, investors, and tech leaders gather for three days of 250+ tactical sessions, powerful introductions, and market-defining innovation. Register now to save up to $400. Save up to $300 or 30% to TechCrunch Founder Summit 1,000+ founders and investors come together at TechCrunch Founder Summit 2026 for a full day focused on growth, execution, and real-world scaling. Learn from founders and investors who have shaped the industry. Connect with peers navigating similar growth stages. Walk away with tactics you can apply immediately
Offer ends March 13. San Francisco, CA | REGISTER NOW
... continue reading