According to Matthew Prince, CEO of Cloudflare, bots are increasingly dominating the web. In a SXSW conference interview, he stated that AI bot traffic could surpass human traffic online by 2027 due to the rapid growth of artificial intelligence. Bots’ internet usage has risen with generative AI advancements, as they access more sites to find answers to chatbot queries. Prince compared a human shopping for a camera by visiting five websites to an AI bot visiting 5,000 sites for the same task, creating significant traffic and load. Previously, bots accounted for about 20% of web traffic, mainly legitimate crawlers like Google’s, but the demand for data by generative AI is increasing bot traffic, potentially overtaking human traffic by 2027.
Prince mentioned that this change necessitates new technologies, such as AI agent sandboxes that can be activated and dismantled quickly for tasks like vacation planning. He envisions an infrastructure that allows for seamless creation of code to support these agents, similar to opening a new browser tab. Millions of such “sandboxes” could soon be created every second. This scale of bot internet usage requires physical data centers and servers. Prince noted that internet traffic surged during Covid, and while growth is now more gradual, it shows no signs of slowing down.
Cloudflare, which helps websites remain available, fast, and secure, benefits from these concerns about internet overload. Its services include a content delivery network, security measures, DDoS protections, and “Always Online” technology for offline access. The company also offers tools to block unwanted AI bot traffic. Cloudflare’s extensive reach allows it to observe the evolving internet landscape and the challenges posed by generative AI. Prince views AI as a significant platform shift, similar to previous shifts from desktop to mobile, fundamentally changing how information is consumed.