Cloudflare CEO says the web's future is "pay to crawl" as bots overtake human traffic
Bot traffic now outpaces human traffic on the internet, Cloudflare CEO Matthew Prince says, years ahead of his late 2027 forecast. He blames AI agents for the surge. His conclusion for the future of the web: "Clearly it's going to be pay to crawl."<br /> The article Cloudflare CEO says the web's future is "pay to crawl" as bots overtake human traffic appeared first on The Decoder. [...]
Rating
Innovation
Pricing
Technology
Usability
We have discovered similar tools to what you are looking for. Check out our suggestions for similar AI tools.
Cloudflare’s new Dynamic Workers ditch containers to run AI agent code 100x faster
Web infrastructure giant Cloudlflare is seeking to transform the way enterprises deploy AI agents with the open beta release of Dynamic Workers, a new lightweight, isolate-based sandboxing system that [...]
Perplexity is allegedly scraping websites it's not supposed to, again
Web crawlers deployed by Perplexity to scrape websites are allegedly skirting restrictions, according to a new report from Cloudflare. Specifically, the report claims that the company's bots appe [...]
Cloudflare experiment will block AI bot scrapers unless they pay a fee
Cloudflare has rolled out a couple of new measures meant to keep AI bot crawlers at bay. To start with, every new domain customer that signs up with the company to manage their website traffic will no [...]
Cloudflare CEO says people aren't checking AI chatbots' source links
Companies that develop generative AI always make it a point to say that they include links to websites in the answers that their chatbots generate for users. But Cloudflare CEO Matthew Prince has reve [...]
Upwork study shows AI agents excel with human partners but fail independently
Artificial intelligence agents powered by the world's most advanced language models routinely fail to complete even straightforward professional tasks on their own, according to groundbreaking re [...]
How to test OpenClaw without giving an autonomous agent shell access to your corporate laptop
Your developers are already running OpenClaw at home. Censys tracked the open-source AI agent from roughly 1,000 instances to over 21,000 publicly exposed deployments in under a week. Bitdefender’s [...]
The web is now mostly bots. Cloudflare is rebuilding its defences around that
For the first time, bots generate more than half of all web traffic. Cloudflare Precursor, the company’s new tool, stops checking IDs at the door and starts watching how visitors behave once they ar [...]