<
AI
Automation
Science
Innovation
Open Source
Blockchain
Social Media
Startups
Culture
Cloud
>

Destination
Wikipedia is struggling with voracious AI bot crawlers

Wikimedia has seen a 50 percent increase in bandwidth used for downloading multimedia content since January 2024, the foundation said in an update. But it's not because human readers have suddenly developed a voracious appetite for consuming Wikipedia articles and for watching videos or downloading files from Wikimedia Commons. No, the spike in usage came from AI crawlers, or automated programs scraping Wikimedia's openly licensed images, videos, articles and other files to train generative artificial intelligence models. <br /> This sudden increase in traffic from bots could slow down access to Wikimedia's pages and assets, especially during high-interest events. When Jimmy Carter died in December, for instance, people's heightened interest in the video of his p [...]

Discover Copy
Rating

Innovation

Pricing

Technology

Usability

We have discovered similar tools to what you are looking for. Check out our suggestions for similar AI tools.

Destination
Wikipedia cancels plan to test AI summaries after editors skewer the idea

Wikipedia is backing off a plan to test AI article summaries. Earlier this month, the platform announced plans to trial the feature for about 10 percent of mobile web visitors. To say they weren' [...]

Match Score: 98.85

Destination
Cloudflare experiment will block AI bot scrapers unless they pay a fee

Cloudflare has rolled out a couple of new measures meant to keep AI bot crawlers at bay. To start with, every new domain customer that signs up with the company to manage their website traffic will no [...]

Match Score: 91.13

Destination
Wikimedia says AI bots and summaries are hurting Wikipedia's traffic

Wikimedia is sounding the alarm on the impact AI is having on reliable knowledge and information on the internet. In a blog post, Wikimedia's senior director of product, Marshall Miller, lays out [...]

Match Score: 88.16

Destination
Wikipedia offers AI developers a training dataset to maybe get scraper bots off its back

Wikipedia has been struggling with the impact that AI crawlers — bots that are scraping text and multimedia from the encyclopedia to train generative artificial intelligence models — have been hav [...]

Match Score: 86.17

Destination
Vampire Survivors spinoff Vampire Crawlers is coming to PC and consoles on April 21

Poncle could be about to ruin the planet’s productivity all over again now that Vampire Crawlers has a release date for PC and consoles. The dungeon-crawling roguelike deckbuilder — which is a Vam [...]

Match Score: 70.16

Destination
Wikipedia has banned AI-generated articles

English Wikipedia has banned the use of generative AI when writing or rewriting articles. The platform says it came to this decision because using AI to whip up copy "often violates several of Wi [...]

Match Score: 64.25

Destination
Why the Open Web Is at Risk in the Age of AI Crawlers

The Internet has always been a space for free expression, collaboration, and the open exchange of ideas. However, with persistent advances in artificial intelligence (AI), AI-powered web crawlers have [...]

Match Score: 61.39

Destination
Wikipedia pauses AI summaries after editors skewer the idea

Wikipedia is backing off AI article summaries… for now. Earlier this month, the platform trialed the feature in its mobile app. To say they weren't well-received by editors would be an understa [...]

Match Score: 59.31

Destination
A developer turned Wikipedia into a social media-style feed

While it's important to stay informed about what's going on in the world, endlessly scrolling through your social media feeds and absorbing what's likely to be a largely negative influx [...]

Match Score: 54.37