LLM Scrapers Allegedly Target Multiple Open Source Projects Disrupting the FOSS Ecosystem
Description
In mid-March 2025, KDE's GitLab infrastructure was reportedly disrupted by aggressive AI web scrapers originating from Alibaba IP ranges. These bots allegedly ignored robots.txt and spoofed browser headers, which in turn purportedly overwhelmed the site and caused outages for developers. Similar incidents reportedly affected other FOSS projects like GNOME, SourceHut, and Fedora. The scraping is allegedly tied to large language model training, and reportedly imposes real costs and delays.
Actors
Alleged Deployers
- alibaba
- generative-ai-developers
Alleged Developers
- alibaba
- generative-ai-developers
Harmed Parties
- sysadmins
- sourcehut
- read-the-docs
- linux-weekly-news
- kde
- inkscape
- gnome
- foss-projects-and-communities
- fedora
- diaspora
- curl
Classification
Risk Domain
Socioeconomic & EnvironmentalRisk Subdomain
6.1. Power centralization and unfair distribution of benefits
MIT Risk Profile
Topics
Source
Related Incidents (Socioeconomic & Environmental)
View all →OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
Feb 2026
RealPage Algorithm Allegedly Inflates Rents and Reduces Competition in Housing Market
Sep 2016
Kronos Scheduling Algorithm Allegedly Caused Financial Issues for Starbucks Employees
Research Papers on This Topic
View all →Long-Term Trends in the Public Perception of Artificial Intelligence
Reduced, Reused and Recycled: The Life of a Dataset in Machine Learning Research
Artificial Intelligence Index Report 2025
Ethical Considerations in Artificial Intelligence Courses
Mitigation Tools
Tools related to this risk domain, via shared responsible AI topics.
Open Source
View all →AIF360
Trusted-AI/AIF360
A comprehensive set of fairness metrics for datasets and machine learning models, explanations for these metrics, and algorithms to mitigate bias in datasets and models.
⭐ 2,872
fairlearn
fairlearn/fairlearn
A Python package to assess and improve fairness of machine learning models.
⭐ 2,199
responsible-ai-toolbox
microsoft/responsible-ai-toolbox
Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower developers and stakeholders of AI systems to develop and monitor AI more responsibly, and take better data-driven actions.