Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers
Description
Large language models have reportedly hallucinated non-existent software package names, some of which were subsequently uploaded to public repositories and incorporated into real codebases. In one case, a package named huggingface-cli, which was purported to have been originally suggested by an AI model, was downloaded more than 15,000 times. This dynamic enables what security researchers have termed "slopsquatting," in which attackers register hallucinated package names and introduce potential malware into software supply chains.
Actors
Alleged Deployers
- developers-using-ai-generated-suggestions
- bar-lanyado
Alleged Developers
- openai
- meta
- deepseek-ai
- cohere
- bigscience
Harmed Parties
- users-downstream-of-software-contaminated-by-hallucinated-packages
- trust-in-open-source-repositories-and-ai-assisted-coding-tools
- software-ecosystems
- organizations-that-incorporated-fake-dependencies
- developers-and-businesses-incorporating-ai-suggested-packages
- alibaba
Classification
Risk Domain
MisinformationRisk Subdomain
3.1. False or misleading information
MIT Risk Profile
Source
Related Incidents (Misinformation)
View all →Research Papers on This Topic
Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvature
Why Language Models Hallucinate
CIFAKE: Image Classification and Explainable Identification of AI-Generated Synthetic Images
Degenerate Feedback Loops in Recommender Systems