Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Entities

Alibaba

Incidents involved as both Developer and Deployer

Incident 11865 Report
Reported Public Exposure of Over 100,000 LLM Conversations via Share Links Indexed by Search Engines and Archived

2025-07-31

Across 2024 and 2025, the share features in multiple LLM platforms, including ChatGPT, Claude, Copilot, Qwen, Mistral, and Grok, allegedly exposed user conversations marked "discoverable" to search engines and archiving services. Over 100,000 chats were reportedly indexed and later scraped, purportedly revealing API keys, access tokens, personal identifiers, and sensitive business data.

More

Incident 10012 Report
LLM Scrapers Allegedly Target Multiple Open Source Projects Disrupting the FOSS Ecosystem

2025-03-17

In mid-March 2025, KDE's GitLab infrastructure was reportedly disrupted by aggressive AI web scrapers originating from Alibaba IP ranges. These bots allegedly ignored robots.txt and spoofed browser headers, which in turn purportedly overwhelmed the site and caused outages for developers. Similar incidents reportedly affected other FOSS projects like GNOME, SourceHut, and Fedora. The scraping is allegedly tied to large language model training, and reportedly imposes real costs and delays.

More

Incidents Harmed By

Incident 7314 Report
Hallucinated Software Packages with Potential Malware Downloaded Thousands of Times by Developers

2023-12-01

Large language models are reportedly hallucinating software package names, some of which are uploaded to public repositories and integrated into real code. One such package, huggingface-cli, was downloaded over 15,000 times. This behavior enables "slopsquatting," a term coined by Seth Michael Larson of the Python Software Foundation, where attackers register fake packages under AI-invented names and put supply chains at serious risk.

More

Incidents involved as Developer

Incident 1072 Report
Chinese Tech Firms Allegedly Developed Facial Recognition to Identify People by Race, Targeting Uyghur Muslims

2018-07-20

Various Chinese firms were revealed by patent applications to have developed facial recognition capable of detecting people by race, which critics feared would enable persecution and discrimination of Uyghur Muslims.

More

Related Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
 

Entity

none

Incidents involved as Deployer
  • Incident 107
    2 Reports

    Chinese Tech Firms Allegedly Developed Facial Recognition to Identify People by Race, Targeting Uyghur Muslims

More
Entity

Huawei

Incidents involved as Developer
  • Incident 107
    2 Reports

    Chinese Tech Firms Allegedly Developed Facial Recognition to Identify People by Race, Targeting Uyghur Muslims

More
Entity

Megvii

Incidents involved as Developer
  • Incident 107
    2 Reports

    Chinese Tech Firms Allegedly Developed Facial Recognition to Identify People by Race, Targeting Uyghur Muslims

More
Entity

SenseTime

Incidents involved as Developer
  • Incident 107
    2 Reports

    Chinese Tech Firms Allegedly Developed Facial Recognition to Identify People by Race, Targeting Uyghur Muslims

More
Entity

Baibu

Incidents involved as Developer
  • Incident 107
    2 Reports

    Chinese Tech Firms Allegedly Developed Facial Recognition to Identify People by Race, Targeting Uyghur Muslims

More
Entity

Uyghur people

Incidents Harmed By
  • Incident 107
    2 Reports

    Chinese Tech Firms Allegedly Developed Facial Recognition to Identify People by Race, Targeting Uyghur Muslims

More
Entity

Developers using AI-generated suggestions

Incidents involved as Deployer
  • Incident 731
    4 Reports

    Hallucinated Software Packages with Potential Malware Downloaded Thousands of Times by Developers

More
Entity

Bar Lanyado

Incidents involved as Deployer
  • Incident 731
    4 Reports

    Hallucinated Software Packages with Potential Malware Downloaded Thousands of Times by Developers

More
Entity

OpenAI

Incidents involved as both Developer and Deployer
  • Incident 1186
    5 Reports

    Reported Public Exposure of Over 100,000 LLM Conversations via Share Links Indexed by Search Engines and Archived

Incidents involved as Developer
  • Incident 731
    4 Reports

    Hallucinated Software Packages with Potential Malware Downloaded Thousands of Times by Developers

More
Entity

Google

Incidents involved as Developer
  • Incident 731
    4 Reports

    Hallucinated Software Packages with Potential Malware Downloaded Thousands of Times by Developers

Incidents implicated systems
  • Incident 1186
    5 Reports

    Reported Public Exposure of Over 100,000 LLM Conversations via Share Links Indexed by Search Engines and Archived

More
Entity

Cohere

Incidents involved as Developer
  • Incident 731
    4 Reports

    Hallucinated Software Packages with Potential Malware Downloaded Thousands of Times by Developers

More
Entity

Meta

Incidents involved as Developer
  • Incident 731
    4 Reports

    Hallucinated Software Packages with Potential Malware Downloaded Thousands of Times by Developers

More
Entity

DeepSeek AI

Incidents involved as Developer
  • Incident 731
    4 Reports

    Hallucinated Software Packages with Potential Malware Downloaded Thousands of Times by Developers

More
Entity

BigScience

Incidents involved as Developer
  • Incident 731
    4 Reports

    Hallucinated Software Packages with Potential Malware Downloaded Thousands of Times by Developers

More
Entity

Developers and businesses incorporating AI-suggested packages

Incidents Harmed By
  • Incident 731
    4 Reports

    Hallucinated Software Packages with Potential Malware Downloaded Thousands of Times by Developers

More
Entity

Organizations that incorporated fake dependencies

Incidents Harmed By
  • Incident 731
    4 Reports

    Hallucinated Software Packages with Potential Malware Downloaded Thousands of Times by Developers

More
Entity

Software ecosystems

Incidents Harmed By
  • Incident 731
    4 Reports

    Hallucinated Software Packages with Potential Malware Downloaded Thousands of Times by Developers

More
Entity

Users downstream of software contaminated by hallucinated packages

Incidents Harmed By
  • Incident 731
    4 Reports

    Hallucinated Software Packages with Potential Malware Downloaded Thousands of Times by Developers

More
Entity

Trust in open-source repositories and AI-assisted coding tools

Incidents Harmed By
  • Incident 731
    4 Reports

    Hallucinated Software Packages with Potential Malware Downloaded Thousands of Times by Developers

More
Entity

LLM-powered coding assistants

Incidents implicated systems
  • Incident 731
    4 Reports

    Hallucinated Software Packages with Potential Malware Downloaded Thousands of Times by Developers

More
Entity

ChatGPT 3.5

Incidents implicated systems
  • Incident 731
    4 Reports

    Hallucinated Software Packages with Potential Malware Downloaded Thousands of Times by Developers

More
Entity

ChatGPT 4

Incidents implicated systems
  • Incident 731
    4 Reports

    Hallucinated Software Packages with Potential Malware Downloaded Thousands of Times by Developers

More
Entity

Gemini Pro

Incidents implicated systems
  • Incident 731
    4 Reports

    Hallucinated Software Packages with Potential Malware Downloaded Thousands of Times by Developers

More
Entity

Command

Incidents implicated systems
  • Incident 731
    4 Reports

    Hallucinated Software Packages with Potential Malware Downloaded Thousands of Times by Developers

More
Entity

LLaMA

Incidents implicated systems
  • Incident 731
    4 Reports

    Hallucinated Software Packages with Potential Malware Downloaded Thousands of Times by Developers

More
Entity

CodeLlama

Incidents implicated systems
  • Incident 731
    4 Reports

    Hallucinated Software Packages with Potential Malware Downloaded Thousands of Times by Developers

More
Entity

DeepSeek Coder

Incidents implicated systems
  • Incident 731
    4 Reports

    Hallucinated Software Packages with Potential Malware Downloaded Thousands of Times by Developers

More
Entity

BLOOM

Incidents implicated systems
  • Incident 731
    4 Reports

    Hallucinated Software Packages with Potential Malware Downloaded Thousands of Times by Developers

More
Entity

Python Package Index (PyPI)

Incidents implicated systems
  • Incident 731
    4 Reports

    Hallucinated Software Packages with Potential Malware Downloaded Thousands of Times by Developers

More
Entity

npm (Node.js)

Incidents implicated systems
  • Incident 731
    4 Reports

    Hallucinated Software Packages with Potential Malware Downloaded Thousands of Times by Developers

More
Entity

GitHub

Incidents implicated systems
  • Incident 731
    4 Reports

    Hallucinated Software Packages with Potential Malware Downloaded Thousands of Times by Developers

More
Entity

Google Search / AI Overview

Incidents implicated systems
  • Incident 731
    4 Reports

    Hallucinated Software Packages with Potential Malware Downloaded Thousands of Times by Developers

More
Entity

Unnamed generative AI companies

Incidents involved as both Developer and Deployer
  • Incident 1001
    2 Reports

    LLM Scrapers Allegedly Target Multiple Open Source Projects Disrupting the FOSS Ecosystem

More
Entity

Sysadmins

Incidents Harmed By
  • Incident 1001
    2 Reports

    LLM Scrapers Allegedly Target Multiple Open Source Projects Disrupting the FOSS Ecosystem

More
Entity

SourceHut

Incidents Harmed By
  • Incident 1001
    2 Reports

    LLM Scrapers Allegedly Target Multiple Open Source Projects Disrupting the FOSS Ecosystem

More
Entity

Read the Docs

Incidents Harmed By
  • Incident 1001
    2 Reports

    LLM Scrapers Allegedly Target Multiple Open Source Projects Disrupting the FOSS Ecosystem

More
Entity

Linux Weekly News

Incidents Harmed By
  • Incident 1001
    2 Reports

    LLM Scrapers Allegedly Target Multiple Open Source Projects Disrupting the FOSS Ecosystem

More
Entity

KDE

Incidents Harmed By
  • Incident 1001
    2 Reports

    LLM Scrapers Allegedly Target Multiple Open Source Projects Disrupting the FOSS Ecosystem

Incidents implicated systems
  • Incident 1001
    2 Reports

    LLM Scrapers Allegedly Target Multiple Open Source Projects Disrupting the FOSS Ecosystem

More
Entity

Inkscape

Incidents Harmed By
  • Incident 1001
    2 Reports

    LLM Scrapers Allegedly Target Multiple Open Source Projects Disrupting the FOSS Ecosystem

More
Entity

GNOME

Incidents Harmed By
  • Incident 1001
    2 Reports

    LLM Scrapers Allegedly Target Multiple Open Source Projects Disrupting the FOSS Ecosystem

Incidents implicated systems
  • Incident 1001
    2 Reports

    LLM Scrapers Allegedly Target Multiple Open Source Projects Disrupting the FOSS Ecosystem

More
Entity

FOSS projects and communities

Incidents Harmed By
  • Incident 1001
    2 Reports

    LLM Scrapers Allegedly Target Multiple Open Source Projects Disrupting the FOSS Ecosystem

More
Entity

Fedora

Incidents Harmed By
  • Incident 1001
    2 Reports

    LLM Scrapers Allegedly Target Multiple Open Source Projects Disrupting the FOSS Ecosystem

More
Entity

Diaspora

Incidents Harmed By
  • Incident 1001
    2 Reports

    LLM Scrapers Allegedly Target Multiple Open Source Projects Disrupting the FOSS Ecosystem

More
Entity

Curl

Incidents Harmed By
  • Incident 1001
    2 Reports

    LLM Scrapers Allegedly Target Multiple Open Source Projects Disrupting the FOSS Ecosystem

More
Entity

Websites hosting FOSS documentation or bug trackers

Incidents implicated systems
  • Incident 1001
    2 Reports

    LLM Scrapers Allegedly Target Multiple Open Source Projects Disrupting the FOSS Ecosystem

More
Entity

SourceHut infrastructure

Incidents implicated systems
  • Incident 1001
    2 Reports

    LLM Scrapers Allegedly Target Multiple Open Source Projects Disrupting the FOSS Ecosystem

More
Entity

Pagure.io (Fedora)

Incidents implicated systems
  • Incident 1001
    2 Reports

    LLM Scrapers Allegedly Target Multiple Open Source Projects Disrupting the FOSS Ecosystem

More
Entity

GitLab instances

Incidents implicated systems
  • Incident 1001
    2 Reports

    LLM Scrapers Allegedly Target Multiple Open Source Projects Disrupting the FOSS Ecosystem

More
Entity

Anubis proof-of-work systems

Incidents implicated systems
  • Incident 1001
    2 Reports

    LLM Scrapers Allegedly Target Multiple Open Source Projects Disrupting the FOSS Ecosystem

More
Entity

AI scrapers

Incidents implicated systems
  • Incident 1001
    2 Reports

    LLM Scrapers Allegedly Target Multiple Open Source Projects Disrupting the FOSS Ecosystem

More
Entity

Anthropic

Incidents involved as both Developer and Deployer
  • Incident 1186
    5 Reports

    Reported Public Exposure of Over 100,000 LLM Conversations via Share Links Indexed by Search Engines and Archived

More
Entity

Microsoft

Incidents involved as both Developer and Deployer
  • Incident 1186
    5 Reports

    Reported Public Exposure of Over 100,000 LLM Conversations via Share Links Indexed by Search Engines and Archived

More
Entity

xAI

Incidents involved as both Developer and Deployer
  • Incident 1186
    5 Reports

    Reported Public Exposure of Over 100,000 LLM Conversations via Share Links Indexed by Search Engines and Archived

More
Entity

Mistral

Incidents involved as both Developer and Deployer
  • Incident 1186
    5 Reports

    Reported Public Exposure of Over 100,000 LLM Conversations via Share Links Indexed by Search Engines and Archived

Incidents implicated systems
  • Incident 1186
    5 Reports

    Reported Public Exposure of Over 100,000 LLM Conversations via Share Links Indexed by Search Engines and Archived

More
Entity

Users of ChatGPT

Incidents Harmed By
  • Incident 1186
    5 Reports

    Reported Public Exposure of Over 100,000 LLM Conversations via Share Links Indexed by Search Engines and Archived

More
Entity

Users of Claude

Incidents Harmed By
  • Incident 1186
    5 Reports

    Reported Public Exposure of Over 100,000 LLM Conversations via Share Links Indexed by Search Engines and Archived

More
Entity

Users of Copilot

Incidents Harmed By
  • Incident 1186
    5 Reports

    Reported Public Exposure of Over 100,000 LLM Conversations via Share Links Indexed by Search Engines and Archived

More
Entity

Users of Grok

Incidents Harmed By
  • Incident 1186
    5 Reports

    Reported Public Exposure of Over 100,000 LLM Conversations via Share Links Indexed by Search Engines and Archived

More
Entity

Users of Qwen

Incidents Harmed By
  • Incident 1186
    5 Reports

    Reported Public Exposure of Over 100,000 LLM Conversations via Share Links Indexed by Search Engines and Archived

More
Entity

Users of Mistral

Incidents Harmed By
  • Incident 1186
    5 Reports

    Reported Public Exposure of Over 100,000 LLM Conversations via Share Links Indexed by Search Engines and Archived

More
Entity

General public

Incidents Harmed By
  • Incident 1186
    5 Reports

    Reported Public Exposure of Over 100,000 LLM Conversations via Share Links Indexed by Search Engines and Archived

More
Entity

ChatGPT

Incidents implicated systems
  • Incident 1186
    5 Reports

    Reported Public Exposure of Over 100,000 LLM Conversations via Share Links Indexed by Search Engines and Archived

More
Entity

Claude

Incidents implicated systems
  • Incident 1186
    5 Reports

    Reported Public Exposure of Over 100,000 LLM Conversations via Share Links Indexed by Search Engines and Archived

More
Entity

Copilot

Incidents implicated systems
  • Incident 1186
    5 Reports

    Reported Public Exposure of Over 100,000 LLM Conversations via Share Links Indexed by Search Engines and Archived

More
Entity

Grok

Incidents implicated systems
  • Incident 1186
    5 Reports

    Reported Public Exposure of Over 100,000 LLM Conversations via Share Links Indexed by Search Engines and Archived

More
Entity

Qwen

Incidents implicated systems
  • Incident 1186
    5 Reports

    Reported Public Exposure of Over 100,000 LLM Conversations via Share Links Indexed by Search Engines and Archived

More
Entity

Internet Archive

Incidents implicated systems
  • Incident 1186
    5 Reports

    Reported Public Exposure of Over 100,000 LLM Conversations via Share Links Indexed by Search Engines and Archived

More
Entity

Wayback Machine

Incidents implicated systems
  • Incident 1186
    5 Reports

    Reported Public Exposure of Over 100,000 LLM Conversations via Share Links Indexed by Search Engines and Archived

More

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2024 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • e132322