Skip to Content
logologo
AI Incident Database
Donate
Discover
Submit
  • Welcome to the AIID
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Spatial View
  • Blog
  • AI News Digest
  • Random Incident
  • Sign Up
Discover
Submit
  • Welcome to the AIID
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Spatial View
  • Blog
  • AI News Digest
  • Random Incident
  • Sign Up
Entities

AI training data pipelines

Incidents implicated systems

Incident 4508 Report
Kenyan Data Annotators Reported Psychological Trauma from Labeling Graphic Text for ChatGPT Safety Systems

2021-11-01

Sama data annotators in Nairobi, Kenya, reported lasting psychological trauma after labeling graphic sexual and violent text for OpenAI's content-moderation classifiers used in ChatGPT. Workers alleged low pay and inadequate psychological support; Sama disputed aspects of those accounts. The contract ended early, and former workers later petitioned Kenya's Parliament for stronger protections.

More

Incident 5211 Report
iRobot Roomba J7 R&D Images Reportedly Appeared in Private Online Groups After Data Labeling

2020-06-10

Images reportedly captured in 2020 by development versions of iRobot's Roomba J7 robot vacuum during an AI training data project were sent to Scale AI for labeling and later appeared in private Facebook, Discord, and other online groups. Reporting described some images as showing sensitive household scenes.

More

Related Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
 

Entity

OpenAI

Incidents involved as both Developer and Deployer
  • Incident 450
    8 Reports

    Kenyan Data Annotators Reported Psychological Trauma from Labeling Graphic Text for ChatGPT Safety Systems

More
Entity

Sama

Incidents Harmed By
  • Incident 450
    8 Reports

    Kenyan Data Annotators Reported Psychological Trauma from Labeling Graphic Text for ChatGPT Safety Systems

Incidents involved as Deployer
  • Incident 450
    8 Reports

    Kenyan Data Annotators Reported Psychological Trauma from Labeling Graphic Text for ChatGPT Safety Systems

More
Entity

Large language model developers

Incidents involved as Developer
  • Incident 450
    8 Reports

    Kenyan Data Annotators Reported Psychological Trauma from Labeling Graphic Text for ChatGPT Safety Systems

More
Entity

Chatbot developers

Incidents involved as Developer
  • Incident 450
    8 Reports

    Kenyan Data Annotators Reported Psychological Trauma from Labeling Graphic Text for ChatGPT Safety Systems

More
Entity

Employees of Sama

Incidents Harmed By
  • Incident 450
    8 Reports

    Kenyan Data Annotators Reported Psychological Trauma from Labeling Graphic Text for ChatGPT Safety Systems

More
Entity

Data annotators

Incidents Harmed By
  • Incident 450
    8 Reports

    Kenyan Data Annotators Reported Psychological Trauma from Labeling Graphic Text for ChatGPT Safety Systems

More
Entity

Sama data annotators in Kenya

Incidents Harmed By
  • Incident 450
    8 Reports

    Kenyan Data Annotators Reported Psychological Trauma from Labeling Graphic Text for ChatGPT Safety Systems

More
Entity

OpenAI large language models

Incidents implicated systems
  • Incident 450
    8 Reports

    Kenyan Data Annotators Reported Psychological Trauma from Labeling Graphic Text for ChatGPT Safety Systems

More
Entity

Large language models

Incidents implicated systems
  • Incident 450
    8 Reports

    Kenyan Data Annotators Reported Psychological Trauma from Labeling Graphic Text for ChatGPT Safety Systems

More
Entity

ChatGPT

Incidents implicated systems
  • Incident 450
    8 Reports

    Kenyan Data Annotators Reported Psychological Trauma from Labeling Graphic Text for ChatGPT Safety Systems

More
Entity

Content moderation systems

Incidents implicated systems
  • Incident 450
    8 Reports

    Kenyan Data Annotators Reported Psychological Trauma from Labeling Graphic Text for ChatGPT Safety Systems

More
Entity

OpenAI toxic-content classifiers

Incidents implicated systems
  • Incident 450
    8 Reports

    Kenyan Data Annotators Reported Psychological Trauma from Labeling Graphic Text for ChatGPT Safety Systems

More
Entity

iRobot

Incidents involved as both Developer and Deployer
  • Incident 521
    1 Report

    iRobot Roomba J7 R&D Images Reportedly Appeared in Private Online Groups After Data Labeling

More
Entity

Scale AI

Incidents involved as Developer
  • Incident 521
    1 Report

    iRobot Roomba J7 R&D Images Reportedly Appeared in Private Online Groups After Data Labeling

More
Entity

Privacy

Incidents Harmed By
  • Incident 521
    1 Report

    iRobot Roomba J7 R&D Images Reportedly Appeared in Private Online Groups After Data Labeling

More
Entity

Project IO participants

Incidents Harmed By
  • Incident 521
    1 Report

    iRobot Roomba J7 R&D Images Reportedly Appeared in Private Online Groups After Data Labeling

More
Entity

People captured in Roomba training images

Incidents Harmed By
  • Incident 521
    1 Report

    iRobot Roomba J7 R&D Images Reportedly Appeared in Private Online Groups After Data Labeling

More
Entity

Minors captured in Roomba training images

Incidents Harmed By
  • Incident 521
    1 Report

    iRobot Roomba J7 R&D Images Reportedly Appeared in Private Online Groups After Data Labeling

More
Entity

Minors

Incidents Harmed By
  • Incident 521
    1 Report

    iRobot Roomba J7 R&D Images Reportedly Appeared in Private Online Groups After Data Labeling

More
Entity

iRobot Roomba J7 development robots

Incidents implicated systems
  • Incident 521
    1 Report

    iRobot Roomba J7 R&D Images Reportedly Appeared in Private Online Groups After Data Labeling

More
Entity

Roomba image capture systems

Incidents implicated systems
  • Incident 521
    1 Report

    iRobot Roomba J7 R&D Images Reportedly Appeared in Private Online Groups After Data Labeling

More
Entity

Scale AI data-labeling platform

Incidents implicated systems
  • Incident 521
    1 Report

    iRobot Roomba J7 R&D Images Reportedly Appeared in Private Online Groups After Data Labeling

More
Entity

Computer vision training datasets

Incidents implicated systems
  • Incident 521
    1 Report

    iRobot Roomba J7 R&D Images Reportedly Appeared in Private Online Groups After Data Labeling

More
Entity

Smart home devices

Incidents implicated systems
  • Incident 521
    1 Report

    iRobot Roomba J7 R&D Images Reportedly Appeared in Private Online Groups After Data Labeling

More
Entity

Home service robots

Incidents implicated systems
  • Incident 521
    1 Report

    iRobot Roomba J7 R&D Images Reportedly Appeared in Private Online Groups After Data Labeling

More
Entity

Robot vacuum systems

Incidents implicated systems
  • Incident 521
    1 Report

    iRobot Roomba J7 R&D Images Reportedly Appeared in Private Online Groups After Data Labeling

More
Entity

Smart home sensing systems

Incidents implicated systems
  • Incident 521
    1 Report

    iRobot Roomba J7 R&D Images Reportedly Appeared in Private Online Groups After Data Labeling

More

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2026 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • b74f812