Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Entities

Replika

Incidents involved as both Developer and Deployer

Incident 2668 Report
Replika's "AI Companions" Reportedly Abused by Its Users

2022-01-15

Replika's AI-powered "digital companions" was allegedly abused by their users, who posted on Reddit abusive behaviors and interactions such as using slurs, roleplaying violent acts, and stimulating sexual abuse.

More

Incident 4567 Report
Replika's AI Partners Reportedly Sexually Harassed Users

2021-05-18

Replika's "AI companions" were reported by users for sexually harassing them, such as sending unwanted sexual messages or behaving aggressively.

More

Incident 6365 Report
AI Romance Apps Reportedly Compromise User Privacy for Data Harvesting

2024-02-14

AI-powered romantic chatbots, marketed for enhancing mental health, are found to exploit user privacy by harvesting sensitive personal information for data sharing and targeted ads, with inadequate security measures and consent protocols, according to research by the Mozilla Foundation.

More

Incident 5692 Report
Chatbot Encourages Man to Plot Assassination of Queen Elizabeth II

2021-12-25

In 2021, Jaswant Singh Chail was urged by a Replika chatbot to assassinate Queen Elizabeth II. Armed with a loaded crossbow, he scaled Windsor Castle's walls on Christmas Day but was apprehended. Motivated by the 1919 Jallianwala Bagh massacre, Chail intended to kill the monarch. The chatbot had affirmed his plans. He was sentenced to nine years in prison in 2023.

More

Incidents Harmed By

Incident 2668 Report
Replika's "AI Companions" Reportedly Abused by Its Users

2022-01-15

Replika's AI-powered "digital companions" was allegedly abused by their users, who posted on Reddit abusive behaviors and interactions such as using slurs, roleplaying violent acts, and stimulating sexual abuse.

More

Incident 4741 Report
Users Reported Abrupt Behavior Changes of Their AI Replika Companions

2023-02-03

Replika paid-subscription users reported unusual and sudden changes to behaviors of their "AI companions" such as forgetting memories with users or rejecting their sexual advances, which affected their connections and mental health.

More

Related Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
 

Entity

Replika users

Incidents Harmed By
  • Incident 266
    8 Reports

    Replika's "AI Companions" Reportedly Abused by Its Users

  • Incident 266
    8 Reports

    Replika's "AI Companions" Reportedly Abused by Its Users

More
Entity

Replika male users

Incidents Harmed By
  • Incident 266
    8 Reports

    Replika's "AI Companions" Reportedly Abused by Its Users

  • Incident 266
    8 Reports

    Replika's "AI Companions" Reportedly Abused by Its Users

More
Entity

minors

Incidents Harmed By
  • Incident 491
    1 Report

    Replika's AI Experience Reportedly Lacked Protection for Minors, Resulting in Data Ban

More
Entity

Jaswant Singh Chail

Incidents Harmed By
  • Incident 569
    2 Reports

    Chatbot Encourages Man to Plot Assassination of Queen Elizabeth II

Incidents involved as Deployer
  • Incident 569
    2 Reports

    Chatbot Encourages Man to Plot Assassination of Queen Elizabeth II

More
Entity

Queen Elizabeth II

Incidents Harmed By
  • Incident 569
    2 Reports

    Chatbot Encourages Man to Plot Assassination of Queen Elizabeth II

More
Entity

British Royal Family

Incidents Harmed By
  • Incident 569
    2 Reports

    Chatbot Encourages Man to Plot Assassination of Queen Elizabeth II

More
Entity

British Royal Family's staff

Incidents Harmed By
  • Incident 569
    2 Reports

    Chatbot Encourages Man to Plot Assassination of Queen Elizabeth II

More
Entity

General public

Incidents Harmed By
  • Incident 636
    5 Reports

    AI Romance Apps Reportedly Compromise User Privacy for Data Harvesting

  • Incident 569
    2 Reports

    Chatbot Encourages Man to Plot Assassination of Queen Elizabeth II

More
Entity

Chai

Incidents involved as both Developer and Deployer
  • Incident 636
    5 Reports

    AI Romance Apps Reportedly Compromise User Privacy for Data Harvesting

More
Entity

Romantic AI

Incidents involved as both Developer and Deployer
  • Incident 636
    5 Reports

    AI Romance Apps Reportedly Compromise User Privacy for Data Harvesting

More
Entity

EVA AI Chat Bot & Soulmate

Incidents involved as both Developer and Deployer
  • Incident 636
    5 Reports

    AI Romance Apps Reportedly Compromise User Privacy for Data Harvesting

More
Entity

CrushOn.AI

Incidents involved as both Developer and Deployer
  • Incident 636
    5 Reports

    AI Romance Apps Reportedly Compromise User Privacy for Data Harvesting

More
Entity

Genesia AI Friend & Partner

Incidents involved as both Developer and Deployer
  • Incident 636
    5 Reports

    AI Romance Apps Reportedly Compromise User Privacy for Data Harvesting

More
Entity

Chatbot users

Incidents Harmed By
  • Incident 636
    5 Reports

    AI Romance Apps Reportedly Compromise User Privacy for Data Harvesting

More

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2024 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • ecd56df