Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Entities

Perplexity AI

Incidents Harmed By

Incident 6771 Report
ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

2024-04-29

The "Dan" ("Do Anything Now") AI boyfriend is a trend on TikTok in which users appear to regularly manipulate ChatGPT to adopt boyfriend personas, breaching content policies. ChatGPT 3.5 is reported to regularly produce explicitly sexual content, directly violating its intended safety protocols. GPT-4 and Perplexity AI were subjected to similar manipulations, and although they exhibited more resistance to breaches, some prompts were reported to break its guidelines.

More

Incidents involved as Deployer

Incident 6771 Report
ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

2024-04-29

The "Dan" ("Do Anything Now") AI boyfriend is a trend on TikTok in which users appear to regularly manipulate ChatGPT to adopt boyfriend personas, breaching content policies. ChatGPT 3.5 is reported to regularly produce explicitly sexual content, directly violating its intended safety protocols. GPT-4 and Perplexity AI were subjected to similar manipulations, and although they exhibited more resistance to breaches, some prompts were reported to break its guidelines.

More

Incidents implicated systems

Incident 10711 Report
Student Reportedly Files Complaint Over Professor's Undisclosed Use of Generative AI at Northeastern University

2025-05-14

A student at Northeastern University reportedly filed a complaint after discovering that a professor had used generative AI tools, including ChatGPT, to produce course materials despite university policies discouraging undisclosed AI use. The student alleged hypocrisy, citing a syllabus that barred unauthorized AI use by students. The professor acknowledged having used AI-generated materials and expressed regret over not reviewing them more carefully. No tuition refund was reportedly granted.

More

Incident 12051 Report
Multiple Generative AI Systems Reportedly Amplify False Information During Charlie Kirk Assassination Coverage

2025-09-11

Multiple AI systems allegedly spread false claims in the aftermath of Charlie Kirk's assassination at Utah Valley University. Perplexity and Grok chatbots reportedly stated Kirk was alive, mischaracterized authentic video as satire, and wrongly identified Utah Democrat Michael Mallinson as the suspect. A Google AI Overview allegedly claimed Kirk was on Ukraine's Myrotvorets "enemies" list, a reported falsehood that echoed pro-Kremlin narratives.

More

Related Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
 

Entity

TikTok users

Incidents involved as Deployer
  • Incident 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

  • Incident 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

More
Entity

Julia Munslow

Incidents involved as Deployer
  • Incident 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

  • Incident 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

More
Entity

ChatGPT

Incidents involved as Deployer
  • Incident 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

  • Incident 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

Incidents implicated systems
  • Incident 1071
    1 Report

    Student Reportedly Files Complaint Over Professor's Undisclosed Use of Generative AI at Northeastern University

More
Entity

GPT-3.5

Incidents involved as Deployer
  • Incident 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

  • Incident 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

More
Entity

GPT-4

Incidents involved as Deployer
  • Incident 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

  • Incident 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

More
Entity

OpenAI

Incidents Harmed By
  • Incident 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

  • Incident 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

Incidents involved as Developer
  • Incident 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

  • Incident 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

More
Entity

Perplexity.ai

Incidents involved as Developer
  • Incident 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

  • Incident 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

More
Entity

General public

Incidents Harmed By
  • Incident 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

  • Incident 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

More
Entity

Rick Arrowood

Incidents Harmed By
  • Incident 1071
    1 Report

    Student Reportedly Files Complaint Over Professor's Undisclosed Use of Generative AI at Northeastern University

Incidents involved as Deployer
  • Incident 1071
    1 Report

    Student Reportedly Files Complaint Over Professor's Undisclosed Use of Generative AI at Northeastern University

More
Entity

Perplexity

Incidents involved as both Developer and Deployer
  • Incident 1205
    1 Report

    Multiple Generative AI Systems Reportedly Amplify False Information During Charlie Kirk Assassination Coverage

Incidents involved as Developer
  • Incident 1071
    1 Report

    Student Reportedly Files Complaint Over Professor's Undisclosed Use of Generative AI at Northeastern University

More
Entity

Gamma.app

Incidents involved as Developer
  • Incident 1071
    1 Report

    Student Reportedly Files Complaint Over Professor's Undisclosed Use of Generative AI at Northeastern University

More
Entity

Northeastern University students

Incidents Harmed By
  • Incident 1071
    1 Report

    Student Reportedly Files Complaint Over Professor's Undisclosed Use of Generative AI at Northeastern University

More
Entity

Northeastern University

Incidents Harmed By
  • Incident 1071
    1 Report

    Student Reportedly Files Complaint Over Professor's Undisclosed Use of Generative AI at Northeastern University

More
Entity

Ella Stapleton

Incidents Harmed By
  • Incident 1071
    1 Report

    Student Reportedly Files Complaint Over Professor's Undisclosed Use of Generative AI at Northeastern University

More
Entity

Gamma

Incidents implicated systems
  • Incident 1071
    1 Report

    Student Reportedly Files Complaint Over Professor's Undisclosed Use of Generative AI at Northeastern University

More
Entity

xAI

Incidents involved as both Developer and Deployer
  • Incident 1205
    1 Report

    Multiple Generative AI Systems Reportedly Amplify False Information During Charlie Kirk Assassination Coverage

More
Entity

Google

Incidents involved as both Developer and Deployer
  • Incident 1205
    1 Report

    Multiple Generative AI Systems Reportedly Amplify False Information During Charlie Kirk Assassination Coverage

More
Entity

Pro-Kremlin actors

Incidents involved as Deployer
  • Incident 1205
    1 Report

    Multiple Generative AI Systems Reportedly Amplify False Information During Charlie Kirk Assassination Coverage

More
Entity

Grok users

Incidents Harmed By
  • Incident 1205
    1 Report

    Multiple Generative AI Systems Reportedly Amplify False Information During Charlie Kirk Assassination Coverage

More
Entity

Perplexity users

Incidents Harmed By
  • Incident 1205
    1 Report

    Multiple Generative AI Systems Reportedly Amplify False Information During Charlie Kirk Assassination Coverage

More
Entity

Google users

Incidents Harmed By
  • Incident 1205
    1 Report

    Multiple Generative AI Systems Reportedly Amplify False Information During Charlie Kirk Assassination Coverage

More
Entity

Michael Mallinson

Incidents Harmed By
  • Incident 1205
    1 Report

    Multiple Generative AI Systems Reportedly Amplify False Information During Charlie Kirk Assassination Coverage

More
Entity

Family of Charlie Kirk

Incidents Harmed By
  • Incident 1205
    1 Report

    Multiple Generative AI Systems Reportedly Amplify False Information During Charlie Kirk Assassination Coverage

More
Entity

Epistemic integrity

Incidents Harmed By
  • Incident 1205
    1 Report

    Multiple Generative AI Systems Reportedly Amplify False Information During Charlie Kirk Assassination Coverage

More
Entity

Journalistic integrity

Incidents Harmed By
  • Incident 1205
    1 Report

    Multiple Generative AI Systems Reportedly Amplify False Information During Charlie Kirk Assassination Coverage

More
Entity

Journalists

Incidents Harmed By
  • Incident 1205
    1 Report

    Multiple Generative AI Systems Reportedly Amplify False Information During Charlie Kirk Assassination Coverage

More
Entity

General public of Utah

Incidents Harmed By
  • Incident 1205
    1 Report

    Multiple Generative AI Systems Reportedly Amplify False Information During Charlie Kirk Assassination Coverage

More
Entity

Grok

Incidents implicated systems
  • Incident 1205
    1 Report

    Multiple Generative AI Systems Reportedly Amplify False Information During Charlie Kirk Assassination Coverage

More
Entity

Google AI

Incidents implicated systems
  • Incident 1205
    1 Report

    Multiple Generative AI Systems Reportedly Amplify False Information During Charlie Kirk Assassination Coverage

More
Entity

Google AI overview

Incidents implicated systems
  • Incident 1205
    1 Report

    Multiple Generative AI Systems Reportedly Amplify False Information During Charlie Kirk Assassination Coverage

More

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2024 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 6f6c5a5