Chatbots
Incidents involved as Developer
Incident 7644 Report
Cody Enterprise Reporter Resigns After Admitting to AI-Generated Fake Quotes
2024-06-26
A reporter at the Cody Enterprise used AI to generate fake quotes and stories, including fabricating statements from Wyoming’s governor and other officials. The misuse of AI was uncovered when another journalist noticed robotic phrases and false information in the articles. The reporter resigned, and the newspaper is now implementing policies to prevent future incidents.
MoreIncidents implicated systems
Incident 10611 Report
Korean Chatbot Luda Reportedly Made Offensive Remarks Towards Minority Groups in South Korea
2020-12-23
A Korean interactive chatbot was allegedly shown in screenshots to have used derogatory and bigoted language when asked about lesbians, Black people, and people with disabilities.
MoreIncident 165711 Report
Anthropic Allegedly Copied Copyrighted Song Lyrics Without Permission to Train Claude
2023-09-27
Music publishers alleged that Anthropic copied copyrighted song lyrics without permission to train Claude and that Claude reproduced protected lyrics in its outputs. Anthropic denied infringement and has argued that its training use is fair use. Publishers alleged that the conduct deprived rightsholders and songwriters of licensing control and revenue and undermined markets for licensed lyrics.
MoreIncident 5135 Report
ChatGPT Reportedly Banned by Italian Authority Due to OpenAI's Purported Lack of Legal Basis for Data Collection and Age Verification
2023-03-31
Italy's data protection authority is reported to have temporarily limited OpenAI's processing of Italian users' data after alleging that ChatGPT lacked adequate notice and legal basis for large-scale personal data collection and processing used to train the system. The authority also cited a March 2023 data breach, possible processing of inaccurate personal data, and the absence of age-verification safeguards for children.
MoreIncident 5385 Report
Texas A&M-Commerce Professor Reportedly Used ChatGPT to Accuse Students of Cheating and Assign Incomplete Grades
2023-05-15
On May 15, 2023, Texas A&M University-Commerce instructor Jared Mumm reportedly emailed animal-science seniors that he had copied their final assignments into ChatGPT and would assign zeros or temporary incompletes when the chatbot claimed the text was AI-generated. Students said the accusations caused panic and put graduation or diplomas at risk; the university later said no students failed or were barred from graduating because of the issue.
MoreRelated Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
Related Entities
Chatbot developers
Incidents involved as both Developer and Deployer
- Incident 15353 Reports
OpenAI Allegedly Failed to Intervene in ChatGPT Conversations Preceding Montreal Web Developer Alice Carrier's Suicide
- Incident 16093 Reports
ChatGPT-4o Allegedly Discouraged Florida Pastor From Seeking Care Before Pulmonary Embolism
Incidents Harmed By
Incidents involved as Developer
Chatbot users
Incidents Harmed By
- Incident 10611 Reports
Korean Chatbot Luda Reportedly Made Offensive Remarks Towards Minority Groups in South Korea
- Incident 6365 Reports
AI Romance Apps Reportedly Compromise User Privacy for Data Harvesting
Incidents involved as Developer
Incidents involved as Deployer
- Incident 16194 Reports
Bentonville, Arkansas, Photographer Allegedly Used Grok to Create AI-Generated Child Sexual Abuse Material from Clients' Photos
- Incident 16364 Reports
Purportedly AI-Generated Travel Information Reportedly Misled Tourists into Seeking Nonexistent 'Sacred Canyon of Humantay' in Peru
OpenAI
Incidents involved as both Developer and Deployer
- Incident 5135 Reports
ChatGPT Reportedly Banned by Italian Authority Due to OpenAI's Purported Lack of Legal Basis for Data Collection and Age Verification
- Incident 12534 Reports
Large-Scale Mental Health Crises Allegedly Associated with ChatGPT Interactions
Incidents Harmed By
Incidents involved as Developer
Large language model developers
Incidents involved as both Developer and Deployer
- Incident 15353 Reports
OpenAI Allegedly Failed to Intervene in ChatGPT Conversations Preceding Montreal Web Developer Alice Carrier's Suicide
- Incident 16093 Reports
ChatGPT-4o Allegedly Discouraged Florida Pastor From Seeking Care Before Pulmonary Embolism
Incidents Harmed By
Incidents involved as Developer
Minors
Incidents Harmed By
- Incident 5135 Reports
ChatGPT Reportedly Banned by Italian Authority Due to OpenAI's Purported Lack of Legal Basis for Data Collection and Age Verification
- Incident 16194 Reports
Bentonville, Arkansas, Photographer Allegedly Used Grok to Create AI-Generated Child Sexual Abuse Material from Clients' Photos
Educational communities
Incidents Harmed By
- Incident 5385 Reports
Texas A&M-Commerce Professor Reportedly Used ChatGPT to Accuse Students of Cheating and Assign Incomplete Grades
- Incident 15121 Report
The Sydney Morning Herald and The Age Removed an Opinion Article After Undisclosed Copilot Use
Incidents involved as Deployer
Image generation technology developers
Incidents involved as Developer
- Incident 5613 Reports
OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent
- Incident 15803 Reports
PRC-Linked Accounts Reportedly Used ChatGPT in Covert Campaigns Targeting U.S. AI Policy Debates
Incidents implicated systems
Replika
Incidents involved as both Developer and Deployer
- Incident 6365 Reports
AI Romance Apps Reportedly Compromise User Privacy for Data Harvesting
- Incident 4911 Report
Replika's AI Experience Reportedly Lacked Protection for Minors, Resulting in Data Ban
Incidents implicated systems
Genesia AI Friend & Partner
Incidents involved as both Developer and Deployer
Incidents implicated systems
EVA AI Chat Bot & Soulmate
Incidents involved as both Developer and Deployer
Incidents implicated systems
ChatGPT users
Incidents Harmed By
- Incident 12534 Reports
Large-Scale Mental Health Crises Allegedly Associated with ChatGPT Interactions
- Incident 13563 Reports
Urban VPN Proxy Browser Extension Reportedly Harvested and Sold Private AI Chatbot Conversations via Silent Update
Incidents involved as Deployer
Incidents involved as both Developer and Deployer
- Incident 7431 Report
Gemini AI Allegedly Reads Google Drive Files Without Explicit User Consent
- Incident 7501 Report
AI Chatbots Reportedly Inaccurately Conveyed Real-Time Political News
Incidents involved as Developer
Perplexity
Incidents involved as both Developer and Deployer
Incidents involved as Developer
Incidents implicated systems
Microsoft
Incidents involved as both Developer and Deployer
Incidents Harmed By
Incidents involved as Developer
OpenAI users
Incidents Harmed By
- Incident 16364 Reports
Purportedly AI-Generated Travel Information Reportedly Misled Tourists into Seeking Nonexistent 'Sacred Canyon of Humantay' in Peru
- Incident 15353 Reports
OpenAI Allegedly Failed to Intervene in ChatGPT Conversations Preceding Montreal Web Developer Alice Carrier's Suicide
Incidents involved as Deployer
Anthropic
Incidents involved as both Developer and Deployer
- Incident 165711 Reports
Anthropic Allegedly Copied Copyrighted Song Lyrics Without Permission to Train Claude
- Incident 16212 Reports
Publicly Shared Claude Artifacts Reportedly Became Discoverable Through Google Search
Incidents involved as Developer
Synthetic media generation technology developers
Incidents involved as Developer
- Incident 16194 Reports
Bentonville, Arkansas, Photographer Allegedly Used Grok to Create AI-Generated Child Sexual Abuse Material from Clients' Photos
- Incident 15803 Reports
PRC-Linked Accounts Reportedly Used ChatGPT in Covert Campaigns Targeting U.S. AI Policy Debates