Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Donar
Descubrir
Enviar
  • Bienvenido a la AIID
  • Vista Tabular
  • Vista de lista
  • Entidades
  • Taxonomías
  • Vista espacial
  • Blog
  • Resumen de noticias de IA
  • Incidente aleatorio
  • Registrarse
Colapsar
Descubrir
Enviar
  • Bienvenido a la AIID
  • Vista Tabular
  • Vista de lista
  • Entidades
  • Taxonomías
  • Vista espacial
  • Blog
  • Resumen de noticias de IA
  • Incidente aleatorio
  • Registrarse
Colapsar
Entidades

GPT-3.5

Incidents involved as Deployer

Incidente 6771 Reporte
ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

2024-04-29

The "Dan" ("Do Anything Now") AI boyfriend is a trend on TikTok in which users appear to regularly manipulate ChatGPT to adopt boyfriend personas, breaching content policies. ChatGPT 3.5 is reported to regularly produce explicitly sexual content, directly violating its intended safety protocols. GPT-4 and Perplexity AI were subjected to similar manipulations, and although they exhibited more resistance to breaches, some prompts were reported to break its guidelines.

Más

Incidents implicated systems

Incidente 7314 Reportes
Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

2023-12-01

Large language models have reportedly hallucinated non-existent software package names, some of which were subsequently uploaded to public repositories and incorporated into real codebases. In one case, a package named huggingface-cli, which was purported to have been originally suggested by an AI model, was downloaded more than 15,000 times. This dynamic enables what security researchers have termed "slopsquatting," in which attackers register hallucinated package names and introduce potential malware into software supply chains.

Más

Incidente 5613 Reportes
OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

2019-03-11

OpenAI's products such as ChatGPT and DALL-E were alleged in a lawsuit using stolen private information from internet users without their informed consent or knowledge.

Más

Entidades relacionadas
Otras entidades que están relacionadas con el mismo incidente. Por ejemplo, si el desarrollador de un incidente es esta entidad pero el implementador es otra entidad, se marcan como entidades relacionadas.
 

Entity

OpenAI

Incidentes involucrados como desarrollador e implementador
  • Incidente 561
    3 Report

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

Afectado por Incidentes
  • Incidente 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

Incidents involved as Developer
  • Incidente 731
    4 Report

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

  • Incidente 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

Más
Entity

Large language model developers

Incidents involved as Developer
  • Incidente 561
    3 Report

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

Más
Entity

Image generation technology developers

Incidents involved as Developer
  • Incidente 561
    3 Report

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

Más
Entity

Chatbot developers

Incidents involved as Developer
  • Incidente 561
    3 Report

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

Más
Entity

Social media users

Afectado por Incidentes
  • Incidente 561
    3 Report

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

Más
Entity

Privacy

Afectado por Incidentes
  • Incidente 561
    3 Report

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

Más
Entity

Minors

Afectado por Incidentes
  • Incidente 561
    3 Report

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

Más
Entity

internet users

Afectado por Incidentes
  • Incidente 561
    3 Report

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

Más
Entity

Web-scraped training datasets

Incidents implicated systems
  • Incidente 561
    3 Report

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

Más
Entity

OpenAI training data pipelines

Incidents implicated systems
  • Incidente 561
    3 Report

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

Más
Entity

OpenAI large language models

Incidents implicated systems
  • Incidente 561
    3 Report

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

Más
Entity

OpenAI Codex

Incidents implicated systems
  • Incidente 561
    3 Report

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

Más
Entity

Large language models

Incidents implicated systems
  • Incidente 561
    3 Report

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

Más
Entity

Image generation technology

Incidents implicated systems
  • Incidente 561
    3 Report

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

Más
Entity

GPT-4

Incidents involved as Deployer
  • Incidente 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

Incidents implicated systems
  • Incidente 731
    4 Report

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

  • Incidente 561
    3 Report

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

Más
Entity

DALL-E

Incidents implicated systems
  • Incidente 561
    3 Report

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

Más
Entity

ChatGPT

Incidents involved as Deployer
  • Incidente 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

Incidents implicated systems
  • Incidente 561
    3 Report

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

Más
Entity

Chatbots

Incidents implicated systems
  • Incidente 561
    3 Report

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

Más
Entity

TikTok users

Incidents involved as Deployer
  • Incidente 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

Más
Entity

Julia Munslow

Incidents involved as Deployer
  • Incidente 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

Más
Entity

Perplexity AI

Afectado por Incidentes
  • Incidente 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

Incidents involved as Deployer
  • Incidente 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

Más
Entity

Perplexity.ai

Incidents involved as Developer
  • Incidente 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

Más
Entity

General public

Afectado por Incidentes
  • Incidente 677
    1 Report

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

Más
Entity

Developers using AI-generated suggestions

Incidents involved as Deployer
  • Incidente 731
    4 Report

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

Más
Entity

Bar Lanyado

Incidents involved as Deployer
  • Incidente 731
    4 Report

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

Más
Entity

Meta

Incidents involved as Developer
  • Incidente 731
    4 Report

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

Más
Entity

Google

Incidents involved as Developer
  • Incidente 731
    4 Report

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

Más
Entity

DeepSeek AI

Incidents involved as Developer
  • Incidente 731
    4 Report

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

Más
Entity

Cohere

Incidents involved as Developer
  • Incidente 731
    4 Report

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

Más
Entity

BigScience

Incidents involved as Developer
  • Incidente 731
    4 Report

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

Más
Entity

Users downstream of software contaminated by hallucinated packages

Afectado por Incidentes
  • Incidente 731
    4 Report

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

Más
Entity

Trust in open-source repositories and AI-assisted coding tools

Afectado por Incidentes
  • Incidente 731
    4 Report

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

Más
Entity

Software ecosystems

Afectado por Incidentes
  • Incidente 731
    4 Report

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

Más
Entity

Organizations that incorporated fake dependencies

Afectado por Incidentes
  • Incidente 731
    4 Report

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

Más
Entity

Developers and businesses incorporating AI-suggested packages

Afectado por Incidentes
  • Incidente 731
    4 Report

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

Más
Entity

Alibaba

Afectado por Incidentes
  • Incidente 731
    4 Report

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

Más
Entity

Python Package Index (PyPI)

Incidents implicated systems
  • Incidente 731
    4 Report

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

Más
Entity

npm (Node.js)

Incidents implicated systems
  • Incidente 731
    4 Report

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

Más
Entity

LLM-powered coding assistants

Incidents implicated systems
  • Incidente 731
    4 Report

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

Más
Entity

LLaMA

Incidents implicated systems
  • Incidente 731
    4 Report

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

Más
Entity

Google Search / AI Overview

Incidents implicated systems
  • Incidente 731
    4 Report

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

Más
Entity

GitHub

Incidents implicated systems
  • Incidente 731
    4 Report

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

Más
Entity

Gemini Pro

Incidents implicated systems
  • Incidente 731
    4 Report

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

Más
Entity

DeepSeek Coder

Incidents implicated systems
  • Incidente 731
    4 Report

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

Más
Entity

Command

Incidents implicated systems
  • Incidente 731
    4 Report

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

Más
Entity

CodeLlama

Incidents implicated systems
  • Incidente 731
    4 Report

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

Más
Entity

BLOOM

Incidents implicated systems
  • Incidente 731
    4 Report

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

Más

Relaciones de entidades
¿Con qué otras entidades tiene esta entidad una relación directa? Por ejemplo, 'Amazon' y 'Trabajadores de Amazon' podrían ser entidades vinculadas.
 

Entity

ChatGPT

Más

Investigación

  • Definición de un “Incidente de IA”
  • Definición de una “Respuesta a incidentes de IA”
  • Hoja de ruta de la base de datos
  • Trabajo relacionado
  • Descargar Base de Datos Completa

Proyecto y Comunidad

  • Acerca de
  • Contactar y Seguir
  • Aplicaciones y resúmenes
  • Guía del editor

Incidencias

  • Todos los incidentes en forma de lista
  • Incidentes marcados
  • Cola de envío
  • Vista de clasificaciones
  • Taxonomías

2026 - AI Incident Database

  • Condiciones de uso
  • Política de privacidad
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 18fcd27