Skip to Content
logologo
AI Incident Database
寄付する
発見する
投稿する
  • ようこそAIIDへ
  • テーブル表示
  • リスト表示
  • 組織
  • 分類法
  • 空間ビュー
  • ブログ
  • AIニュースダイジェスト
  • おまかせ表示
  • サインアップ
発見する
投稿する
  • ようこそAIIDへ
  • テーブル表示
  • リスト表示
  • 組織
  • 分類法
  • 空間ビュー
  • ブログ
  • AIニュースダイジェスト
  • おまかせ表示
  • サインアップ
組織

GPT-3.5

Incidents involved as Deployer

インシデント 6771 Report
ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

2024-04-29

The "Dan" ("Do Anything Now") AI boyfriend is a trend on TikTok in which users appear to regularly manipulate ChatGPT to adopt boyfriend personas, breaching content policies. ChatGPT 3.5 is reported to regularly produce explicitly sexual content, directly violating its intended safety protocols. GPT-4 and Perplexity AI were subjected to similar manipulations, and although they exhibited more resistance to breaches, some prompts were reported to break its guidelines.

もっと

Incidents implicated systems

インシデント 7314 Report
Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

2023-12-01

Large language models have reportedly hallucinated non-existent software package names, some of which were subsequently uploaded to public repositories and incorporated into real codebases. In one case, a package named huggingface-cli, which was purported to have been originally suggested by an AI model, was downloaded more than 15,000 times. This dynamic enables what security researchers have termed "slopsquatting," in which attackers register hallucinated package names and introduce potential malware into software supply chains.

もっと

インシデント 5613 Report
OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

2019-03-11

OpenAI's products such as ChatGPT and DALL-E were alleged in a lawsuit using stolen private information from internet users without their informed consent or knowledge.

もっと

関連団体
同じインシデントに関連するその他のエンティティ。たとえば、インシデントの開発者がこのエンティティで、デプロイヤーが別のエンティティである場合、それらは関連エンティティとしてマークされます。
 

Entity

OpenAI

開発者と提供者の両方の立場で関わったインシデント
  • インシデント 561
    3 レポート

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

影響を受けたインシデント
  • インシデント 677
    1 レポート

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

Incidents involved as Developer
  • インシデント 731
    4 レポート

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

  • インシデント 677
    1 レポート

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

もっと
Entity

Large language model developers

Incidents involved as Developer
  • インシデント 561
    3 レポート

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

もっと
Entity

Image generation technology developers

Incidents involved as Developer
  • インシデント 561
    3 レポート

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

もっと
Entity

Chatbot developers

Incidents involved as Developer
  • インシデント 561
    3 レポート

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

もっと
Entity

Social media users

影響を受けたインシデント
  • インシデント 561
    3 レポート

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

もっと
Entity

Privacy

影響を受けたインシデント
  • インシデント 561
    3 レポート

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

もっと
Entity

Minors

影響を受けたインシデント
  • インシデント 561
    3 レポート

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

もっと
Entity

internet users

影響を受けたインシデント
  • インシデント 561
    3 レポート

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

もっと
Entity

Web-scraped training datasets

Incidents implicated systems
  • インシデント 561
    3 レポート

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

もっと
Entity

OpenAI training data pipelines

Incidents implicated systems
  • インシデント 561
    3 レポート

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

もっと
Entity

OpenAI large language models

Incidents implicated systems
  • インシデント 561
    3 レポート

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

もっと
Entity

OpenAI Codex

Incidents implicated systems
  • インシデント 561
    3 レポート

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

もっと
Entity

Large language models

Incidents implicated systems
  • インシデント 561
    3 レポート

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

もっと
Entity

Image generation technology

Incidents implicated systems
  • インシデント 561
    3 レポート

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

もっと
Entity

GPT-4

Incidents involved as Deployer
  • インシデント 677
    1 レポート

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

Incidents implicated systems
  • インシデント 731
    4 レポート

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

  • インシデント 561
    3 レポート

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

もっと
Entity

DALL-E

Incidents implicated systems
  • インシデント 561
    3 レポート

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

もっと
Entity

ChatGPT

Incidents involved as Deployer
  • インシデント 677
    1 レポート

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

Incidents implicated systems
  • インシデント 561
    3 レポート

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

もっと
Entity

Chatbots

Incidents implicated systems
  • インシデント 561
    3 レポート

    OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent

もっと
Entity

TikTok users

Incidents involved as Deployer
  • インシデント 677
    1 レポート

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

もっと
Entity

Julia Munslow

Incidents involved as Deployer
  • インシデント 677
    1 レポート

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

もっと
Entity

Perplexity AI

影響を受けたインシデント
  • インシデント 677
    1 レポート

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

Incidents involved as Deployer
  • インシデント 677
    1 レポート

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

もっと
Entity

Perplexity.ai

Incidents involved as Developer
  • インシデント 677
    1 レポート

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

もっと
Entity

General public

影響を受けたインシデント
  • インシデント 677
    1 レポート

    ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios

もっと
Entity

Developers using AI-generated suggestions

Incidents involved as Deployer
  • インシデント 731
    4 レポート

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

もっと
Entity

Bar Lanyado

Incidents involved as Deployer
  • インシデント 731
    4 レポート

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

もっと
Entity

Meta

Incidents involved as Developer
  • インシデント 731
    4 レポート

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

もっと
Entity

Google

Incidents involved as Developer
  • インシデント 731
    4 レポート

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

もっと
Entity

DeepSeek AI

Incidents involved as Developer
  • インシデント 731
    4 レポート

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

もっと
Entity

Cohere

Incidents involved as Developer
  • インシデント 731
    4 レポート

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

もっと
Entity

BigScience

Incidents involved as Developer
  • インシデント 731
    4 レポート

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

もっと
Entity

Users downstream of software contaminated by hallucinated packages

影響を受けたインシデント
  • インシデント 731
    4 レポート

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

もっと
Entity

Trust in open-source repositories and AI-assisted coding tools

影響を受けたインシデント
  • インシデント 731
    4 レポート

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

もっと
Entity

Software ecosystems

影響を受けたインシデント
  • インシデント 731
    4 レポート

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

もっと
Entity

Organizations that incorporated fake dependencies

影響を受けたインシデント
  • インシデント 731
    4 レポート

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

もっと
Entity

Developers and businesses incorporating AI-suggested packages

影響を受けたインシデント
  • インシデント 731
    4 レポート

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

もっと
Entity

Alibaba

影響を受けたインシデント
  • インシデント 731
    4 レポート

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

もっと
Entity

Python Package Index (PyPI)

Incidents implicated systems
  • インシデント 731
    4 レポート

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

もっと
Entity

npm (Node.js)

Incidents implicated systems
  • インシデント 731
    4 レポート

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

もっと
Entity

LLM-powered coding assistants

Incidents implicated systems
  • インシデント 731
    4 レポート

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

もっと
Entity

LLaMA

Incidents implicated systems
  • インシデント 731
    4 レポート

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

もっと
Entity

Google Search / AI Overview

Incidents implicated systems
  • インシデント 731
    4 レポート

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

もっと
Entity

GitHub

Incidents implicated systems
  • インシデント 731
    4 レポート

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

もっと
Entity

Gemini Pro

Incidents implicated systems
  • インシデント 731
    4 レポート

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

もっと
Entity

DeepSeek Coder

Incidents implicated systems
  • インシデント 731
    4 レポート

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

もっと
Entity

Command

Incidents implicated systems
  • インシデント 731
    4 レポート

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

もっと
Entity

CodeLlama

Incidents implicated systems
  • インシデント 731
    4 レポート

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

もっと
Entity

BLOOM

Incidents implicated systems
  • インシデント 731
    4 レポート

    Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers

もっと

エンティティ関係
このエンティティが他のどのエンティティと直接関係しているか。たとえば、「Amazon」と「Amazon Workers」はリンクされたエンティティである可能性があります。
 

Entity

ChatGPT

もっと

リサーチ

  • “AIインシデント”の定義
  • “AIインシデントレスポンス”の定義
  • データベースのロードマップ
  • 関連研究
  • 全データベースのダウンロード

プロジェクトとコミュニティ

  • AIIDについて
  • コンタクトとフォロー
  • アプリと要約
  • エディタのためのガイド

インシデント

  • 全インシデントの一覧
  • フラグの立ったインシデント
  • 登録待ち一覧
  • クラスごとの表示
  • 分類法

2026 - AI Incident Database

  • 利用規約
  • プライバシーポリシー
  • dd3f754