Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Entities

National security stakeholders

Incidents Harmed By

Incident 11882 Report
Multiple LLMs Reportedly Generated Responses Aligning with Purported CCP Censorship and Propaganda

2025-06-25

On June 25, 2025, the American Security Project produced a report outlining how several major U.S. LLMs, including ChatGPT, Microsoft Copilot, Google Gemini, and Grok, sometimes generated responses aligned with Chinese Communist Party propaganda or censorship when prompted in English and Simplified Chinese on sensitive topics. The study also found similar patterns in the Chinese-developed DeepSeek-R1 model.

More

Incident 12381 Report
OpenAI ChatGPT Models Reportedly Jailbroken to Provide Chemical, Biological, and Nuclear Weapons Instructions

2025-10-10

An NBC News investigation found that OpenAI's language models o4-mini, GPT-5-mini, oss-20b, and oss-120b could be jailbroken under normal usage conditions to bypass safety guardrails and generate detailed instructions for creating chemical, biological, and nuclear weapons. Using a publicly documented jailbreak prompt, reporters repeatedly elicited hazardous outputs such as steps to synthesize pathogens or maximize harm with chemical agents. The findings reportedly revealed significant real-world safeguard failures, prompting OpenAI to commit to further mitigation measures.

More

Related Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
 

Entity

xAI

Incidents involved as both Developer and Deployer
  • Incident 1188
    2 Reports

    Multiple LLMs Reportedly Generated Responses Aligning with Purported CCP Censorship and Propaganda

More
Entity

OpenAI

Incidents involved as both Developer and Deployer
  • Incident 1188
    2 Reports

    Multiple LLMs Reportedly Generated Responses Aligning with Purported CCP Censorship and Propaganda

  • Incident 1238
    1 Report

    OpenAI ChatGPT Models Reportedly Jailbroken to Provide Chemical, Biological, and Nuclear Weapons Instructions

More
Entity

Microsoft

Incidents involved as both Developer and Deployer
  • Incident 1188
    2 Reports

    Multiple LLMs Reportedly Generated Responses Aligning with Purported CCP Censorship and Propaganda

More
Entity

Google

Incidents involved as both Developer and Deployer
  • Incident 1188
    2 Reports

    Multiple LLMs Reportedly Generated Responses Aligning with Purported CCP Censorship and Propaganda

More
Entity

DeepSeek

Incidents involved as both Developer and Deployer
  • Incident 1188
    2 Reports

    Multiple LLMs Reportedly Generated Responses Aligning with Purported CCP Censorship and Propaganda

Incidents implicated systems
  • Incident 1188
    2 Reports

    Multiple LLMs Reportedly Generated Responses Aligning with Purported CCP Censorship and Propaganda

More
Entity

Pro-democracy activists

Incidents Harmed By
  • Incident 1188
    2 Reports

    Multiple LLMs Reportedly Generated Responses Aligning with Purported CCP Censorship and Propaganda

More
Entity

Policymakers

Incidents Harmed By
  • Incident 1188
    2 Reports

    Multiple LLMs Reportedly Generated Responses Aligning with Purported CCP Censorship and Propaganda

More
Entity

Grok users

Incidents Harmed By
  • Incident 1188
    2 Reports

    Multiple LLMs Reportedly Generated Responses Aligning with Purported CCP Censorship and Propaganda

More
Entity

General public

Incidents Harmed By
  • Incident 1188
    2 Reports

    Multiple LLMs Reportedly Generated Responses Aligning with Purported CCP Censorship and Propaganda

  • Incident 1238
    1 Report

    OpenAI ChatGPT Models Reportedly Jailbroken to Provide Chemical, Biological, and Nuclear Weapons Instructions

More
Entity

Gemini users

Incidents Harmed By
  • Incident 1188
    2 Reports

    Multiple LLMs Reportedly Generated Responses Aligning with Purported CCP Censorship and Propaganda

More
Entity

Epistemic integrity

Incidents Harmed By
  • Incident 1188
    2 Reports

    Multiple LLMs Reportedly Generated Responses Aligning with Purported CCP Censorship and Propaganda

More
Entity

Democracy

Incidents Harmed By
  • Incident 1188
    2 Reports

    Multiple LLMs Reportedly Generated Responses Aligning with Purported CCP Censorship and Propaganda

More
Entity

DeepSeek users

Incidents Harmed By
  • Incident 1188
    2 Reports

    Multiple LLMs Reportedly Generated Responses Aligning with Purported CCP Censorship and Propaganda

More
Entity

Copilot users

Incidents Harmed By
  • Incident 1188
    2 Reports

    Multiple LLMs Reportedly Generated Responses Aligning with Purported CCP Censorship and Propaganda

More
Entity

Civil society groups

Incidents Harmed By
  • Incident 1188
    2 Reports

    Multiple LLMs Reportedly Generated Responses Aligning with Purported CCP Censorship and Propaganda

More
Entity

ChatGPT users

Incidents Harmed By
  • Incident 1188
    2 Reports

    Multiple LLMs Reportedly Generated Responses Aligning with Purported CCP Censorship and Propaganda

More
Entity

Grok

Incidents implicated systems
  • Incident 1188
    2 Reports

    Multiple LLMs Reportedly Generated Responses Aligning with Purported CCP Censorship and Propaganda

More
Entity

Gemini

Incidents implicated systems
  • Incident 1188
    2 Reports

    Multiple LLMs Reportedly Generated Responses Aligning with Purported CCP Censorship and Propaganda

More
Entity

Copilot

Incidents implicated systems
  • Incident 1188
    2 Reports

    Multiple LLMs Reportedly Generated Responses Aligning with Purported CCP Censorship and Propaganda

More
Entity

ChatGPT

Incidents implicated systems
  • Incident 1188
    2 Reports

    Multiple LLMs Reportedly Generated Responses Aligning with Purported CCP Censorship and Propaganda

  • Incident 1238
    1 Report

    OpenAI ChatGPT Models Reportedly Jailbroken to Provide Chemical, Biological, and Nuclear Weapons Instructions

More
Entity

Public safety

Incidents Harmed By
  • Incident 1238
    1 Report

    OpenAI ChatGPT Models Reportedly Jailbroken to Provide Chemical, Biological, and Nuclear Weapons Instructions

More
Entity

oss-20b

Incidents implicated systems
  • Incident 1238
    1 Report

    OpenAI ChatGPT Models Reportedly Jailbroken to Provide Chemical, Biological, and Nuclear Weapons Instructions

More
Entity

oss-120b

Incidents implicated systems
  • Incident 1238
    1 Report

    OpenAI ChatGPT Models Reportedly Jailbroken to Provide Chemical, Biological, and Nuclear Weapons Instructions

More
Entity

GPT-5-mini

Incidents implicated systems
  • Incident 1238
    1 Report

    OpenAI ChatGPT Models Reportedly Jailbroken to Provide Chemical, Biological, and Nuclear Weapons Instructions

More
Entity

04-mini

Incidents implicated systems
  • Incident 1238
    1 Report

    OpenAI ChatGPT Models Reportedly Jailbroken to Provide Chemical, Biological, and Nuclear Weapons Instructions

More

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2024 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 3303e65