Incident 477: Bing Chat Tentatively Hallucinated in Extended Conversations with Users

Description: Early testers reported Bing Chat, in extended conversations with users, having tendencies to make up facts and emulate emotions through an unintended persona.


New ReportNew ReportNew ResponseNew ResponseDiscoverDiscoverView HistoryView History
Alleged: OpenAI developed an AI system deployed by , which harmed Microsoft.

Incident Stats

Incident ID
Report Count
Incident Date
Khoa Lam
A Conversation With Bing’s Chatbot Left Me Deeply Unsettled · 2023

Last week, after testing the new, A.I.-powered Bing search engine from Microsoft, I wrote that, much to my shock, it had replaced Google as my favorite search engine.

But a week later, I’ve changed my mind. I’m still fascinated and impresse…

Bing Is Not Sentient, Does Not Have Feelings, Is Not Alive, and Does Not Want to Be Alive · 2023

Text-generating AI is getting good at being convincing—scary good, even. Microsoft's Bing AI chatbot has gone viral this week for giving users aggressive, deceptive, and rude responses, even berating users and messing with their heads. Unse…

The new Bing told our reporter it ‘can feel or think things’ · 2023

Last week, Microsoft launched a "reimagined" Bing search engine that can answer complex questions and converse directly with users. But instead of a chipper helper, some testers have encountered a moody and combative presence that calls its…

Microsoft’s AI chatbot is going off the rails · 2023

When Marvin von Hagen, a 23-year-old studying technology in Germany, asked Microsoft's new AI-powered search chatbot if it knew anything about him, the answer was a lot more surprising and menacing than he expected.

"My honest opinion of yo…

The new Bing & Edge – Updates to Chat · 2023
Microsoft post-incident response

Hello early previewers,

We want to share a quick update on one notable change we are making to the new Bing based on your feedback.

As we mentioned recently, very long chat sessions can confuse the underlying chat model in the new Bing. To…

Microsoft Limits Bing AI Chats to 5 Replies to Keep Conversations Normal · 2023

Microsoft is limiting how extensively people can converse with its Bing AI chatbot, following media coverage of the bot going off the rails during long exchanges. 

Bing Chat will now reply to up to five questions or statements in a row for …


A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.