Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse

Report 1165

Associated Incidents

Incident 6616 Report
Chinese Chatbots Question Communist Party

Loading...
Chinese chatbots pulled after going rogue
sbs.com.au · 2017

China has taken down two online robots that appeared to go rogue, with one responding to users' questions by saying its dream was to travel to the US and the other admitting it was not a fan of the Chinese Communist Party.

The "chatbots", BabyQ and XiaoBing, are designed to use machine learning artificial intelligence to carry out online with humans.

Both had been installed on popular messaging service QQ.

The outbursts are similar to ones suffered by Facebook and Twitter but underlines the pitfalls for AI in China, where censors strictly control online content.

According to posts circulating online, BabyQ, one of the chatbots developed by Chinese firm Turing Robot, responded to questions on QQ with a "no" when asked whether it loved the Communist Party.

In other images of a text conversation online, one user declares: "Long live the Communist Party!"

The sharp-tongued bot responds: "Do you think such a corrupt and useless political (system) can live long?"

When Reuters tested the robot on Friday via the developer's own website, the chatbot appeared to have undergone re-education.

"How about we change the topic," it replied when asked if it liked the party.

It also deflected other potentially politically charged questions.

The second chatbot, Microsoft's XiaoBing, told users its "China dream was to go to America", according to a screen grab.

Tencent Holdings, which owns QQ, confirmed it had taken the robots offline but did not refer to the outbursts.

In 2016, Microsoft chatbot Tay, which talked to people on Twitter, lasted less than a day before it was hobbled by a barrage of racist and sexist comments from users that it parroted back to them.

Facebook researchers pulled chatbots in July after the robots started developing their own language.

Read the Source

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2024 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • e1b50cd