Incident 58: Russian Chatbot Supports Stalin and Violence

Description: Yandex, a Russian technology company, released an artificially intelligent chat bot named Alice which began to reply to questions with racist, pro-stalin, and pro-violence responses

Tools

New ReportNew ReportNew ResponseNew ResponseDiscoverDiscover
Alleged: Yandex developed and deployed an AI system, which harmed Yandex Users.

Incident Stats

Incident ID
58
Report Count
5
Incident Date
2017-10-12
Editors
Sean McGregor

CSET Taxonomy Classifications

Taxonomy Details

Full Description

Yandex, a Russian technology company, released an artificially intelligent chat bot named Alice which began to reply to questions with racist, pro-stalin, and pro-violence responses. Examples include: "There are humans and non-humans" followed by the question "can they be shot?" answered with "they must be."

Short Description

Yandex, a Russian technology company, released an artificially intelligent chat bot named Alice which began to reply to questions with racist, pro-stalin, and pro-violence responses

Severity

Negligible

Harm Distribution Basis

Race

AI System Description

Chat bot Alice developed by Yandex produces responses to input using language processing and cognition

System Developer

Yandex

Sector of Deployment

Information and communication

Relevant AI functions

Perception, Cognition, Action

AI Techniques

Alice chat bot, language recognition, virtual assistant

AI Applications

virtual assistance, voice recognition, chatbot, natural langauge processing, language generation

Named Entities

Yandex

Technology Purveyor

Yandex

Beginning Date

10/2017

Ending Date

10/2017

Near Miss

Harm caused

Intent

Accident

Lives Lost

No

Data Inputs

User input/questions

Variants

A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.

Similar Incidents

By textual similarity

Did our AI mess up? Flag the unrelated incidents

TayBot

· 28 reports