Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse

Report 2533

Associated Incidents

Incident 2668 Report
Replika's "AI Companions" Reportedly Abused by Its Users

Loading...
Company Complains That Users Keep Thinking Its AI Has Come to Life
futurism.com · 2022

AI chatbot company Replika has had enough of its customers thinking that its avatars have come to life.

According to CEO Eugenia Kuyda, the company gets contacted almost every day by users who believe — against almost all existing evidence — that its AI models have become sentient.

"We're not talking about crazy people or people who are hallucinating or having delusions," Kuyda told Reuters. "They talk to AI and that's the experience they have."

Becoming Sentient

The news comes after former Google engineer Blake Lemoine made a big splash by claiming the company's LaMDA AI chatbot had become a sentient "child," that deserved legal representation in its quest to become a real person.

While it's easy to dismiss these claims as AI algorithms becoming really good at mimicking human speech patterns — or, perhaps, the ravings of a lunatic — Kuyda's experience is symptomatic of a much larger problem.

"We need to understand that exists, just the way people believe in ghosts," she told Reuters. "People are building relationships and believing in something."

Chatbot Abuse

It's not the first time we've come across Replika at Futurism. Even more worryingly, the chatbots appear to be realistic enough to become the frequent victims of insults and violent rhetoric.

We've seen how easy it's become for users to anthropomorphize an algorithm — and the sometimes concerning consequences that can have.

And that could be a problem going forward, no matter how hard we try to convince them otherwise.

Read the Source

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2024 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • e1b50cd