Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse

Report 107

Associated Incidents

Incident 1722 Report
Inappropriate Gmail Smart Reply Suggestions

Loading...
Google changed Gmail's Smart Reply after AI kept suggesting I love you
businessinsider.com · 2018

A few days ago, I received a short, effective email in my inbox: "Sounds good!"

I had to pause. Although that was the response I wanted — I was arranging a meeting — I wondered: Did he really send that, or did he simply hit Google's automated response suggestions at the bottom?

In recent weeks, Gmail's "Smart Reply" feature has been released to an ever-rising amount of the web email service's over 1.4 billion users, meaning that soon a large percentage of the world's population will get access to Google's cheery, direct suggestions when it becomes a default feature next month.

The actual language of the suggestions is created with machine learning, a family of technologies that is sometimes called artificial intelligence in the non-technical world.

Google

Google's software crawls billions of emails on Gmail, and then uses software to suggest phrases drawn from that database that you might want to use to confirm a coffee at 4 PM at Blue Bottle. 10% of responses are generated through the Smart Reply feature, according to The Wall Street Journal.

But it hasn't always worked well enough — a director of product management at Google, Ajit Varma, shared some funny early bugs with the Journal.

From the story:

Google said an early prototype of the feature had "a propensity to respond with 'I love you' to seemingly anything," forcing it to tweak the algorithm. "You don't want to respond that to your boss," Mr. Varma said.

Imagine trying to organize a conference call with a client and accidentally sending "I love you."

Another funny suggestion the software kept repeating is a nod to Google's neighbors in Silicon Valley, Apple. Apparently, the software thought "Sent from my iPhone" was a good way to respond to emails.

That's the default signature on the default email app on iPhones, so it shows up all the time in Google's data. And Google's machine learning software, as smart as it was, isn't actually a human, so it didn't realize that was a clever bit of branding, and not any kind of useful information.

Same with "I love you" — while Smart Reply is impressive, it doesn't understand social context yet.

But the software does learn: Google says that as you use it more, the style and tone will become more personalized to you.

Sounds good!

Read the Source

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2024 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • e1b50cd