Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
発見する
投稿する
  • ようこそAIIDへ
  • インシデントを発見
  • 空間ビュー
  • テーブル表示
  • リスト表示
  • 組織
  • 分類法
  • インシデントレポートを投稿
  • 投稿ランキング
  • ブログ
  • AIニュースダイジェスト
  • リスクチェックリスト
  • おまかせ表示
  • サインアップ
閉じる
発見する
投稿する
  • ようこそAIIDへ
  • インシデントを発見
  • 空間ビュー
  • テーブル表示
  • リスト表示
  • 組織
  • 分類法
  • インシデントレポートを投稿
  • 投稿ランキング
  • ブログ
  • AIニュースダイジェスト
  • リスクチェックリスト
  • おまかせ表示
  • サインアップ
閉じる

インシデント 17: Inappropriate Gmail Smart Reply Suggestions

概要: Google's Gmail Smart Reply tool was over-recommending the response "I love you" in situations where it was deemed innappropriate.

ツール

新しいレポート新しいレポート新しいレスポンス新しいレスポンス発見する発見する履歴を表示履歴を表示

組織

すべての組織を表示
推定: Googleが開発し提供したAIシステムで、Gmail Usersに影響を与えた

インシデントのステータス

インシデントID
17
レポート数
22
インシデント発生日
2015-11-03
エディタ
Sean McGregor
Applied Taxonomies
CSETv0, CSETv1, GMF, MIT

CSETv0 分類法のクラス

分類法の詳細

Problem Nature

Indicates which, if any, of the following types of AI failure describe the incident: "Specification," i.e. the system's behavior did not align with the true intentions of its designer, operator, etc; "Robustness," i.e. the system operated unsafely because of features or changes in its environment, or in the inputs the system received; "Assurance," i.e. the system could not be adequately monitored or controlled during operation.
 

Specification

Physical System

Where relevant, indicates whether the AI system(s) was embedded into or tightly associated with specific types of hardware.
 

Software only

Level of Autonomy

The degree to which the AI system(s) functions independently from human intervention. "High" means there is no human involved in the system action execution; "Medium" means the system generates a decision and a human oversees the resulting action; "low" means the system generates decision-support output and a human makes a decision and executes an action.
 

High

Nature of End User

"Expert" if users with special training or technical expertise were the ones meant to benefit from the AI system(s)’ operation; "Amateur" if the AI systems were primarily meant to benefit the general public or untrained users.
 

Amateur

Public Sector Deployment

"Yes" if the AI system(s) involved in the accident were being used by the public sector or for the administration of public goods (for example, public transportation). "No" if the system(s) were being used in the private sector or for commercial purposes (for example, a ride-sharing company), on the other.
 

No

Data Inputs

A brief description of the data that the AI system(s) used or were trained on.
 

email text

CSETv1 分類法のクラス

分類法の詳細

Incident Number

The number of the incident in the AI Incident Database.
 

17

Special Interest Intangible Harm

An assessment of whether a special interest intangible harm occurred. This assessment does not consider the context of the intangible harm, if an AI was involved, or if there is characterizable class or subgroup of harmed entities. It is also not assessing if an intangible harm occurred. It is only asking if a special interest intangible harm occurred.
 

no

Date of Incident Year

The year in which the incident occurred. If there are multiple harms or occurrences of the incident, list the earliest. If a precise date is unavailable, but the available sources provide a basis for estimating the year, estimate. Otherwise, leave blank. Enter in the format of YYYY
 

2017

Date of Incident Month

The month in which the incident occurred. If there are multiple harms or occurrences of the incident, list the earliest. If a precise date is unavailable, but the available sources provide a basis for estimating the month, estimate. Otherwise, leave blank. Enter in the format of MM
 

11

Date of Incident Day

The day on which the incident occurred. If a precise date is unavailable, leave blank. Enter in the format of DD
 

03

Estimated Date

“Yes” if the data was estimated. “No” otherwise.
 

Yes

MIT 分類法のクラス

Machine-Classified
分類法の詳細

Risk Subdomain

A further 23 subdomains create an accessible and understandable classification of hazards and harms associated with AI
 

7.3. Lack of capability or robustness

Risk Domain

The Domain Taxonomy of AI Risks classifies risks into seven AI risk domains: (1) Discrimination & toxicity, (2) Privacy & security, (3) Misinformation, (4) Malicious actors & misuse, (5) Human-computer interaction, (6) Socioeconomic & environmental harms, and (7) AI system safety, failures & limitations.
 
  1. AI system safety, failures, and limitations

Entity

Which, if any, entity is presented as the main cause of the risk
 

AI

Timing

The stage in the AI lifecycle at which the risk is presented as occurring
 

Post-deployment

Intent

Whether the risk is presented as occurring as an expected or unexpected outcome from pursuing a goal
 

Unintentional

インシデントレポート

レポートタイムライン

+9
Soon, Gmail's AI Could Reply to Your Email for You
Google's Smart Reply: Convenience Over Connection+11
Ranking Gmail’s AI Fueled Smart Replies
Soon, Gmail's AI Could Reply to Your Email for You

Soon, Gmail's AI Could Reply to Your Email for You

wired.com

Google's Smart Reply Lets a Computer Answer Your Emails for You

Google's Smart Reply Lets a Computer Answer Your Emails for You

popularmechanics.com

Computer, respond to this email: Introducing Smart Reply in Inbox by Gmail

Computer, respond to this email: Introducing Smart Reply in Inbox by Gmail

blog.google

Google Inbox's new Smart Replies uses machine learning to speed up email responses

Google Inbox's new Smart Replies uses machine learning to speed up email responses

greenbot.com

Google Inbox Suggests Replies for Incoming Email

Google Inbox Suggests Replies for Incoming Email

techlicious.com

New Gmail feature scans your emails and suggests replies

New Gmail feature scans your emails and suggests replies

money.cnn.com

Google's new email feature will write replies for you

Google's new email feature will write replies for you

mashable.com

Google’s New Autoreply Sounds Great!!!!

Google’s New Autoreply Sounds Great!!!!

newyorker.com

Google's Email Replying AI Keeps Saying It Loves You

Google's Email Replying AI Keeps Saying It Loves You

escapistmagazine.com

Google's Smart Reply: Convenience Over Connection

Google's Smart Reply: Convenience Over Connection

thetechnoskeptic.com

Ranking Gmail’s AI Fueled Smart Replies

Ranking Gmail’s AI Fueled Smart Replies

nymag.com

Gmail's Smart Reply Blurs the Line Between People and Brands

Gmail's Smart Reply Blurs the Line Between People and Brands

dailydot.com

Is This Article Worth Reading? Gmail’s Suggested Reply: ‘Haha, Thanks!’

Is This Article Worth Reading? Gmail’s Suggested Reply: ‘Haha, Thanks!’

wsj.com

Gmail users will be able to opt out of Smart Replies on desktop

Gmail users will be able to opt out of Smart Replies on desktop

engadget.com

Smart Reply Not Smart Enough? Desktop Gmail Users Can Soon Opt Out

Smart Reply Not Smart Enough? Desktop Gmail Users Can Soon Opt Out

digitaltrends.com

Gmail Smart Reply goofed w/ 'Sent from my iPhone'

Gmail Smart Reply goofed w/ 'Sent from my iPhone'

9to5google.com

Neira Jones on Twitter

Neira Jones on Twitter

twitter.com

You can turn off Gmail's creepy Smart Replies on desktop too - just not yet

You can turn off Gmail's creepy Smart Replies on desktop too - just not yet

trustedreviews.com

Google tweaked its Smart Reply feature because it would repeatedly suggest users send 'I love you'

Google tweaked its Smart Reply feature because it would repeatedly suggest users send 'I love you'

dailymail.co.uk

Google changed Gmail's Smart Reply after AI kept suggesting I love you

Google changed Gmail's Smart Reply after AI kept suggesting I love you

businessinsider.com

Gmail smart compose: Will it change how we write emails?

Gmail smart compose: Will it change how we write emails?

qz.com

Google ends support for Reply, which added smart replies to third-party apps

Google ends support for Reply, which added smart replies to third-party apps

theverge.com

Soon, Gmail's AI Could Reply to Your Email for You
wired.com · 2015

Ever wished your phone could automatically reply to your email messages?

Well, Google just unveiled technology that's at least moving in that direction. Using what's called "deep learning"—a form of artificial intelligence that's rapidly re…

Google's Smart Reply Lets a Computer Answer Your Emails for You
popularmechanics.com · 2015

Just a few months ago, Google really started showing off its newest secret weapon: a robot brain that learns. Using machine learning algorithms that actually get smarter as they practice, Google's been able to identify your loved ones in yo…

Computer, respond to this email: Introducing Smart Reply in Inbox by Gmail
blog.google · 2015

There's actually a lot going on behind the scenes to make Smart Reply work. Inbox uses machine learning to recognize emails that need responses and to generate the natural language responses on the fly. If you're interested in how Smart Rep…

Google Inbox's new Smart Replies uses machine learning to speed up email responses
greenbot.com · 2015

Not every email deserves a handcrafted response. Sometimes, all it takes is a sentence to answer the one burning question that someone has dropped in your inbox, which is why Google is using the power of machine learning to make email triag…

Google Inbox Suggests Replies for Incoming Email
techlicious.com · 2015

Replying to routine email requests just got easier with a new smart reply feature for Gmail users who get their email through Google Inbox. Starting this week, the app's Smart Reply feature will analyze incoming email messages and offer a s…

New Gmail feature scans your emails and suggests replies
money.cnn.com · 2015

Google will soon scan the content of your emails and serve up what it thinks is the perfect reply.

The new feature, called Smart Reply, identifies Gmail emails that require a response and presents three options for replies. Smart Reply will…

Google's new email feature will write replies for you
mashable.com · 2015

When Google launched Inbox, its most recent email app from the Gmail team, it touted the app's ability to act almost like an assistant. Now, a year later, Google is making the app more like an aide than ever.

The company will soon be rollin…

Google’s New Autoreply Sounds Great!!!!
newyorker.com · 2015

On April 1, 2009, Google unveiled Gmail Autopilot, a plug-in that promised to read and generate contextually relevant replies to the messages piling up in users’ inboxes. “As more and more everyday communication takes place over email, lots…

Google's Email Replying AI Keeps Saying It Loves You
escapistmagazine.com · 2015

A system Google designed for replying to emails proved a little friendlier than anyone expected.

There are quite a few humans out there who are absolutely convinced robots will kill us the moment they become self-aware. But what if the exac…

Google's Smart Reply: Convenience Over Connection
thetechnoskeptic.com · 2017

If you use Google products for email, you may have noticed those suggested replies at the bottom of your mobile inbox. These give users options to choose short and snappy responses to emails, such as, “Will do,” “I am working on that now,” …

Ranking Gmail’s AI Fueled Smart Replies
nymag.com · 2018

Image: Google: Photo: Konstantin Sergeyev

The most recognizable feature of Gmail’s newly rolled-out redesign is the so-called smart reply, wherein bots offer three one-click responses to each mail message. Say your email contains the words …

Gmail's Smart Reply Blurs the Line Between People and Brands
dailydot.com · 2018

“Thanks for letting me know.”

Have you noticed an uptick in this phrase appearing in emails, on social media, and IRL? Do you find yourself saying it even though maybe a year ago you would never use the phrase? Is there a new wave of semi-f…

Is This Article Worth Reading? Gmail’s Suggested Reply: ‘Haha, Thanks!’
wsj.com · 2018

When Jess Klein emailed her mother to make plans, the response startled her.

“Cool, see you there.”

Ms. Klein, a 38-year-old from Brooklyn, was suspicious. “Why is my mom talking like a Valley Girl?” she wondered.

She...

Gmail users will be able to opt out of Smart Replies on desktop
engadget.com · 2018

Around 10 percent of Gmail responses are now generated with the Smart Reply feature, according to the Wall Street Journal, and it has been available on Gmail apps since last year. Ajit Varma, Google's director of product management, told th…

Smart Reply Not Smart Enough? Desktop Gmail Users Can Soon Opt Out
digitaltrends.com · 2018

After users complained that Gmail’s Smart Reply wasn’t so smart, Google announced that it will soon give desktop users the ability to disable the A.I.-based feature. Although the time-saving feature relies on artificial intelligence to come…

Gmail Smart Reply goofed w/ 'Sent from my iPhone'
9to5google.com · 2018

The Wall Street Journal is out today with a quick story on the rollout and reception of Gmail’s new Smart Reply feature, and it comes with a few interesting bits of information and anecdotes from random users and Google alike — one of which…

Neira Jones on Twitter
twitter.com · 2018

Romantic AI: Google Had to Change Gmail's New Smart Reply Responses Because it Kept Suggesting "I Love You"

You can turn off Gmail's creepy Smart Replies on desktop too - just not yet
trustedreviews.com · 2018

How do you feel about Gmail’s new Smart Reply tool? We’re hearing mixed reports. On one hand it’s super handy to be able to tap/click that “Thank you so much!” button when you’re in a rush.

However, users are reporting the suggestions aren’…

Google tweaked its Smart Reply feature because it would repeatedly suggest users send 'I love you'
dailymail.co.uk · 2018

Google recently made its handy 'Smart Reply' feature available to Gmail's 1 billion-plus users.

But early prototypes of the tool didn't work so seamlessly, according to the Wall Street Journal.

In one case, the algorithms powering Gmail's '…

Google changed Gmail's Smart Reply after AI kept suggesting I love you
businessinsider.com · 2018

A few days ago, I received a short, effective email in my inbox: "Sounds good!"

I had to pause. Although that was the response I wanted — I was arranging a meeting — I wondered: Did he really send that, or did he simply hit Google's automat…

Gmail smart compose: Will it change how we write emails?
qz.com · 2018

From: Corinne Purtill (Quartz)

To: Corinne Purtill (Gmail)

Mon, Oct 1, 2018 at 11:08 AM

At its annual developers conference earlier this year Google introduced “smart compose,” a new Gmail feature that helps users complete their sentences. …

Google ends support for Reply, which added smart replies to third-party apps
theverge.com · 2018

Google will no longer continue support for Reply, an experimental app that offers smart reply responses to various messaging apps such as Slack, Hangouts, and Messenger. The app launched earlier this year as part of Google’s Area 120 divisi…

バリアント

「バリアント」は既存のAIインシデントと同じ原因要素を共有し、同様な被害を引き起こし、同じ知的システムを含んだインシデントです。バリアントは完全に独立したインシデントとしてインデックスするのではなく、データベースに最初に投稿された同様なインシデントの元にインシデントのバリエーションとして一覧します。インシデントデータベースの他の投稿タイプとは違い、バリアントではインシデントデータベース以外の根拠のレポートは要求されません。詳細についてはこの研究論文を参照してください

よく似たインシデント

テキスト類似度による

Did our AI mess up? Flag the unrelated incidents

TayBot

Danger, danger! 10 alarming examples of AI gone wild

Mar 2016 · 28 レポート
High-Toxicity Assessed on Text Involving Women and Minority Groups

Google’s comment-ranking system will be a hit with the alt-right

Feb 2017 · 9 レポート
Nest Smoke Alarm Erroneously Stops Alarming

Google's Nest Stops Selling Its Smart Smoke Alarm For Now Due To Faulty Feature

Jan 2014 · 6 レポート
前のインシデント次のインシデント

よく似たインシデント

テキスト類似度による

Did our AI mess up? Flag the unrelated incidents

TayBot

Danger, danger! 10 alarming examples of AI gone wild

Mar 2016 · 28 レポート
High-Toxicity Assessed on Text Involving Women and Minority Groups

Google’s comment-ranking system will be a hit with the alt-right

Feb 2017 · 9 レポート
Nest Smoke Alarm Erroneously Stops Alarming

Google's Nest Stops Selling Its Smart Smoke Alarm For Now Due To Faulty Feature

Jan 2014 · 6 レポート

リサーチ

  • “AIインシデント”の定義
  • “AIインシデントレスポンス”の定義
  • データベースのロードマップ
  • 関連研究
  • 全データベースのダウンロード

プロジェクトとコミュニティ

  • AIIDについて
  • コンタクトとフォロー
  • アプリと要約
  • エディタのためのガイド

インシデント

  • 全インシデントの一覧
  • フラグの立ったインシデント
  • 登録待ち一覧
  • クラスごとの表示
  • 分類法

2024 - AI Incident Database

  • 利用規約
  • プライバシーポリシー
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • ecd56df