Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
発見する
投稿する
  • ようこそAIIDへ
  • インシデントを発見
  • 空間ビュー
  • テーブル表示
  • リスト表示
  • 組織
  • 分類法
  • インシデントレポートを投稿
  • 投稿ランキング
  • ブログ
  • AIニュースダイジェスト
  • リスクチェックリスト
  • おまかせ表示
  • サインアップ
閉じる
発見する
投稿する
  • ようこそAIIDへ
  • インシデントを発見
  • 空間ビュー
  • テーブル表示
  • リスト表示
  • 組織
  • 分類法
  • インシデントレポートを投稿
  • 投稿ランキング
  • ブログ
  • AIニュースダイジェスト
  • リスクチェックリスト
  • おまかせ表示
  • サインアップ
閉じる

インシデント 55: Alexa Plays Pornography Instead of Kids Song

概要: An Amazon Echo Dot using the Amazon Alex software started to play pornographic results when a child asked it to play a song.

ツール

新しいレポート新しいレポート新しいレスポンス新しいレスポンス発見する発見する履歴を表示履歴を表示

組織

すべての組織を表示
推定: Amazonが開発し提供したAIシステムで、Childrenに影響を与えた

インシデントのステータス

インシデントID
55
レポート数
16
インシデント発生日
2016-12-30
エディタ
Sean McGregor
Applied Taxonomies
CSETv0, CSETv1, GMF, MIT

CSETv0 分類法のクラス

分類法の詳細

Problem Nature

Indicates which, if any, of the following types of AI failure describe the incident: "Specification," i.e. the system's behavior did not align with the true intentions of its designer, operator, etc; "Robustness," i.e. the system operated unsafely because of features or changes in its environment, or in the inputs the system received; "Assurance," i.e. the system could not be adequately monitored or controlled during operation.
 

Robustness, Assurance

Physical System

Where relevant, indicates whether the AI system(s) was embedded into or tightly associated with specific types of hardware.
 

Consumer device

Level of Autonomy

The degree to which the AI system(s) functions independently from human intervention. "High" means there is no human involved in the system action execution; "Medium" means the system generates a decision and a human oversees the resulting action; "low" means the system generates decision-support output and a human makes a decision and executes an action.
 

High

Nature of End User

"Expert" if users with special training or technical expertise were the ones meant to benefit from the AI system(s)’ operation; "Amateur" if the AI systems were primarily meant to benefit the general public or untrained users.
 

Amateur

Public Sector Deployment

"Yes" if the AI system(s) involved in the accident were being used by the public sector or for the administration of public goods (for example, public transportation). "No" if the system(s) were being used in the private sector or for commercial purposes (for example, a ride-sharing company), on the other.
 

No

Data Inputs

A brief description of the data that the AI system(s) used or were trained on.
 

Voice commands

CSETv1 分類法のクラス

分類法の詳細

Incident Number

The number of the incident in the AI Incident Database.
 

55

Notes (special interest intangible harm)

Input any notes that may help explain your answers.
 

Alexa produced inappropriate response/content for child user.

Special Interest Intangible Harm

An assessment of whether a special interest intangible harm occurred. This assessment does not consider the context of the intangible harm, if an AI was involved, or if there is characterizable class or subgroup of harmed entities. It is also not assessing if an intangible harm occurred. It is only asking if a special interest intangible harm occurred.
 

yes

Date of Incident Year

The year in which the incident occurred. If there are multiple harms or occurrences of the incident, list the earliest. If a precise date is unavailable, but the available sources provide a basis for estimating the year, estimate. Otherwise, leave blank. Enter in the format of YYYY
 

2016

Date of Incident Month

The month in which the incident occurred. If there are multiple harms or occurrences of the incident, list the earliest. If a precise date is unavailable, but the available sources provide a basis for estimating the month, estimate. Otherwise, leave blank. Enter in the format of MM
 

12

Estimated Date

“Yes” if the data was estimated. “No” otherwise.
 

No

MIT 分類法のクラス

Machine-Classified
分類法の詳細

Risk Subdomain

A further 23 subdomains create an accessible and understandable classification of hazards and harms associated with AI
 

1.2. Exposure to toxic content

Risk Domain

The Domain Taxonomy of AI Risks classifies risks into seven AI risk domains: (1) Discrimination & toxicity, (2) Privacy & security, (3) Misinformation, (4) Malicious actors & misuse, (5) Human-computer interaction, (6) Socioeconomic & environmental harms, and (7) AI system safety, failures & limitations.
 
  1. Discrimination and Toxicity

Entity

Which, if any, entity is presented as the main cause of the risk
 

AI

Timing

The stage in the AI lifecycle at which the risk is presented as occurring
 

Post-deployment

Intent

Whether the risk is presented as occurring as an expected or unexpected outcome from pursuing a goal
 

Unintentional

インシデントレポート

レポートタイムライン

+13
Kid Gets Amazon Echo Dot Alexa to Play Porn
Amazon Echo’s Alexa is turning out to be a bad influence on our kidsHow to Make Amazon's Alexa a Little More Kid-FriendlyAlexa fails: when virtual assistants go very, very wrong
Kid Gets Amazon Echo Dot Alexa to Play Porn

Kid Gets Amazon Echo Dot Alexa to Play Porn

nymag.com

Amazon's Alexa misunderstands boy's request and rattles off PORNOGRAPHIC phrases

Amazon's Alexa misunderstands boy's request and rattles off PORNOGRAPHIC phrases

dailymail.co.uk

Shocking moment Amazon's Alexa starts spouting crude porno messages to toddler

Shocking moment Amazon's Alexa starts spouting crude porno messages to toddler

thesun.co.uk

Amazon Alexa Makes It To Naughty List With NSFW Tirade In Front Of A Child

Amazon Alexa Makes It To Naughty List With NSFW Tirade In Front Of A Child

itechpost.com

Alexa Has Very Explicit Response To Toddler’s Seemingly Innocent Song Request

Alexa Has Very Explicit Response To Toddler’s Seemingly Innocent Song Request

consumerist.com

Kid Asks Amazon Alexa To Play Something, Gets Porn Instead

Kid Asks Amazon Alexa To Play Something, Gets Porn Instead

cinemablend.com

Kid Asks A Digital Assistant For A Song, Gets Porn In Response

Kid Asks A Digital Assistant For A Song, Gets Porn In Response

huffingtonpost.com.au

Whoops, Alexa Plays Porn Instead of a Kids Song!

Whoops, Alexa Plays Porn Instead of a Kids Song!

entrepreneur.com

Boy requests song from Amazon Alexa, but gets porn instead

Boy requests song from Amazon Alexa, but gets porn instead

10news.com

What is the Kid in the Alexa Video Asking to Hear Before Alexa Goes Wild? [VIDEO]

What is the Kid in the Alexa Video Asking to Hear Before Alexa Goes Wild? [VIDEO]

wkdq.com

Better watch what you say to Amazon Echo Dot: One toddler got an earful of vulgar porn phrases

Better watch what you say to Amazon Echo Dot: One toddler got an earful of vulgar porn phrases

lifesitenews.com

Fails And Facepalms With Amazon’s Alexa: Don’t Let The Kids Near That Thing

Fails And Facepalms With Amazon’s Alexa: Don’t Let The Kids Near That Thing

inquisitr.com

‘Alexa, sort your life out’: when Amazon Echo goes rogue

‘Alexa, sort your life out’: when Amazon Echo goes rogue

theguardian.com

Amazon Echo’s Alexa is turning out to be a bad influence on our kids

Amazon Echo’s Alexa is turning out to be a bad influence on our kids

sheknows.com

How to Make Amazon's Alexa a Little More Kid-Friendly

How to Make Amazon's Alexa a Little More Kid-Friendly

digitaltrends.com

Alexa fails: when virtual assistants go very, very wrong

Alexa fails: when virtual assistants go very, very wrong

verdict.co.uk

Kid Gets Amazon Echo Dot Alexa to Play Porn
nymag.com · 2016

After opening a new Amazon Echo Dot for Christmas, one family got an … interesting surprise when their kid sidled up to the device to ask it to play a song by holding the little robot in both hands and shouting into the microphone. It’s ver…

Amazon's Alexa misunderstands boy's request and rattles off PORNOGRAPHIC phrases
dailymail.co.uk · 2016

A little boy got more than he bargained for when he asked his family's new Amazon Echo Dot to play him some of his favorite kid's songs.

A hilarious YouTube video sees a boy named William holding the smart speaker while asking the Alexa voi…

Shocking moment Amazon's Alexa starts spouting crude porno messages to toddler
thesun.co.uk · 2016

SHOCKING video has emerged showing Amazon’s Alexa bombarding a toddler with crude porno messages.

Footage shows a little boy talking into an Amazon Echo Dot gadget as family members watch on.

YouTube/f0t0b0y 4 Footage shows the little boy t…

Amazon Alexa Makes It To Naughty List With NSFW Tirade In Front Of A Child
itechpost.com · 2016

Amazon Alexa Makes It To Naughty List With NSFW Tirade In Front Of A Child

Close

All he wanted was to hear a nursery song.

A YouTube video posted last Dec. 29 has become viral with 1.2 million views as of this writing. The video shows a lit…

Alexa Has Very Explicit Response To Toddler’s Seemingly Innocent Song Request
consumerist.com · 2016

In what could either be an innocent mistake or a set-up by wise adults, Amazon’s virtual assistant Alexa gave one toddler a very interesting answer to his request to hear a specific song.

“Alexa, play ‘Digger, Digger,'” the tyke tells an Ec…

Kid Asks Amazon Alexa To Play Something, Gets Porn Instead
cinemablend.com · 2017

Kid Asks Amazon Alexa To Play Something, Gets Porn Instead Corey Chichizola Random Article Blend There is no time like Christmas for kids. Essentially winning the lottery every year, it's a joy to see the children in our family anxiously aw…

Kid Asks A Digital Assistant For A Song, Gets Porn In Response
huffingtonpost.com.au · 2017

A family got a nasty surprise when their little boy asked Amazon's digital assistant 'Alexa' to play some of his favourite songs, with the device serving up porn suggestions instead of tunes.

The video posted on YouTube sees the adorable to…

Whoops, Alexa Plays Porn Instead of a Kids Song!
entrepreneur.com · 2017

In this NSFW video, Amazon put the "X" in Alexa when a child asked it to play his favorite song. (You'll want to wear headphones for this one, folks.)

January 3, 2017 1 min read

The description on this YouTube video posted by f0t0b0y reads,…

Boy requests song from Amazon Alexa, but gets porn instead
10news.com · 2017

A video posted last week by YouTube user "F0t0b0y" has been viewed more than 7 million times showing a toddler requesting a song from an Amazon device only to get a raunchy response from the device.

The video titled "Amazon Alexa Gone Wild"…

What is the Kid in the Alexa Video Asking to Hear Before Alexa Goes Wild? [VIDEO]
wkdq.com · 2017

If you haven't seen the funniest video to come out this past month, you must be living under a rock. This video shows a little kid asking Alexa to play a song, and Alexa goes rogue and starts making some very NSFW suggestions to the child!

…
Better watch what you say to Amazon Echo Dot: One toddler got an earful of vulgar porn phrases
lifesitenews.com · 2017

NewsPornography

SEATTLE, Washington, January 6, 2017 (LifeSiteNews) — Amazon's Echo Dot is a small, voice-command device that answers questions, plays music and sounds, and basically functions as a talking/playing encyclopedia, but parents …

Fails And Facepalms With Amazon’s Alexa: Don’t Let The Kids Near That Thing
inquisitr.com · 2017

So you thought AI is cool? So you thought you could have Alexa watch over your kid? Wait till that AI starts spewing dirty words and purchasing expensive toys for your kid.

CES 2017 was a flurry of crazy tech and this year, Amazon’s AI call…

‘Alexa, sort your life out’: when Amazon Echo goes rogue
theguardian.com · 2017

Amazon Echo is apparently always ready, always listening and always getting smarter. So goes the spiel about the sleek, black, voice-controlled speaker, Amazon’s bestselling product over Christmas, with millions now sold worldwide. The prob…

Amazon Echo’s Alexa is turning out to be a bad influence on our kids
sheknows.com · 2017

We can’t keep our kids away from our gadgets, and the new Amazon Echo, the online retail giant’s bestselling product over Christmas, is no exception.

If you don’t already know, Amazon Echo — now in millions of homes worldwide — is a voice-c…

How to Make Amazon's Alexa a Little More Kid-Friendly
digitaltrends.com · 2017

Share

Of the myriad descriptions being levied on Amazon’s Alexa “smart home” system, its creators probably weren’t expecting the phrase “parenting nightmare.” Yet that description has come up again and again as parents discover the new and …

Alexa fails: when virtual assistants go very, very wrong
verdict.co.uk · 2017

Luke is the deputy editor of Verdict. You can reach him at luke.christou@verdict.co.uk

Virtual assistants, such as Amazon Alexa and Apple’s Siri, are supposed to make our busy lives slightly easier.

Rather than wasting valuable seconds sett…

バリアント

「バリアント」は既存のAIインシデントと同じ原因要素を共有し、同様な被害を引き起こし、同じ知的システムを含んだインシデントです。バリアントは完全に独立したインシデントとしてインデックスするのではなく、データベースに最初に投稿された同様なインシデントの元にインシデントのバリエーションとして一覧します。インシデントデータベースの他の投稿タイプとは違い、バリアントではインシデントデータベース以外の根拠のレポートは要求されません。詳細についてはこの研究論文を参照してください

よく似たインシデント

テキスト類似度による

Did our AI mess up? Flag the unrelated incidents

Amazon Alexa Responding to Environmental Inputs

Top 5 AI Failures From 2017 Which Prove That ‘Perfect AI’ Is Still A Dream

Dec 2015 · 35 レポート
Google’s YouTube Kids App Presents Inappropriate Content

Google’s YouTube Kids App Criticized for ‘Inappropriate Content’

May 2015 · 14 レポート
Amazon Alexa Plays Loud Music when Owner is Away

Top 5 AI Failures From 2017 Which Prove That ‘Perfect AI’ Is Still A Dream

Nov 2017 · 4 レポート
前のインシデント次のインシデント

よく似たインシデント

テキスト類似度による

Did our AI mess up? Flag the unrelated incidents

Amazon Alexa Responding to Environmental Inputs

Top 5 AI Failures From 2017 Which Prove That ‘Perfect AI’ Is Still A Dream

Dec 2015 · 35 レポート
Google’s YouTube Kids App Presents Inappropriate Content

Google’s YouTube Kids App Criticized for ‘Inappropriate Content’

May 2015 · 14 レポート
Amazon Alexa Plays Loud Music when Owner is Away

Top 5 AI Failures From 2017 Which Prove That ‘Perfect AI’ Is Still A Dream

Nov 2017 · 4 レポート

リサーチ

  • “AIインシデント”の定義
  • “AIインシデントレスポンス”の定義
  • データベースのロードマップ
  • 関連研究
  • 全データベースのダウンロード

プロジェクトとコミュニティ

  • AIIDについて
  • コンタクトとフォロー
  • アプリと要約
  • エディタのためのガイド

インシデント

  • 全インシデントの一覧
  • フラグの立ったインシデント
  • 登録待ち一覧
  • クラスごとの表示
  • 分類法

2024 - AI Incident Database

  • 利用規約
  • プライバシーポリシー
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • ecd56df