Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
発見する
投稿する
  • ようこそAIIDへ
  • インシデントを発見
  • 空間ビュー
  • テーブル表示
  • リスト表示
  • 組織
  • 分類法
  • インシデントレポートを投稿
  • 投稿ランキング
  • ブログ
  • AIニュースダイジェスト
  • リスクチェックリスト
  • おまかせ表示
  • サインアップ
閉じる
発見する
投稿する
  • ようこそAIIDへ
  • インシデントを発見
  • 空間ビュー
  • テーブル表示
  • リスト表示
  • 組織
  • 分類法
  • インシデントレポートを投稿
  • 投稿ランキング
  • ブログ
  • AIニュースダイジェスト
  • リスクチェックリスト
  • おまかせ表示
  • サインアップ
閉じる

レポート 4

関連インシデント

インシデント 113 Report
Google’s YouTube Kids App Presents Inappropriate Content

Loading...
YouTube has thousands of disturbing videos targeted at kids: Report
businessinsider.com · 2017

An off-brand Paw Patrol video called "Babies Pretend to Die Suicide" features several disturbing scenarios. YouTube

Parents who let their kids watch YouTube unattended might want to pay closer attention to what they're viewing.

YouTube is serving up to kids thousands of disturbing videos, many from obscure producers, that are sprinkled in with kid-friendly ones from well-known studios, according to analysis in a recent Medium post and past reporting from the BBC. At first glance, the inappropriate videos can be hard to distinguish from the benign ones, often involving well-known characters and themes. But they can often be violent or involve abuse to kids, and many appear to be generated automatically and cheaply in an apparent attempt to profit off the sometimes indiscriminate tastes of younger kids.

"The architecture [that Google and YouTube] have built to extract the maximum revenue from online video is being hacked by persons unknown to abuse children, perhaps not even deliberately, but at a massive scale," wrote writer and artist James Bridle, who took to Medium on Monday to help sound the alarm about the continuing phenomenon.

YouTube's recommended videos are a mix of branded and off-brand content featuring the same cast of characters. YouTube In a statement to Business Insider, YouTube said that while it is looking out for younger viewers, it's trying to keep its site as open as possible.

"We're always looking to improve the YouTube experience for all our users and that includes ensuring that our platform remains an open place for free communication while balancing the removal of controversial content," the company said in the statement. It continued: "In the last year, we have updated our advertising policy to clearly indicate that videos depicting family entertainment characters engaged in inappropriate behavior are not eligible for advertising on YouTube."

Peppa Pig's disturbing trip to the dentist

One video Bridle highlighted as "controversial" that hasn't been removed is a knockoff video of Peppa Pig, a popular animated character in the UK. The BBC first reported on the disturbing video in March. Posted to YouTube last year, the clip looks and sounds similar to a real Peppa Pig video and even involves a similar situation — going to the dentist.

But the knockoff video is punctuated with the disturbing sound of a child wailing in the background. When Peppa gets to the dentist's office, he injects her with a green serum and proceeds to pull out all her teeth. She then has to fight a sinister-looking masked monster. Needless to say, the real Peppa Pig's dental visit isn't nearly as horrifying.

That's just one of many disturbing pseudo-Peppa Pig videos on the site, Bridle said.

"Many are so close to the original, and so unsignposted — like the dentist example — that many, many kids are watching them," he wrote on Medium. "I understand that most of them are not trying to mess kids up, not really, even though they are."

But bogus Peppa Pig clips represent a small portion of the disturbing kids videos that can be found on the site, Bridle noted. There are thousands of other videos that may not show disturbing content per se, but are upsetting nonetheless, because they appear to be automatically generated based on popular keywords and tuned specifically to attract kids' clicks, according to Bridle.

"There are vast, vast numbers of these videos," Bridle said. "Channel after channel after channel of similar content, churned out at the rate of hundreds of new videos every week. Industrialized nightmare production."

It's unclear what motivates users to post the disturbing content to the site. Last year, in an attempt to discourage these types of videos, YouTube began pulling ads from videos that depict kids characters engaged in inappropriate behavior, removing the ability for the creators to make money off of them.

YouTube Kids may be designed for kids, but it's not a guaranteed refuge from inappropriate videos

YouTube says its main YouTube.com site and app are not intended to be used by kids younger than 13. However the main YouTube service contains plenty of kids videos. Meanwhile, the company does little to inform parents or kids that the service is not intended for younger children or to prevent kids from accessing it.

The company's notification that the main YouTube service is for people 13 and older is stated within point 12 of its Terms of Service, a document most users likely never see. The company does take steps to block kids younger than 13 from creating Google accounts — which are needed to subscribe to YouTube channels or upload videos to the service — and to prevent them from seeing some videos depicting sex or other adult themes. But most videos on the main YouTube service can be accessed without a Google account, and many kids view the site while logged into their parents' accounts.

Instead of having kids use its main site and app, YouTube recommends that parents direct their children to its

情報源を読む

リサーチ

  • “AIインシデント”の定義
  • “AIインシデントレスポンス”の定義
  • データベースのロードマップ
  • 関連研究
  • 全データベースのダウンロード

プロジェクトとコミュニティ

  • AIIDについて
  • コンタクトとフォロー
  • アプリと要約
  • エディタのためのガイド

インシデント

  • 全インシデントの一覧
  • フラグの立ったインシデント
  • 登録待ち一覧
  • クラスごとの表示
  • 分類法

2024 - AI Incident Database

  • 利用規約
  • プライバシーポリシー
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • e1b50cd