Incident 570: Facebook Messenger AI Stickers Generate Ethical and Content Moderation Concerns

Description: Facebook Messenger AI stickers, a feature by Meta, allows users to generate personalized stickers via AI for use in conversations. While the feature has been praised for its creativity, it has also stirred controversy for its alleged production of inappropriate or offensive content. This has raised questions about the effectiveness of Meta's content moderation measures and the ethical responsibilities associated with AI-driven content generation.

Tools

New ReportNew ReportNew ResponseNew ResponseDiscoverDiscoverView HistoryView History
Alleged: Meta developed and deployed an AI system, which harmed Facebook Messenger users.

Incident Stats

Incident ID
570
Report Count
1
Incident Date
2023-10-04
Editors
Daniel Atherton
Facebook’s new AI-generated stickers are lewd, rude, and occasionally nude
theverge.com · 2023

Some early user tests for Meta’s new AI-generated sticker tool have resulted in some dubious (and rather hilarious) creations. After gaining access to the new AI-generated sticker tool on Facebook Messenger, X user @Pioldes was able to crea…

Variants

A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.