Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Entities

Disaster relief workers

Incidents Harmed By

Incident 7963 Report
Facebook's Content Moderation System Flagged and Removed Emergency Updates as Spam During Wildfires

2024-06-01

Facebook's AI moderation system wrongly flagged and removed dozens of posts containing vital emergency information during California's wildfire season, including real-time updates on evacuations and fire tracking. Posts from official sources like Cal Fire and the U.S. Forest Service were marked as spam, potentially endangering lives by restricting access to crucial updates. Despite user complaints, the issue persisted, with Facebook acknowledging the problem only after media inquiry.

More

Related Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
 

Entity

Meta

Incidents involved as both Developer and Deployer
  • Incident 796
    3 Reports

    Facebook's Content Moderation System Flagged and Removed Emergency Updates as Spam During Wildfires

More
Entity

Facebook

Incidents involved as both Developer and Deployer
  • Incident 796
    3 Reports

    Facebook's Content Moderation System Flagged and Removed Emergency Updates as Spam During Wildfires

More
Entity

California residents

Incidents Harmed By
  • Incident 796
    3 Reports

    Facebook's Content Moderation System Flagged and Removed Emergency Updates as Spam During Wildfires

More
Entity

Wildfire evacuees

Incidents Harmed By
  • Incident 796
    3 Reports

    Facebook's Content Moderation System Flagged and Removed Emergency Updates as Spam During Wildfires

More
Entity

Emergency responders

Incidents Harmed By
  • Incident 796
    3 Reports

    Facebook's Content Moderation System Flagged and Removed Emergency Updates as Spam During Wildfires

More
Entity

Fire safety coordinators

Incidents Harmed By
  • Incident 796
    3 Reports

    Facebook's Content Moderation System Flagged and Removed Emergency Updates as Spam During Wildfires

More
Entity

Facebook users

Incidents Harmed By
  • Incident 796
    3 Reports

    Facebook's Content Moderation System Flagged and Removed Emergency Updates as Spam During Wildfires

More
Entity

Facebook users in disaster zones

Incidents Harmed By
  • Incident 796
    3 Reports

    Facebook's Content Moderation System Flagged and Removed Emergency Updates as Spam During Wildfires

More

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2024 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • ecd56df