Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse

Incident 1177: Purported AI Monitoring Software Reportedly Flags Unsent Joke Threat, Leading to Arizona Student Suspension

Description: AI monitoring software on a school-issued laptop reportedly flagged a Marana High School (of Arizona) student's allegedly unsent joke email containing a violent threat. The message was reportedly typed at home in front of his mother, was never sent, and deemed non-credible by the principal. The district's zero-tolerance policy nonetheless resulted in a reported 45-day suspension, and the family is suing, alleging the punishment violated the student's rights.

Tools

New ReportNew ReportNew ResponseNew ResponseDiscoverDiscoverView HistoryView History

Entities

View all entities
Alleged: Unknown AI monitoring software developer developed an AI system deployed by Marana Unified School District and Marana High School, which harmed Unnamed Marana High School student's family , Unnamed Marana High School student , Students of Marana Unified School District and Students of Marana High School.
Alleged implicated AI system: Unknown AI monitoring software

Incident Stats

Incident ID
1177
Report Count
1
Incident Date
2025-08-14
Editors
Daniel Atherton

Incident Reports

Reports Timeline

Incident OccurrenceArizona family sues after student suspended for threat joke that was typed but never sent
Loading...
Arizona family sues after student suspended for threat joke that was typed but never sent

Arizona family sues after student suspended for threat joke that was typed but never sent

ktar.com

Loading...
Arizona family sues after student suspended for threat joke that was typed but never sent
ktar.com · 2025

PHOENIX -- Is a threat real if it's never made?

That's the question at the center of a lawsuit filed by the parents of an Arizona student who was suspended under his school's threat and intimidation policy over a joke he made at home.

The f…

Variants

A "variant" is an AI incident similar to a known case—it has the same causes, harms, and AI system. Instead of listing it separately, we group it under the first reported incident. Unlike other incidents, variants do not need to have been reported outside the AIID. Learn more from the research paper.
Seen something similar?

Similar Incidents

By textual similarity

Did our AI mess up? Flag the unrelated incidents

Loading...
Alexa Recommended Dangerous TikTok Challenge to Ten-Year-Old Girl

Alexa Recommended Dangerous TikTok Challenge to Ten-Year-Old Girl

Dec 2021 · 3 reports
Loading...
YouTube's AI Mistakenly Banned Chess Channel over Chess Language Misinterpretation

YouTube's AI Mistakenly Banned Chess Channel over Chess Language Misinterpretation

Jun 2020 · 6 reports
Loading...
Security Robot Rolls Over Child in Mall

Security Robot Rolls Over Child in Mall

Jul 2016 · 27 reports
Previous IncidentNext Incident

Similar Incidents

By textual similarity

Did our AI mess up? Flag the unrelated incidents

Loading...
Alexa Recommended Dangerous TikTok Challenge to Ten-Year-Old Girl

Alexa Recommended Dangerous TikTok Challenge to Ten-Year-Old Girl

Dec 2021 · 3 reports
Loading...
YouTube's AI Mistakenly Banned Chess Channel over Chess Language Misinterpretation

YouTube's AI Mistakenly Banned Chess Channel over Chess Language Misinterpretation

Jun 2020 · 6 reports
Loading...
Security Robot Rolls Over Child in Mall

Security Robot Rolls Over Child in Mall

Jul 2016 · 27 reports

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2024 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • b9764d4