Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse

Incident 892: Apple Intelligence Allegedly Flags Scam Messages as High Priority

Description: Apple’s AI notification summarization and prioritization feature, part of the Apple Intelligence update, has reportedly flagged scam and phishing messages as high-priority, and is allegedly misleading users into trusting fraudulent communications. By rephrasing and condensing messages, the system is allegedly amplifying scam risks inadvertently and reportedly increasing the likelihood of financial harm for users.
Editor Notes: See also: Incident 861: Apple Intelligence Reportedly Notified Users That Luigi Mangione Shot Himself and Benjamin Netanyahu Had Been Arrested.

Tools

New ReportNew ReportNew ResponseNew ResponseDiscoverDiscoverView HistoryView History

Entities

View all entities
Alleged: Apple and Apple Intelligence developed and deployed an AI system, which harmed Apple users and Apple Intelligence users.
Alleged implicated AI system: Apple Intelligence

Incident Stats

Incident ID
892
Report Count
5
Incident Date
2024-08-05
Editors
Daniel Atherton

Incident Reports

Reports Timeline

+2
Apple Intelligence Thinks Phishing Emails Are 'Priority' Messages
Apple Intelligence is “a boomer dad” that reportedly prioritizes phishing emails+1
Apple’s new AI feature rewords scam messages to make them look more legit
Apple Intelligence Thinks Phishing Emails Are 'Priority' Messages

Apple Intelligence Thinks Phishing Emails Are 'Priority' Messages

lifehacker.com

Apple Intelligence is marking phishing scams as priority emails — here’s what you need to know

Apple Intelligence is marking phishing scams as priority emails — here’s what you need to know

tomsguide.com

Apple Intelligence is “a boomer dad” that reportedly prioritizes phishing emails

Apple Intelligence is “a boomer dad” that reportedly prioritizes phishing emails

cybernews.com

Apple’s new AI feature rewords scam messages to make them look more legit

Apple’s new AI feature rewords scam messages to make them look more legit

crikey.com.au

Apple Intelligence is Making Scam Messages Appear Legitmate on iPhones

Apple Intelligence is Making Scam Messages Appear Legitmate on iPhones

propakistani.pk

Apple Intelligence Thinks Phishing Emails Are 'Priority' Messages
lifehacker.com · 2024

Apple Intelligence might be smart, but it has plenty to learn—including the fact that phishing emails aren't what they claim to be. (You actually haven't won any prizes, Apple Intelligence, so please don't wire anyone money.)

As reported by…

Apple Intelligence is marking phishing scams as priority emails — here’s what you need to know
tomsguide.com · 2024

It appears that Apple Intelligence is falling for one of the oldest scams in the book, phishing emails.

Originally reported by Android Authority, it appears that multiple Reddit users have observed Apple Intelligence’s AI-powered filter in …

Apple Intelligence is “a boomer dad” that reportedly prioritizes phishing emails
cybernews.com · 2024

Users on the social media platforms Reddit and Panic are complaining that Apple's new artificial intelligence (AI) platform, Apple Intelligence, prioritizes phishing emails.

One user on Reddit posted to the IOSBeta community on Reddit that …

Apple’s new AI feature rewords scam messages to make them look more legit
crikey.com.au · 2025

Apple’s new artificial intelligence features are rephrasing scam messages and emails to iPhone and Mac users to make them look more legitimate and then flagging them as a priority, raising concerns that it will lead to more people falling f…

Apple Intelligence is Making Scam Messages Appear Legitmate on iPhones
propakistani.pk · 2025

Apple's "Apple Intelligence" update, introduced in late 2024, is under fire for making scam messages appear legitimate. The AI-powered features, designed to summarize and prioritize notifications, have flagged fraudulent messages as priorit…

Variants

A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.

Similar Incidents

Selected by our editors
Apple Intelligence Reportedly Notified Users That Luigi Mangione Shot Himself and Benjamin Netanyahu Had Been Arrested

Apple Intelligence Reportedly Notified Users That Luigi Mangione Shot Himself and Benjamin Netanyahu Had Been Arrested

Dec 2024 · 9 reports
By textual similarity

Did our AI mess up? Flag the unrelated incidents

Hackers Break Apple Face ID

Hackers Break Apple Face ID

Sep 2017 · 24 reports
Defamation via AutoComplete

Defamation via AutoComplete

Apr 2011 · 28 reports
Identical Twins Can Open Apple FaceID Protected Devices

Identical Twins Can Open Apple FaceID Protected Devices

Sep 2017 · 21 reports
Previous IncidentNext Incident

Similar Incidents

Selected by our editors
Apple Intelligence Reportedly Notified Users That Luigi Mangione Shot Himself and Benjamin Netanyahu Had Been Arrested

Apple Intelligence Reportedly Notified Users That Luigi Mangione Shot Himself and Benjamin Netanyahu Had Been Arrested

Dec 2024 · 9 reports
By textual similarity

Did our AI mess up? Flag the unrelated incidents

Hackers Break Apple Face ID

Hackers Break Apple Face ID

Sep 2017 · 24 reports
Defamation via AutoComplete

Defamation via AutoComplete

Apr 2011 · 28 reports
Identical Twins Can Open Apple FaceID Protected Devices

Identical Twins Can Open Apple FaceID Protected Devices

Sep 2017 · 21 reports

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2024 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • ecd56df