Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse

Incident 954: Chatbots Allegedly Used in Romance Scams Targeting Nearly One-Third of New Zealand's Dating App Users

Description: A Norton Cyber Safety Insights Report found that nearly one-third of New Zealand dating app users have been targeted by romance scams, with AI chatbots allegedly playing a growing role. The report, based on a January 2025 survey, indicates that 50% of dating app users believed they had interacted with AI-generated messages. Private investigators report cases where victims engage in long-term virtual relationships with fraudsters, often sending money.

Tools

New ReportNew ReportNew ResponseNew ResponseDiscoverDiscoverView HistoryView History

Entities

View all entities
Alleged: Unknown large language model developers and Unknown chatbot developers developed an AI system deployed by Romance scammers targeting New Zealanders and Unknown scammers, which harmed New Zealand dating app users , Romance scam victims and Financial fraud victims.
Alleged implicated AI systems: Unknown large language models , Unknown chatbots , Social media platforms and Dating apps

Incident Stats

Incident ID
954
Report Count
1
Incident Date
2025-02-04
Editors
Daniel Atherton
Applied Taxonomies
MIT

MIT Taxonomy Classifications

Machine-Classified
Taxonomy Details

Risk Subdomain

A further 23 subdomains create an accessible and understandable classification of hazards and harms associated with AI
 

4.3. Fraud, scams, and targeted manipulation

Risk Domain

The Domain Taxonomy of AI Risks classifies risks into seven AI risk domains: (1) Discrimination & toxicity, (2) Privacy & security, (3) Misinformation, (4) Malicious actors & misuse, (5) Human-computer interaction, (6) Socioeconomic & environmental harms, and (7) AI system safety, failures & limitations.
 
  1. Malicious Actors & Misuse

Entity

Which, if any, entity is presented as the main cause of the risk
 

Human

Timing

The stage in the AI lifecycle at which the risk is presented as occurring
 

Post-deployment

Intent

Whether the risk is presented as occurring as an expected or unexpected outcome from pursuing a goal
 

Intentional

Incident Reports

Reports Timeline

+1
AI sex chat robots among romance scams hitting almost one-third of Kiwi dating app users
Loading...
AI sex chat robots among romance scams hitting almost one-third of Kiwi dating app users

AI sex chat robots among romance scams hitting almost one-third of Kiwi dating app users

nzherald.co.nz

Loading...
AI sex chat robots among romance scams hitting almost one-third of Kiwi dating app users
nzherald.co.nz · 2025

A private investigator says young adults conditioned to life online are increasingly clueless about catfishing and other love and sex scams.

Some grifters are now using artificial intelligence to do their online sweet-talking, and a new Nor…

Variants

A "variant" is an AI incident similar to a known case—it has the same causes, harms, and AI system. Instead of listing it separately, we group it under the first reported incident. Unlike other incidents, variants do not need to have been reported outside the AIID. Learn more from the research paper.
Seen something similar?

Similar Incidents

By textual similarity

Did our AI mess up? Flag the unrelated incidents

Loading...
Australian Automated Debt Assessment System Issued False Notices to Thousands

Australian Automated Debt Assessment System Issued False Notices to Thousands

Jul 2015 · 39 reports
Loading...
Airbnb's Trustworthiness Algorithm Allegedly Banned Users without Explanation, and Discriminated against Sex Workers

Airbnb's Trustworthiness Algorithm Allegedly Banned Users without Explanation, and Discriminated against Sex Workers

Jul 2017 · 6 reports
Loading...
Tinder's Personalized Pricing Algorithm Found to Offer Higher Prices for Older Users

Tinder's Personalized Pricing Algorithm Found to Offer Higher Prices for Older Users

Mar 2015 · 4 reports
Previous IncidentNext Incident

Similar Incidents

By textual similarity

Did our AI mess up? Flag the unrelated incidents

Loading...
Australian Automated Debt Assessment System Issued False Notices to Thousands

Australian Automated Debt Assessment System Issued False Notices to Thousands

Jul 2015 · 39 reports
Loading...
Airbnb's Trustworthiness Algorithm Allegedly Banned Users without Explanation, and Discriminated against Sex Workers

Airbnb's Trustworthiness Algorithm Allegedly Banned Users without Explanation, and Discriminated against Sex Workers

Jul 2017 · 6 reports
Loading...
Tinder's Personalized Pricing Algorithm Found to Offer Higher Prices for Older Users

Tinder's Personalized Pricing Algorithm Found to Offer Higher Prices for Older Users

Mar 2015 · 4 reports

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2024 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 227e5b7