Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Entities

General public of Australia

Incidents Harmed By

Incident 9631 Report
Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

2025-03-05

Google reported to Australia's eSafety Commission that it received 258 complaints globally about AI-generated deepfake terrorism content and 86 about child abuse material made with its Gemini AI. The regulator called this a "world-first insight" into AI misuse. While Google uses hash-matching to detect child abuse content, it lacks a similar system for extremist material.

More

Incident 10471 Report
Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

2025-04-27

A report by ABC News Australia describes how scammers allegedly used AI tools to create detailed fake websites for two fabricated companies, APPC Capital Singapore and Thackeray Mines and Minerals Inc., as part of an investment scam. A pseudonymous Australian fraud analyst ("Leon") was reportedly targeted. Experts cited in the article warn that AI lowers the barrier for generating convincing scams that can deceive even experienced analysts.

More

Incident 10761 Report
Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

2025-05-21

According to an ABC News (Australia) 7.30 report, a second wave of deepfake scam ads impersonating Norman Swan and other public figures circulated widely on Meta platforms in 2025, promoting unproven health supplements. The campaign featured new voice-cloned videos and more impersonation tactics, and it reportedly contributed to financial and health harms. Investigators reportedly linked the ads to businesses in Australia and New Zealand using deceptive redirects and alias branding.

More

Related Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
 

Entity

Google

Incidents involved as both Developer and Deployer
  • Incident 963
    1 Report

    Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

More
Entity

General public

Incidents Harmed By
  • Incident 963
    1 Report

    Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

More
Entity

Google Gemini users

Incidents Harmed By
  • Incident 963
    1 Report

    Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

More
Entity

Victims of deepfake terrorism content

Incidents Harmed By
  • Incident 963
    1 Report

    Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

More
Entity

Victims of deepfake child abuse

Incidents Harmed By
  • Incident 963
    1 Report

    Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

More
Entity

Victims of online radicalization

Incidents Harmed By
  • Incident 963
    1 Report

    Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

More
Entity

Gemini

Incidents implicated systems
  • Incident 963
    1 Report

    Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

More
Entity

Unknown scammers

Incidents involved as Deployer
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

More
Entity

Unknown fraudsters

Incidents involved as Deployer
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

More
Entity

Unknown cybercriminals

Incidents involved as Deployer
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

More
Entity

APPC Capital Singapore

Incidents involved as Deployer
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

More
Entity

Thackeray Mines and Minerals Inc.

Incidents involved as Deployer
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

More
Entity

Unknown generative AI developers

Incidents involved as Developer
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

More
Entity

Unspecified generative AI developers

Incidents involved as Developer
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

More
Entity

"Leon" (pseudonymous Australian fraud analyst)

Incidents Harmed By
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

More
Entity

Generative image models

Incidents implicated systems
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

More
Entity

AI-assisted website generation tools

Incidents implicated systems
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

More
Entity

Language models used to fabricate bios and documents

Incidents implicated systems
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

More
Entity

Possibly AI-generated financial data visualization tools

Incidents implicated systems
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

More
Entity

Unidentified actors linked to Vellec Group NZ Ltd

Incidents involved as Deployer
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Unidentified actors linked to Healthy Life Choices NZ Ltd

Incidents involved as Deployer
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Unidentified actors linked to Apex United Pty Ltd

Incidents involved as Deployer
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Unknown voice cloning technology developer

Incidents involved as Developer
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Unknown deepfake technology developer

Incidents involved as Developer
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Rebel Wilson

Incidents Harmed By
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Public trust in medical guidance

Incidents Harmed By
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Norman Swan

Incidents Harmed By
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Jonathan Shaw

Incidents Harmed By
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Australians with chronic health problems

Incidents Harmed By
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Adele

Incidents Harmed By
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Unknown voice cloning technology

Incidents implicated systems
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Unknown deepfake technology

Incidents implicated systems
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Scam-linked e-commerce platforms for Glyco Balance and Keto Flow + ACV

Incidents implicated systems
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Meta advertising and content distribution infrastructure

Incidents implicated systems
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Instagram

Incidents implicated systems
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Facebook

Incidents implicated systems
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Affiliate redirect and auto-debit subscription systems used in scam marketing

Incidents implicated systems
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2024 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 300d90c