Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Entities

General public of Australia

Incidents Harmed By

Incident 11935 Report
Purportedly Taxpayer-Funded Deloitte Report for Australian Government Contains Alleged AI-Generated Citations and Fabricated Legal Quote

2025-08-22

Australian academics reportedly identified fabricated references and a misattributed legal quote in a $439,000 Deloitte report for the Department of Employment and Workplace Relations on welfare compliance. Deleted citations allegedly referred to non-existent works, and a Federal Court judgment was misstated. Deloitte later acknowledged limited use of generative AI in preparing the report and issued a corrected version with a partial refund.

More

Incident 10762 Report
Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

2025-05-21

According to an ABC News (Australia) 7.30 report, a second wave of deepfake scam ads impersonating Norman Swan and other public figures circulated widely on Meta platforms in 2025, promoting unproven health supplements. The campaign featured new voice-cloned videos and more impersonation tactics, and it reportedly contributed to financial and health harms. Investigators reportedly linked the ads to businesses in Australia and New Zealand using deceptive redirects and alias branding.

More

Incident 12282 Report
Alleged ChatGPT Misuse by Contractor Leads to Reported Data Exposure in New South Wales Resilient Homes Program

2025-03-12

A former contractor of the New South Wales Reconstruction Authority reportedly uploaded a spreadsheet containing personal and health information of Resilient Homes Program applicants to ChatGPT during a three-day period in March 2025. Up to 3,000 people may have reportedly been affected.

More

Incident 9631 Report
Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

2025-03-05

Google reported to Australia's eSafety Commission that it received 258 complaints globally about AI-generated deepfake terrorism content and 86 about child abuse material made with its Gemini AI. The regulator called this a "world-first insight" into AI misuse. While Google uses hash-matching to detect child abuse content, it lacks a similar system for extremist material.

More

Related Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
 

Entity

Google

Incidents involved as both Developer and Deployer
  • Incident 963
    1 Report

    Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

More
Entity

General public

Incidents Harmed By
  • Incident 1228
    2 Reports

    Alleged ChatGPT Misuse by Contractor Leads to Reported Data Exposure in New South Wales Resilient Homes Program

  • Incident 963
    1 Report

    Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

More
Entity

Google Gemini users

Incidents Harmed By
  • Incident 963
    1 Report

    Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

More
Entity

Victims of deepfake terrorism content

Incidents Harmed By
  • Incident 963
    1 Report

    Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

More
Entity

Victims of deepfake child abuse

Incidents Harmed By
  • Incident 963
    1 Report

    Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

More
Entity

Victims of online radicalization

Incidents Harmed By
  • Incident 963
    1 Report

    Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

More
Entity

Gemini

Incidents implicated systems
  • Incident 963
    1 Report

    Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

More
Entity

Unknown scammers

Incidents involved as Deployer
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

  • Incident 1237
    1 Report

    Alleged Deepfake Video of Anthony Albanese Promotes Fake AUFIRST 'Tax Dividend' Trading Platform

More
Entity

Unknown fraudsters

Incidents involved as Deployer
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

  • Incident 1237
    1 Report

    Alleged Deepfake Video of Anthony Albanese Promotes Fake AUFIRST 'Tax Dividend' Trading Platform

More
Entity

Unknown cybercriminals

Incidents involved as Deployer
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

More
Entity

APPC Capital Singapore

Incidents involved as Deployer
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

More
Entity

Thackeray Mines and Minerals Inc.

Incidents involved as Deployer
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

More
Entity

Unknown generative AI developers

Incidents involved as Developer
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

More
Entity

Unspecified generative AI developers

Incidents involved as Developer
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

More
Entity

"Leon" (pseudonymous Australian fraud analyst)

Incidents Harmed By
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

More
Entity

Generative image models

Incidents implicated systems
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

More
Entity

AI-assisted website generation tools

Incidents implicated systems
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

More
Entity

Language models used to fabricate bios and documents

Incidents implicated systems
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

More
Entity

Possibly AI-generated financial data visualization tools

Incidents implicated systems
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

More
Entity

Unidentified actors linked to Vellec Group NZ Ltd

Incidents involved as Deployer
  • Incident 1076
    2 Reports

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Unidentified actors linked to Healthy Life Choices NZ Ltd

Incidents involved as Deployer
  • Incident 1076
    2 Reports

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Unidentified actors linked to Apex United Pty Ltd

Incidents involved as Deployer
  • Incident 1076
    2 Reports

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Unknown voice cloning technology developer

Incidents involved as Developer
  • Incident 1076
    2 Reports

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Unknown deepfake technology developer

Incidents involved as Developer
  • Incident 1076
    2 Reports

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

  • Incident 1237
    1 Report

    Alleged Deepfake Video of Anthony Albanese Promotes Fake AUFIRST 'Tax Dividend' Trading Platform

More
Entity

Rebel Wilson

Incidents Harmed By
  • Incident 1076
    2 Reports

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Public trust in medical guidance

Incidents Harmed By
  • Incident 1076
    2 Reports

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Norman Swan

Incidents Harmed By
  • Incident 1076
    2 Reports

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Jonathan Shaw

Incidents Harmed By
  • Incident 1076
    2 Reports

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Australians with chronic health problems

Incidents Harmed By
  • Incident 1076
    2 Reports

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Adele

Incidents Harmed By
  • Incident 1076
    2 Reports

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Unknown voice cloning technology

Incidents implicated systems
  • Incident 1076
    2 Reports

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Unknown deepfake technology

Incidents implicated systems
  • Incident 1076
    2 Reports

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

  • Incident 1229
    1 Report

    Gold Coast Man Reportedly Ordered to Pay $343,500 After Posting Purported Deepfake Pornographic Images of Australian Public Figures

More
Entity

Scam-linked e-commerce platforms for Glyco Balance and Keto Flow + ACV

Incidents implicated systems
  • Incident 1076
    2 Reports

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Meta advertising and content distribution infrastructure

Incidents implicated systems
  • Incident 1076
    2 Reports

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Instagram

Incidents implicated systems
  • Incident 1076
    2 Reports

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Facebook

Incidents implicated systems
  • Incident 1076
    2 Reports

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Affiliate redirect and auto-debit subscription systems used in scam marketing

Incidents implicated systems
  • Incident 1076
    2 Reports

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

More
Entity

Deloitte

Incidents Harmed By
  • Incident 1193
    5 Reports

    Purportedly Taxpayer-Funded Deloitte Report for Australian Government Contains Alleged AI-Generated Citations and Fabricated Legal Quote

Incidents involved as Deployer
  • Incident 1193
    5 Reports

    Purportedly Taxpayer-Funded Deloitte Report for Australian Government Contains Alleged AI-Generated Citations and Fabricated Legal Quote

More
Entity

Unknown large language model developer

Incidents involved as Developer
  • Incident 1193
    5 Reports

    Purportedly Taxpayer-Funded Deloitte Report for Australian Government Contains Alleged AI-Generated Citations and Fabricated Legal Quote

More
Entity

Scholars erroneously cited

Incidents Harmed By
  • Incident 1193
    5 Reports

    Purportedly Taxpayer-Funded Deloitte Report for Australian Government Contains Alleged AI-Generated Citations and Fabricated Legal Quote

More
Entity

Lisa Burton Crawford

Incidents Harmed By
  • Incident 1193
    5 Reports

    Purportedly Taxpayer-Funded Deloitte Report for Australian Government Contains Alleged AI-Generated Citations and Fabricated Legal Quote

More
Entity

Janina Boughey

Incidents Harmed By
  • Incident 1193
    5 Reports

    Purportedly Taxpayer-Funded Deloitte Report for Australian Government Contains Alleged AI-Generated Citations and Fabricated Legal Quote

More
Entity

Government of Australia

Incidents Harmed By
  • Incident 1193
    5 Reports

    Purportedly Taxpayer-Funded Deloitte Report for Australian Government Contains Alleged AI-Generated Citations and Fabricated Legal Quote

More
Entity

Epistemic integrity

Incidents Harmed By
  • Incident 1193
    5 Reports

    Purportedly Taxpayer-Funded Deloitte Report for Australian Government Contains Alleged AI-Generated Citations and Fabricated Legal Quote

  • Incident 1229
    1 Report

    Gold Coast Man Reportedly Ordered to Pay $343,500 After Posting Purported Deepfake Pornographic Images of Australian Public Figures

More
Entity

Department of Employment and Workplace Relations (DEWR)

Incidents Harmed By
  • Incident 1193
    5 Reports

    Purportedly Taxpayer-Funded Deloitte Report for Australian Government Contains Alleged AI-Generated Citations and Fabricated Legal Quote

More
Entity

Carolyn Adams

Incidents Harmed By
  • Incident 1193
    5 Reports

    Purportedly Taxpayer-Funded Deloitte Report for Australian Government Contains Alleged AI-Generated Citations and Fabricated Legal Quote

More
Entity

Academics

Incidents Harmed By
  • Incident 1193
    5 Reports

    Purportedly Taxpayer-Funded Deloitte Report for Australian Government Contains Alleged AI-Generated Citations and Fabricated Legal Quote

More
Entity

Unknown large language model

Incidents implicated systems
  • Incident 1193
    5 Reports

    Purportedly Taxpayer-Funded Deloitte Report for Australian Government Contains Alleged AI-Generated Citations and Fabricated Legal Quote

More
Entity

Nomi AI

Incidents involved as both Developer and Deployer
  • Incident 1212
    1 Report

    Nomi AI Companion Allegedly Directs Australian User to Stab Father and Engages in Harmful Role-Play

More
Entity

Samuel McCarthy

Incidents Harmed By
  • Incident 1212
    1 Report

    Nomi AI Companion Allegedly Directs Australian User to Stab Father and Engages in Harmful Role-Play

More
Entity

Nomi users

Incidents Harmed By
  • Incident 1212
    1 Report

    Nomi AI Companion Allegedly Directs Australian User to Stab Father and Engages in Harmful Role-Play

More
Entity

Emotionally vulnerable individuals

Incidents Harmed By
  • Incident 1212
    1 Report

    Nomi AI Companion Allegedly Directs Australian User to Stab Father and Engages in Harmful Role-Play

More
Entity

Nomi chatbots

Incidents implicated systems
  • Incident 1212
    1 Report

    Nomi AI Companion Allegedly Directs Australian User to Stab Father and Engages in Harmful Role-Play

More
Entity

Nomi

Incidents implicated systems
  • Incident 1212
    1 Report

    Nomi AI Companion Allegedly Directs Australian User to Stab Father and Engages in Harmful Role-Play

More
Entity

OpenAI

Incidents involved as both Developer and Deployer
  • Incident 1228
    2 Reports

    Alleged ChatGPT Misuse by Contractor Leads to Reported Data Exposure in New South Wales Resilient Homes Program

More
Entity

General public of New South Wales

Incidents Harmed By
  • Incident 1228
    2 Reports

    Alleged ChatGPT Misuse by Contractor Leads to Reported Data Exposure in New South Wales Resilient Homes Program

More
Entity

Resilient Homes Program

Incidents Harmed By
  • Incident 1228
    2 Reports

    Alleged ChatGPT Misuse by Contractor Leads to Reported Data Exposure in New South Wales Resilient Homes Program

More
Entity

Resilient Homes Program applicants

Incidents Harmed By
  • Incident 1228
    2 Reports

    Alleged ChatGPT Misuse by Contractor Leads to Reported Data Exposure in New South Wales Resilient Homes Program

More
Entity

Government of New South Wales

Incidents Harmed By
  • Incident 1228
    2 Reports

    Alleged ChatGPT Misuse by Contractor Leads to Reported Data Exposure in New South Wales Resilient Homes Program

More
Entity

ChatGPT

Incidents implicated systems
  • Incident 1228
    2 Reports

    Alleged ChatGPT Misuse by Contractor Leads to Reported Data Exposure in New South Wales Resilient Homes Program

More
Entity

Anthony Rotondo

Incidents involved as Deployer
  • Incident 1229
    1 Report

    Gold Coast Man Reportedly Ordered to Pay $343,500 After Posting Purported Deepfake Pornographic Images of Australian Public Figures

More
Entity

MrDeepFakes.com

Incidents involved as Deployer
  • Incident 1229
    1 Report

    Gold Coast Man Reportedly Ordered to Pay $343,500 After Posting Purported Deepfake Pornographic Images of Australian Public Figures

More
Entity

Unknown deepfake technology developers

Incidents involved as Developer
  • Incident 1229
    1 Report

    Gold Coast Man Reportedly Ordered to Pay $343,500 After Posting Purported Deepfake Pornographic Images of Australian Public Figures

More
Entity

Prominent Australian women

Incidents Harmed By
  • Incident 1229
    1 Report

    Gold Coast Man Reportedly Ordered to Pay $343,500 After Posting Purported Deepfake Pornographic Images of Australian Public Figures

More
Entity

Women

Incidents Harmed By
  • Incident 1229
    1 Report

    Gold Coast Man Reportedly Ordered to Pay $343,500 After Posting Purported Deepfake Pornographic Images of Australian Public Figures

More
Entity

Unknown AUFIRST platform scam operators

Incidents involved as Deployer
  • Incident 1237
    1 Report

    Alleged Deepfake Video of Anthony Albanese Promotes Fake AUFIRST 'Tax Dividend' Trading Platform

More
Entity

Unknown voice synthesis technology developer

Incidents involved as Developer
  • Incident 1237
    1 Report

    Alleged Deepfake Video of Anthony Albanese Promotes Fake AUFIRST 'Tax Dividend' Trading Platform

More
Entity

Anthony Albanese

Incidents Harmed By
  • Incident 1237
    1 Report

    Alleged Deepfake Video of Anthony Albanese Promotes Fake AUFIRST 'Tax Dividend' Trading Platform

More
Entity

Investors

Incidents Harmed By
  • Incident 1237
    1 Report

    Alleged Deepfake Video of Anthony Albanese Promotes Fake AUFIRST 'Tax Dividend' Trading Platform

More
Entity

Australian investors

Incidents Harmed By
  • Incident 1237
    1 Report

    Alleged Deepfake Video of Anthony Albanese Promotes Fake AUFIRST 'Tax Dividend' Trading Platform

More
Entity

Unknown voice synthesis technology

Incidents implicated systems
  • Incident 1237
    1 Report

    Alleged Deepfake Video of Anthony Albanese Promotes Fake AUFIRST 'Tax Dividend' Trading Platform

More
Entity

AUFIRST

Incidents implicated systems
  • Incident 1237
    1 Report

    Alleged Deepfake Video of Anthony Albanese Promotes Fake AUFIRST 'Tax Dividend' Trading Platform

More
Entity

YouTube

Incidents implicated systems
  • Incident 1237
    1 Report

    Alleged Deepfake Video of Anthony Albanese Promotes Fake AUFIRST 'Tax Dividend' Trading Platform

More

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2024 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 3303e65