Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Découvrir
Envoyer
  • Bienvenue sur AIID
  • Découvrir les incidents
  • Vue spatiale
  • Vue de tableau
  • Vue de liste
  • Entités
  • Taxonomies
  • Soumettre des rapports d'incident
  • Classement des reporters
  • Blog
  • Résumé de l’Actualité sur l’IA
  • Contrôle des risques
  • Incident au hasard
  • S'inscrire
Fermer
Découvrir
Envoyer
  • Bienvenue sur AIID
  • Découvrir les incidents
  • Vue spatiale
  • Vue de tableau
  • Vue de liste
  • Entités
  • Taxonomies
  • Soumettre des rapports d'incident
  • Classement des reporters
  • Blog
  • Résumé de l’Actualité sur l’IA
  • Contrôle des risques
  • Incident au hasard
  • S'inscrire
Fermer
Entités

General public of Australia

Affecté par des incidents

Incident 9631 Rapport
Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

2025-03-05

Google reported to Australia's eSafety Commission that it received 258 complaints globally about AI-generated deepfake terrorism content and 86 about child abuse material made with its Gemini AI. The regulator called this a "world-first insight" into AI misuse. While Google uses hash-matching to detect child abuse content, it lacks a similar system for extremist material.

Plus

Incident 10471 Rapport
Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

2025-04-27

A report by ABC News Australia describes how scammers allegedly used AI tools to create detailed fake websites for two fabricated companies, APPC Capital Singapore and Thackeray Mines and Minerals Inc., as part of an investment scam. A pseudonymous Australian fraud analyst ("Leon") was reportedly targeted. Experts cited in the article warn that AI lowers the barrier for generating convincing scams that can deceive even experienced analysts.

Plus

Incident 10761 Rapport
Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

2025-05-21

According to an ABC News (Australia) 7.30 report, a second wave of deepfake scam ads impersonating Norman Swan and other public figures circulated widely on Meta platforms in 2025, promoting unproven health supplements. The campaign featured new voice-cloned videos and more impersonation tactics, and it reportedly contributed to financial and health harms. Investigators reportedly linked the ads to businesses in Australia and New Zealand using deceptive redirects and alias branding.

Plus

Entités liées
Autres entités liées au même incident. Par exemple, si le développeur d'un incident est cette entité mais que le responsable de la mise en œuvre est une autre entité, ils sont marqués comme entités liées.
 

Entity

Google

Incidents impliqués en tant que développeur et déployeur
  • Incident 963
    1 Report

    Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

Plus
Entity

General public

Affecté par des incidents
  • Incident 963
    1 Report

    Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

Plus
Entity

Google Gemini users

Affecté par des incidents
  • Incident 963
    1 Report

    Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

Plus
Entity

Victims of deepfake terrorism content

Affecté par des incidents
  • Incident 963
    1 Report

    Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

Plus
Entity

Victims of deepfake child abuse

Affecté par des incidents
  • Incident 963
    1 Report

    Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

Plus
Entity

Victims of online radicalization

Affecté par des incidents
  • Incident 963
    1 Report

    Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

Plus
Entity

Gemini

Incidents implicated systems
  • Incident 963
    1 Report

    Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

Plus
Entity

Unknown scammers

Incidents involved as Deployer
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

Plus
Entity

Unknown fraudsters

Incidents involved as Deployer
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

Plus
Entity

Unknown cybercriminals

Incidents involved as Deployer
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

Plus
Entity

APPC Capital Singapore

Incidents involved as Deployer
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

Plus
Entity

Thackeray Mines and Minerals Inc.

Incidents involved as Deployer
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

Plus
Entity

Unknown generative AI developers

Incidents involved as Developer
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

Plus
Entity

Unspecified generative AI developers

Incidents involved as Developer
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

Plus
Entity

"Leon" (pseudonymous Australian fraud analyst)

Affecté par des incidents
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

Plus
Entity

Generative image models

Incidents implicated systems
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

Plus
Entity

AI-assisted website generation tools

Incidents implicated systems
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

Plus
Entity

Language models used to fabricate bios and documents

Incidents implicated systems
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

Plus
Entity

Possibly AI-generated financial data visualization tools

Incidents implicated systems
  • Incident 1047
    1 Report

    Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials

Plus
Entity

Unidentified actors linked to Vellec Group NZ Ltd

Incidents involved as Deployer
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

Plus
Entity

Unidentified actors linked to Healthy Life Choices NZ Ltd

Incidents involved as Deployer
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

Plus
Entity

Unidentified actors linked to Apex United Pty Ltd

Incidents involved as Deployer
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

Plus
Entity

Unknown voice cloning technology developer

Incidents involved as Developer
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

Plus
Entity

Unknown deepfake technology developer

Incidents involved as Developer
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

Plus
Entity

Rebel Wilson

Affecté par des incidents
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

Plus
Entity

Public trust in medical guidance

Affecté par des incidents
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

Plus
Entity

Norman Swan

Affecté par des incidents
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

Plus
Entity

Jonathan Shaw

Affecté par des incidents
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

Plus
Entity

Australians with chronic health problems

Affecté par des incidents
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

Plus
Entity

Adele

Affecté par des incidents
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

Plus
Entity

Unknown voice cloning technology

Incidents implicated systems
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

Plus
Entity

Unknown deepfake technology

Incidents implicated systems
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

Plus
Entity

Scam-linked e-commerce platforms for Glyco Balance and Keto Flow + ACV

Incidents implicated systems
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

Plus
Entity

Meta advertising and content distribution infrastructure

Incidents implicated systems
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

Plus
Entity

Instagram

Incidents implicated systems
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

Plus
Entity

Facebook

Incidents implicated systems
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

Plus
Entity

Affiliate redirect and auto-debit subscription systems used in scam marketing

Incidents implicated systems
  • Incident 1076
    1 Report

    Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns

Plus

Recherche

  • Définition d'un « incident d'IA »
  • Définir une « réponse aux incidents d'IA »
  • Feuille de route de la base de données
  • Travaux connexes
  • Télécharger la base de données complète

Projet et communauté

  • À propos de
  • Contacter et suivre
  • Applications et résumés
  • Guide de l'éditeur

Incidents

  • Tous les incidents sous forme de liste
  • Incidents signalés
  • File d'attente de soumission
  • Affichage des classifications
  • Taxonomies

2024 - AI Incident Database

  • Conditions d'utilisation
  • Politique de confidentialité
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • 300d90c