Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Discover
Submit
  • Welcome to the AIID
  • Discover Incidents
  • Spatial View
  • Table View
  • List view
  • Entities
  • Taxonomies
  • Submit Incident Reports
  • Submission Leaderboard
  • Blog
  • AI News Digest
  • Risk Checklists
  • Random Incident
  • Sign Up
Collapse
Entities

Consumers

Incidents Harmed By

Incident 10375 Report
Microsoft Reportedly Blocks 1.6 Million Bot Signup Attempts Per Hour Amid Global AI-Driven Fraud Surge

2025-04-16

Between April 2024 and April 2025, Microsoft reportedly blocked 1.6 million bot signups per hour and disrupted $4 billion in fraud attempts linked to AI-enhanced scams. The company's Cyber Signals report details how generative AI is being used to fabricate realistic e-commerce sites, job offers, customer service bots, and phishing lures. Fraud actors now automate mass-deceptive campaigns with fake reviews, deepfakes, and cloned brand domains at unprecedented scale and speed.

More

Incident 5761 Report
Alleged Misuse of PicSo AI for Generating Inappropriate Content Emphasizing "Girls"

2023-10-24

PicSo AI, which appears to be getting advertised by Meta over Instagram, is allegedly being used for generating inappropriate content with an emphasis on "girls." This raises concerns about the misuse of generative AI technologies for creating offensive and potentially sexually explicit material that could be used for nefarious and criminal purposes.

More

Incident 11891 Report
Joann Fabrics Shoppers Reportedly Defrauded by AI-Generated Scam Sites, Part of Purported Wave of ~100,000 Fake Domains Across 194 Brands

2025-08-20

Consumers were allegedly defrauded by AI-generated scam websites impersonating Joann Fabrics following the retailer's bankruptcy. The alleged impostor sites reportedly used Joann's branding to steal credit card details and personal data and leaving victims without products. Cybersecurity firm Netcraft estimated that nearly 100,000 domains created with AI tools were impersonating 194 brands, accounting for a reported 6–7% of global phishing activity.

More

Related Entities
Other entities that are related to the same incident. For example, if the developer of an incident is this entity but the deployer is another entity, they are marked as related entities.
 

Entity

Meta

Incidents involved as Deployer
  • Incident 576
    1 Report

    Alleged Misuse of PicSo AI for Generating Inappropriate Content Emphasizing "Girls"

More
Entity

Instagram

Incidents involved as Deployer
  • Incident 576
    1 Report

    Alleged Misuse of PicSo AI for Generating Inappropriate Content Emphasizing "Girls"

More
Entity

PicSo AI

Incidents involved as Developer
  • Incident 576
    1 Report

    Alleged Misuse of PicSo AI for Generating Inappropriate Content Emphasizing "Girls"

More
Entity

Potentially exploited groups

Incidents Harmed By
  • Incident 576
    1 Report

    Alleged Misuse of PicSo AI for Generating Inappropriate Content Emphasizing "Girls"

More
Entity

General public

Incidents Harmed By
  • Incident 1037
    5 Reports

    Microsoft Reportedly Blocks 1.6 Million Bot Signup Attempts Per Hour Amid Global AI-Driven Fraud Surge

  • Incident 576
    1 Report

    Alleged Misuse of PicSo AI for Generating Inappropriate Content Emphasizing "Girls"

More
Entity

scammers

Incidents involved as Deployer
  • Incident 1037
    5 Reports

    Microsoft Reportedly Blocks 1.6 Million Bot Signup Attempts Per Hour Amid Global AI-Driven Fraud Surge

More
Entity

Fraudsters

Incidents involved as Deployer
  • Incident 1037
    5 Reports

    Microsoft Reportedly Blocks 1.6 Million Bot Signup Attempts Per Hour Amid Global AI-Driven Fraud Surge

More
Entity

Cyber criminal networks

Incidents involved as Deployer
  • Incident 1037
    5 Reports

    Microsoft Reportedly Blocks 1.6 Million Bot Signup Attempts Per Hour Amid Global AI-Driven Fraud Surge

More
Entity

Various generative AI developers

Incidents involved as Developer
  • Incident 1037
    5 Reports

    Microsoft Reportedly Blocks 1.6 Million Bot Signup Attempts Per Hour Amid Global AI-Driven Fraud Surge

More
Entity

Various deepfake technology developers

Incidents involved as Developer
  • Incident 1037
    5 Reports

    Microsoft Reportedly Blocks 1.6 Million Bot Signup Attempts Per Hour Amid Global AI-Driven Fraud Surge

More
Entity

Various voice cloning technology developers

Incidents involved as Developer
  • Incident 1037
    5 Reports

    Microsoft Reportedly Blocks 1.6 Million Bot Signup Attempts Per Hour Amid Global AI-Driven Fraud Surge

More
Entity

Enterprises

Incidents Harmed By
  • Incident 1037
    5 Reports

    Microsoft Reportedly Blocks 1.6 Million Bot Signup Attempts Per Hour Amid Global AI-Driven Fraud Surge

More
Entity

Microsoft

Incidents Harmed By
  • Incident 1037
    5 Reports

    Microsoft Reportedly Blocks 1.6 Million Bot Signup Attempts Per Hour Amid Global AI-Driven Fraud Surge

More
Entity

Financial institutions

Incidents Harmed By
  • Incident 1037
    5 Reports

    Microsoft Reportedly Blocks 1.6 Million Bot Signup Attempts Per Hour Amid Global AI-Driven Fraud Surge

More
Entity

Generative AI systems

Incidents implicated systems
  • Incident 1037
    5 Reports

    Microsoft Reportedly Blocks 1.6 Million Bot Signup Attempts Per Hour Amid Global AI-Driven Fraud Surge

More
Entity

AI-powered chatbots

Incidents implicated systems
  • Incident 1037
    5 Reports

    Microsoft Reportedly Blocks 1.6 Million Bot Signup Attempts Per Hour Amid Global AI-Driven Fraud Surge

More
Entity

AI-enhanced phishing frameworks

Incidents implicated systems
  • Incident 1037
    5 Reports

    Microsoft Reportedly Blocks 1.6 Million Bot Signup Attempts Per Hour Amid Global AI-Driven Fraud Surge

More
Entity

Microsoft Quick Assist

Incidents implicated systems
  • Incident 1037
    5 Reports

    Microsoft Reportedly Blocks 1.6 Million Bot Signup Attempts Per Hour Amid Global AI-Driven Fraud Surge

More
Entity

E-commerce and job listing platforms

Incidents implicated systems
  • Incident 1037
    5 Reports

    Microsoft Reportedly Blocks 1.6 Million Bot Signup Attempts Per Hour Amid Global AI-Driven Fraud Surge

More
Entity

Fraud detection and domain protection tools

Incidents implicated systems
  • Incident 1037
    5 Reports

    Microsoft Reportedly Blocks 1.6 Million Bot Signup Attempts Per Hour Amid Global AI-Driven Fraud Surge

More
Entity

Unknown scammers

Incidents involved as Deployer
  • Incident 1189
    1 Report

    Joann Fabrics Shoppers Reportedly Defrauded by AI-Generated Scam Sites, Part of Purported Wave of ~100,000 Fake Domains Across 194 Brands

More
Entity

Unknown fraudsters

Incidents involved as Deployer
  • Incident 1189
    1 Report

    Joann Fabrics Shoppers Reportedly Defrauded by AI-Generated Scam Sites, Part of Purported Wave of ~100,000 Fake Domains Across 194 Brands

More
Entity

Unknown cybercriminals

Incidents involved as Deployer
  • Incident 1189
    1 Report

    Joann Fabrics Shoppers Reportedly Defrauded by AI-Generated Scam Sites, Part of Purported Wave of ~100,000 Fake Domains Across 194 Brands

More
Entity

Unknown generative AI developers

Incidents involved as Developer
  • Incident 1189
    1 Report

    Joann Fabrics Shoppers Reportedly Defrauded by AI-Generated Scam Sites, Part of Purported Wave of ~100,000 Fake Domains Across 194 Brands

More
Entity

Shoppers

Incidents Harmed By
  • Incident 1189
    1 Report

    Joann Fabrics Shoppers Reportedly Defrauded by AI-Generated Scam Sites, Part of Purported Wave of ~100,000 Fake Domains Across 194 Brands

More
Entity

Customers

Incidents Harmed By
  • Incident 1189
    1 Report

    Joann Fabrics Shoppers Reportedly Defrauded by AI-Generated Scam Sites, Part of Purported Wave of ~100,000 Fake Domains Across 194 Brands

More
Entity

Joann's Fabrics

Incidents Harmed By
  • Incident 1189
    1 Report

    Joann Fabrics Shoppers Reportedly Defrauded by AI-Generated Scam Sites, Part of Purported Wave of ~100,000 Fake Domains Across 194 Brands

More
Entity

Companies whose domains and websites are impersonated by scammers

Incidents Harmed By
  • Incident 1189
    1 Report

    Joann Fabrics Shoppers Reportedly Defrauded by AI-Generated Scam Sites, Part of Purported Wave of ~100,000 Fake Domains Across 194 Brands

More
Entity

Unknown generative AI technology

Incidents implicated systems
  • Incident 1189
    1 Report

    Joann Fabrics Shoppers Reportedly Defrauded by AI-Generated Scam Sites, Part of Purported Wave of ~100,000 Fake Domains Across 194 Brands

More

Research

  • Defining an “AI Incident”
  • Defining an “AI Incident Response”
  • Database Roadmap
  • Related Work
  • Download Complete Database

Project and Community

  • About
  • Contact and Follow
  • Apps and Summaries
  • Editor’s Guide

Incidents

  • All Incidents in List Form
  • Flagged Incidents
  • Submission Queue
  • Classifications View
  • Taxonomies

2024 - AI Incident Database

  • Terms of use
  • Privacy Policy
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • e132322