概要: 2024年8月、サンフランシスコ市検事局は、生成AIを用いて未成年者を含む合意のないポルノディープフェイクを作成・配信したとして、16のウェブサイトに対し、初の訴訟を起こしました。これらのウェブサイトは、6ヶ月間で2億回以上のアクセスがあり、ユーザーに実際の画像をアップロードして露骨なフェイクを生成していました。2025年3月までに、対象となったウェブサイトのうち11は法的圧力を受けて閉鎖されました。
Editor Notes: Timeline notes: The San Francisco City Attorney's office announced its actions against the 16 operators of these sites on August 15, 2024 (the date for this incident ID). By March 2025, reporting on these actions stated that 11 of the sites had been taken down.
Alleged: Deepfake technology developers developed an AI system deployed by Operators of 16 deepfake pornography websites, which harmed Women depicted in deepfake pornography と Minors depicted in deepfake pornography.
関与が疑われるAIシステム: Unknown generative AI tools と Deepfake technology
インシデントのステータス
Risk Subdomain
A further 23 subdomains create an accessible and understandable classification of hazards and harms associated with AI
4.3. Fraud, scams, and targeted manipulation
Risk Domain
The Domain Taxonomy of AI Risks classifies risks into seven AI risk domains: (1) Discrimination & toxicity, (2) Privacy & security, (3) Misinformation, (4) Malicious actors & misuse, (5) Human-computer interaction, (6) Socioeconomic & environmental harms, and (7) AI system safety, failures & limitations.
- Malicious Actors & Misuse
Entity
Which, if any, entity is presented as the main cause of the risk
AI
Timing
The stage in the AI lifecycle at which the risk is presented as occurring
Post-deployment
Intent
Whether the risk is presented as occurring as an expected or unexpected outcome from pursuing a goal
Intentional