Description: In August 2024, the San Francisco City Attorney’s Office filed a first-of-its-kind lawsuit against 16 websites accused of using generative AI to create and distribute nonconsensual pornographic deepfakes, including images of minors. The sites, which had over 200 million visits in six months, invited users to upload real images to generate explicit fakes. By March 2025, 11 of the targeted websites had shut down following legal pressure.
Editor Notes: Timeline notes: The San Francisco City Attorney's office announced its actions against the 16 operators of these sites on August 15, 2024 (the date for this incident ID). By March 2025, reporting on these actions stated that 11 of the sites had been taken down.
Entidades
Ver todas las entidadesAlleged: Unknown deepfake technology developers developed an AI system deployed by Operators of 16 deepfake pornography websites, which harmed Women depicted in deepfake pornography y Minors depicted in deepfake pornography.
Sistemas de IA presuntamente implicados: Unknown deepfake apps y Unknown generative AI tools
Estadísticas de incidentes
ID
1004
Cantidad de informes
2
Fecha del Incidente
2024-08-15
Editores
Daniel Atherton
Informes del Incidente
Cronología de Informes
Las imágenes explícitas no consensuadas de adultos y menores reales generadas por IA causan daños inconmensurables y violan las leyes estatales y federales
SAN FRANCISCO (15 de agosto de 2024) --- El fiscal de la ciudad de San Francisco, Da…

La Fiscalía Municipal de San Francisco está tomando medidas contra sitios web acusados de crear y difundir desnudos deepfake, retirando los sitios de internet y enviando un mensaje claro.
La Fiscal Adjunta Principal de la Ciudad, Yvonne Mer…
Variantes
Una "Variante" es un incidente que comparte los mismos factores causales, produce daños similares e involucra los mismos sistemas inteligentes que un incidente de IA conocido. En lugar de indexar las variantes como incidentes completamente separados, enumeramos las variaciones de los incidentes bajo el primer incidente similar enviado a la base de datos. A diferencia de otros tipos de envío a la base de datos de incidentes, no se requiere que las variantes tengan informes como evidencia externa a la base de datos de incidentes. Obtenga más información del trabajo de investigación.
Incidentes Similares
Did our AI mess up? Flag the unrelated incidents

Tempe police release report, audio, photo
· 25 informes

Chinese AI caught out by face in bus ad
· 24 informes
Incidentes Similares
Did our AI mess up? Flag the unrelated incidents

Tempe police release report, audio, photo
· 25 informes

Chinese AI caught out by face in bus ad
· 24 informes