Incidente 848: Estudiante de secundaria en Córdoba, Argentina, acusado de usar inteligencia artificial para generar imágenes explícitas de sus compañeros.
Descripción: Una estudiante argentina de 18 años del instituto preuniversitario Manuel Belgrano de Córdoba presuntamente utilizó herramientas de inteligencia artificial para generar imágenes falsas explícitas de al menos 22 compañeras de clase, combinando sus rostros con otros cuerpos. Estas imágenes, publicadas en sitios web pornográficos, incluían los nombres de las víctimas, lo que provocó acoso y un daño psicológico significativo. Las autoridades judiciales acusaron a la estudiante de lesiones graves agravadas por violencia de género.
Editor Notes: Reconstructing the timeline of events: (1) Mid-2024: Two female students at the Manuel Belgrano Institute began receiving suspicious Instagram messages from men aged 40–50. (2) July 2024: Victims discovered explicit AI-generated images of themselves on pornographic websites, featuring their names and altered appearances. (3) August 2024: Families of victims reported the student to authorities, who launched an investigation and conducted a search of the accused's home. (4) October 18, 2024: Charges were filed against the accused for gender-based violence and psychological harm; legal experts advocated for updated laws addressing AI misuse. This fourth date is being marked as the incident date, even though the initial events are reported to have begun sometime in the middle of 2024.
Entidades
Ver todas las entidadesAlleged: Unknown deepfake technology creators developed an AI system deployed by Unnamed 18-year-old Manuel Belgrano male student, which harmed Unnamed Manuel Belgrano female students.
Estadísticas de incidentes
Risk Subdomain
A further 23 subdomains create an accessible and understandable classification of hazards and harms associated with AI
4.3. Fraud, scams, and targeted manipulation
Risk Domain
The Domain Taxonomy of AI Risks classifies risks into seven AI risk domains: (1) Discrimination & toxicity, (2) Privacy & security, (3) Misinformation, (4) Malicious actors & misuse, (5) Human-computer interaction, (6) Socioeconomic & environmental harms, and (7) AI system safety, failures & limitations.
- Malicious Actors & Misuse
Entity
Which, if any, entity is presented as the main cause of the risk
Human
Timing
The stage in the AI lifecycle at which the risk is presented as occurring
Post-deployment
Intent
Whether the risk is presented as occurring as an expected or unexpected outcome from pursuing a goal
Intentional
Informes del Incidente
Cronología de Informes
Él tiene 18 años y va al instituto preuniversitario Manuel Belgrano de Córdoba. Hace unos meses, dos chicas de 17, que no son de su mismo curso y con las que ni siquiera tenía trato, empezaron a recibir solicitudes en Instagram de hombres d…
Variantes
Una "Variante" es un incidente de IA similar a un caso conocido—tiene los mismos causantes, daños y sistema de IA. En lugar de enumerarlo por separado, lo agrupamos bajo el primer incidente informado. A diferencia de otros incidentes, las variantes no necesitan haber sido informadas fuera de la AIID. Obtenga más información del trabajo de investigación.
¿Has visto algo similar?
Incidentes Similares
Did our AI mess up? Flag the unrelated incidents
Incidentes Similares
Did our AI mess up? Flag the unrelated incidents