Description: Generative AI hallucinated non-existent software packages, which were then created and uploaded (as an experiment) by security researcher Bar Lanyado. One such package, "huggingface-cli," was downloaded over 15,000 times, including by large companies like Alibaba. Regardless of the framing of it as an experiment, this incident is an example of harm caused by AI-generated hallucinations in coding, as the fake packages were still distributed widely and with potential malware.
Entidades
Ver todas las entidadesAlleged: Bar Lanyado developed an AI system deployed by Developers using AI-generated suggestions y Bar Lanyado, which harmed Developers and businesses incorporating AI-suggested packages y Alibaba.
Estadísticas de incidentes
ID
731
Cantidad de informes
1
Fecha del Incidente
2023-12-01
Editores
Daniel Atherton
Informes del Incidente
Cronología de Informes
theregister.com · 2024
- Ver el informe original en su fuente
- Ver el informe en el Archivo de Internet
Several big businesses have published source code that incorporates a software package previously hallucinated by generative AI.
Not only that but someone, having spotted this reoccurring hallucination, had turned that made-up dependency in…
Variantes
Una "Variante" es un incidente que comparte los mismos factores causales, produce daños similares e involucra los mismos sistemas inteligentes que un incidente de IA conocido. En lugar de indexar las variantes como incidentes completamente separados, enumeramos las variaciones de los incidentes bajo el primer incidente similar enviado a la base de datos. A diferencia de otros tipos de envío a la base de datos de incidentes, no se requiere que las variantes tengan informes como evidencia externa a la base de datos de incidentes. Obtenga más información del trabajo de investigación.
Incidentes Similares
Did our AI mess up? Flag the unrelated incidents
Incidentes Similares
Did our AI mess up? Flag the unrelated incidents