Incident 594: AI Meal Planner Suggests Hazardous Chlorine Gas Recipe

Description: Pak 'n' Save's AI-based app, Savey Meal-bot, inadvertently suggested dangerous recipes, including one creating chlorine gas, when users entered non-food household items, raising safety and oversight concerns.

Tools

New ReportNew ReportNew ResponseNew ResponseDiscoverDiscoverView HistoryView History
Alleged: Pak 'n' Save developed and deployed an AI system, which harmed Potential users of the Savey Meal-bot.

Incident Stats

Incident ID
594
Report Count
1
Incident Date
2023-08-10
Editors
Daniel Atherton
Supermarket AI meal planner app suggests recipe that would create chlorine gas
theguardian.com · 2023

A New Zealand supermarket experimenting with using AI to generate meal plans has seen its app produce some unusual dishes – recommending customers recipes for deadly chlorine gas, “poison bread sandwiches” and mosquito-repellent roast potat…

Variants

A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.