Incident 514: Turnitin's ChatGPT-Detection Tool Falsely Flagged Student Essays as AI-Generated

Description: Turnitin's tool to detect writing generated by ChatGPT was reported for incorrectly flagging high school students' original essays as AI-generated, accusations of which are argued as reinforcement of bias from teachers due to the inability to compare against source documents.

Tools

New ReportNew ReportNew ResponseNew ResponseDiscoverDiscoverView HistoryView History
Alleged: Turnitin developed and deployed an AI system, which harmed Lucy Goetz and high school students.

Incident Stats

Incident ID
514
Report Count
1
Incident Date
2023-01-20
Editors
Khoa Lam
We tested a new ChatGPT-detector for teachers. It flagged an innocent student.
washingtonpost.com · 2023

High school senior Lucy Goetz got the highest possible grade on an original essay she wrote about socialism. So imagine her surprise when I told her that a new kind of educational software I’ve been testing claimed she got help from artific…

Variants

A "variant" is an incident that shares the same causative factors, produces similar harms, and involves the same intelligent systems as a known AI incident. Rather than index variants as entirely separate incidents, we list variations of incidents under the first similar incident submitted to the database. Unlike other submission types to the incident database, variants are not required to have reporting in evidence external to the Incident Database. Learn more from the research paper.