Skip to Content
logologo
AI Incident Database
Open TwitterOpen RSS FeedOpen FacebookOpen LinkedInOpen GitHub
Open Menu
Descubrir
Enviar
  • Bienvenido a la AIID
  • Descubrir Incidentes
  • Vista espacial
  • Vista Tabular
  • Vista de lista
  • Entidades
  • Taxonomías
  • Enviar Informes de Incidentes
  • Ranking de Reportadores
  • Blog
  • Resumen de noticias de IA
  • Control de Riesgos
  • Incidente aleatorio
  • Registrarse
Colapsar
Descubrir
Enviar
  • Bienvenido a la AIID
  • Descubrir Incidentes
  • Vista espacial
  • Vista Tabular
  • Vista de lista
  • Entidades
  • Taxonomías
  • Enviar Informes de Incidentes
  • Ranking de Reportadores
  • Blog
  • Resumen de noticias de IA
  • Control de Riesgos
  • Incidente aleatorio
  • Registrarse
Colapsar

Incidente 140: ProctorU’s Identity Verification and Exam Monitoring Systems Provided Allegedly Discriminatory Experiences for BIPOC Students

Descripción: An exam monitoring service used by the University of Toronto was alleged by its students to have provided discriminatory check-in experiences via its facial recognition's failure to verify passport photo, disproportionately enhancing disadvantaging stress level for BIPOC students.

Herramientas

Nuevo InformeNuevo InformeNueva RespuestaNueva RespuestaDescubrirDescubrirVer HistorialVer Historial

Entidades

Ver todas las entidades
Alleged: ProctorU developed an AI system deployed by University of Toronto, which harmed University of Toronto BIPOC students.

Estadísticas de incidentes

ID
140
Cantidad de informes
1
Fecha del Incidente
2020-06-01
Editores
Sean McGregor, Khoa Lam
Applied Taxonomies
CSETv1, GMF, MIT

Clasificaciones de la Taxonomía CSETv1

Detalles de la Taxonomía

Incident Number

The number of the incident in the AI Incident Database.
 

140

Notes (special interest intangible harm)

Input any notes that may help explain your answers.
 

This differential treatment affects people's public education, which is a civil rights/liberty violation.

Special Interest Intangible Harm

An assessment of whether a special interest intangible harm occurred. This assessment does not consider the context of the intangible harm, if an AI was involved, or if there is characterizable class or subgroup of harmed entities. It is also not assessing if an intangible harm occurred. It is only asking if a special interest intangible harm occurred.
 

yes

Date of Incident Year

The year in which the incident occurred. If there are multiple harms or occurrences of the incident, list the earliest. If a precise date is unavailable, but the available sources provide a basis for estimating the year, estimate. Otherwise, leave blank. Enter in the format of YYYY
 

2020

Date of Incident Month

The month in which the incident occurred. If there are multiple harms or occurrences of the incident, list the earliest. If a precise date is unavailable, but the available sources provide a basis for estimating the month, estimate. Otherwise, leave blank. Enter in the format of MM
 

12

Estimated Date

“Yes” if the data was estimated. “No” otherwise.
 

Yes

Clasificaciones de la Taxonomía MIT

Machine-Classified
Detalles de la Taxonomía

Risk Subdomain

A further 23 subdomains create an accessible and understandable classification of hazards and harms associated with AI
 

1.1. Unfair discrimination and misrepresentation

Risk Domain

The Domain Taxonomy of AI Risks classifies risks into seven AI risk domains: (1) Discrimination & toxicity, (2) Privacy & security, (3) Misinformation, (4) Malicious actors & misuse, (5) Human-computer interaction, (6) Socioeconomic & environmental harms, and (7) AI system safety, failures & limitations.
 
  1. Discrimination and Toxicity

Entity

Which, if any, entity is presented as the main cause of the risk
 

AI

Timing

The stage in the AI lifecycle at which the risk is presented as occurring
 

Post-deployment

Intent

Whether the risk is presented as occurring as an expected or unexpected outcome from pursuing a goal
 

Unintentional

Informes del Incidente

Cronología de Informes

Incident OccurrenceLos estudiantes de BIPOC enfrentan desventajas con el software de monitoreo de exámenes en la Universidad de Toronto
Los estudiantes de BIPOC enfrentan desventajas con el software de monitoreo de exámenes en la Universidad de Toronto

Los estudiantes de BIPOC enfrentan desventajas con el software de monitoreo de exámenes en la Universidad de Toronto

thestrand.ca

Los estudiantes de BIPOC enfrentan desventajas con el software de monitoreo de exámenes en la Universidad de Toronto
thestrand.ca · 2021
Traducido por IA

En respuesta a las protestas de George Floyd, Meric Gertler, presidente de la Universidad de Toronto, condenó las “injusticias sistémicas” del racismo contra los negros “en los términos más enérgicos posibles”.

“El racismo no es un problema…

Variantes

Una "Variante" es un incidente que comparte los mismos factores causales, produce daños similares e involucra los mismos sistemas inteligentes que un incidente de IA conocido. En lugar de indexar las variantes como incidentes completamente separados, enumeramos las variaciones de los incidentes bajo el primer incidente similar enviado a la base de datos. A diferencia de otros tipos de envío a la base de datos de incidentes, no se requiere que las variantes tengan informes como evidencia externa a la base de datos de incidentes. Obtenga más información del trabajo de investigación.

Incidentes Similares

Por similitud de texto

Did our AI mess up? Flag the unrelated incidents

Alleged Issues with Proctorio's Remote-Testing AI Prompted Suspension by University

University of Illinois to Discontinue Remote-Testing Software After Students Complain of Privacy Violation

Jan 2020 · 6 informes
Twitter’s Image Cropping Tool Allegedly Showed Gender and Racial Bias

Twitter's Photo Crop Algorithm Favors White Faces and Women

Sep 2020 · 5 informes
WeChat’s Machine Translation Gave a Racist English Translation for the Chinese Term for “Black Foreigner”

WeChat Apologizes for Translating ‘Black Foreigner’ as N-Word

Oct 2017 · 5 informes
Incidente AnteriorSiguiente Incidente

Incidentes Similares

Por similitud de texto

Did our AI mess up? Flag the unrelated incidents

Alleged Issues with Proctorio's Remote-Testing AI Prompted Suspension by University

University of Illinois to Discontinue Remote-Testing Software After Students Complain of Privacy Violation

Jan 2020 · 6 informes
Twitter’s Image Cropping Tool Allegedly Showed Gender and Racial Bias

Twitter's Photo Crop Algorithm Favors White Faces and Women

Sep 2020 · 5 informes
WeChat’s Machine Translation Gave a Racist English Translation for the Chinese Term for “Black Foreigner”

WeChat Apologizes for Translating ‘Black Foreigner’ as N-Word

Oct 2017 · 5 informes

Investigación

  • Definición de un “Incidente de IA”
  • Definición de una “Respuesta a incidentes de IA”
  • Hoja de ruta de la base de datos
  • Trabajo relacionado
  • Descargar Base de Datos Completa

Proyecto y Comunidad

  • Acerca de
  • Contactar y Seguir
  • Aplicaciones y resúmenes
  • Guía del editor

Incidencias

  • Todos los incidentes en forma de lista
  • Incidentes marcados
  • Cola de envío
  • Vista de clasificaciones
  • Taxonomías

2024 - AI Incident Database

  • Condiciones de uso
  • Política de privacidad
  • Open twitterOpen githubOpen rssOpen facebookOpen linkedin
  • ecd56df