Registro de citas para el Incidente 94

Description: In December 2020, an Italian court ruled that Deliveroo’s employee ‘reliability’ algorithm illegally discriminated against workers with legitimate reasons for cancelling shifts.

Herramientas

Nuevo InformeNuevo InformeNueva RespuestaNueva RespuestaDescubrirDescubrirVer HistorialVer Historial
Presunto: un sistema de IA desarrollado e implementado por Deliveroo, perjudicó a Deliveroo workers with legitimate reasons for cancelling shifts y Deliveroo workers.

Estadísticas de incidentes

ID
94
Cantidad de informes
2
Fecha del Incidente
2020-11-27
Editores
Sean McGregor, Khoa Lam

Clasificaciones de la Taxonomía CSETv0

Detalles de la Taxonomía

Full Description

In December 2020, an Italian court ruled that an algorithm used by Deliveroo, a popular app-based bicycle food delivery company, resulted in discriminatory employee management. The case – brought by Italian labor group Confederazione Generale Italiana del Lavoro (CGIL) – centered on the app’s algorithm to assign delivery workers a “reliability rating.” The rating was based in part on how much notice the employees gave before cancelling shifts and was used to determine preference order in future shift scheduling. The Tribunale Ordinario di Bologna decided that because the employees were not allowed to give justification for cancellations, Deliveroo was illegally discrimination against those with legitimate reasons for rescheduling.

Short Description

In December 2020, an Italian court ruled that Deliveroo’s employee ‘reliability’ algorithm illegally discriminated against workers with legitimate reasons for cancelling shifts.

Severity

Moderate

Harm Distribution Basis

Other:Those with emegencies, illness, unexpected circumstances

Harm Type

Harm to civil liberties

AI System Description

Deliveroo's machine learning algorithm used to calculate employees' 'reliability' rating.

System Developer

Deliveroo

Sector of Deployment

Accommodation and food service activities

Relevant AI functions

Cognition, Action

AI Techniques

machine learning

AI Applications

data analytics, optimization, decision making

Location

Italy

Named Entities

Deliveroo, Confederazione Generale Italiana del Lavoro, Tribunale Ordinario di Bologna

Technology Purveyor

Deliveroo

Beginning Date

11/2020

Ending Date

12/2020

Near Miss

Harm caused

Intent

Accident

Lives Lost

No

Laws Implicated

Italian employee fairness law

Data Inputs

employee activity history, shift schedules

Un tribunal italiano falla contra el algoritmo "discriminatorio" de clasificación de pasajeros de Deliveroo
techcrunch.com · 2021

Un tribunal en Italia asestó un golpe a la gestión algorítmica pura después de un desafío legal presentado por tres sindicatos. El tribunal de Bolonia dictaminó que un algoritmo de clasificación de reputación utilizado por la plataforma de …

La corte dictamina que Deliveroo usó un algoritmo 'discriminatorio'
vice.com · 2021

Un algoritmo utilizado por la popular aplicación europea de entrega de alimentos Deliveroo para clasificar y ofrecer turnos a los pasajeros es discriminatorio, dictaminó un tribunal italiano a fines de la semana pasada, en lo que algunos ex…

Variantes

Una "Variante" es un incidente que comparte los mismos factores causales, produce daños similares e involucra los mismos sistemas inteligentes que un incidente de IA conocido. En lugar de indexar las variantes como incidentes completamente separados, enumeramos las variaciones de los incidentes bajo el primer incidente similar enviado a la base de datos. A diferencia de otros tipos de envío a la base de datos de incidentes, no se requiere que las variantes tengan informes como evidencia externa a la base de datos de incidentes. Obtenga más información del trabajo de investigación.