Uber Eats driver wins payout over discriminatory facial recognition checks
Pa Edrissa Manjang was removed from the delivery firm’s platform after its facial recognition system failed to recognise him.
Your support helps us to tell the story
From reproductive rights to climate change to Big Tech, The Independent is on the ground when the story is developing. Whether it's investigating the financials of Elon Musk's pro-Trump PAC or producing our latest documentary, 'The A Word', which shines a light on the American women fighting for reproductive rights, we know how important it is to parse out the facts from the messaging.
At such a critical moment in US history, we need reporters on the ground. Your donation allows us to keep sending journalists to speak to both sides of the story.
The Independent is trusted by Americans across the entire political spectrum. And unlike many other quality news outlets, we choose not to lock Americans out of our reporting and analysis with paywalls. We believe quality journalism should be available to everyone, paid for by those who can afford it.
Your support makes all the difference.An Uber Eats driver has received a payout to end a legal claim following allegations that the platform’s AI-powered facial recognition checks required to work for the delivery firm were racially discriminatory.
In 2021, Pa Edrissa Manjang was told he was being removed from working for the platform because of “continued mismatches” in the photos he submitted to the facial recognition system required for drivers to access the platform and work.
Mr Manjang, who is black, said he had experienced continuous difficulties with the verification process and was regularly asked to resubmit selfie images of himself to the platform as it did not recognise him, despite no change to his appearance.
It is important to understand that as AI usage increases, the technology can lead to discrimination and human rights abuses
Following his dismissal, he launched a legal claim with support and funding from the Equality and Human Rights Commission (EHRC) and the App Drivers and Couriers Union (ADCU), who said they were concerned by the use of artificial intelligence and automation in the case, particularly how it could be used to permanently suspend a driver’s access to the app, and therefore, work.
Baroness Kishwer Falkner, chairwoman of the EHRC, said: “I am pleased that Pa Edrissa Manjang was able to settle his case with Uber Eats, but he should never have had to bring a legal claim in order to understand the opaque processes that affected his work.
“AI is complex, and presents unique challenges for employers, lawyers and regulators. It is important to understand that as AI usage increases, the technology can lead to discrimination and human rights abuses.
My case shines a spotlight on the potential problems with the use of AI, particularly for low paid workers in the gig economy who want to understand how decisions are being taken which affect their livelihoods
“We are particularly concerned that Mr Manjang was not made aware that his account was in the process of deactivation, nor provided any clear and effective route to challenge the technology. More needs to be done to ensure employers are transparent and open with their workforces about when and how they use AI.
“Every employer should take note of this, even major companies like Uber. When such companies rely on automation to help manage their staff they need to guard against unlawful discrimination.”
Mr Manjang said: “My case shines a spotlight on the potential problems with the use of AI, particularly for low paid workers in the gig economy who want to understand how decisions are being taken which affect their livelihoods. This marks the end of a long and difficult case.
“I am sure the EHRC will use the learnings and experience of this case to move towards strengthening the rights and protections of workers in relation to AI, particularly ethnic minorities.”
An Uber spokesperson said: “Our Real Time ID check is designed to help keep everyone who uses our app safe, and includes robust human review to make sure that we’re not making decisions about someone’s livelihood in a vacuum, without oversight.
“Automated facial verification was not the reason for Mr Manjang’s temporary loss of access to his courier account.”