UN urges moratorium on use of AI that imperils human rights
The U.N. human rights chief is calling for a moratorium on the use of artificial intelligence technology that poses a serious risk to human rights, including face-scanning systems that track people in public spaces
Your support helps us to tell the story
From reproductive rights to climate change to Big Tech, The Independent is on the ground when the story is developing. Whether it's investigating the financials of Elon Musk's pro-Trump PAC or producing our latest documentary, 'The A Word', which shines a light on the American women fighting for reproductive rights, we know how important it is to parse out the facts from the messaging.
At such a critical moment in US history, we need reporters on the ground. Your donation allows us to keep sending journalists to speak to both sides of the story.
The Independent is trusted by Americans across the entire political spectrum. And unlike many other quality news outlets, we choose not to lock Americans out of our reporting and analysis with paywalls. We believe quality journalism should be available to everyone, paid for by those who can afford it.
Your support makes all the difference.The U.N. human rights chief is calling for a moratorium on the use of artificial intelligence technology that poses a serious risk to human rights, including face-scanning systems that track people in public spaces.
Michelle Bachelet the U.N. High Commissioner for Human Rights, also said Wednesday that countries should expressly ban AI applications that don’t comply with international human rights law.
Applications that should be prohibited include government “social scoring” systems that judge people based on their behavior and certain AI-based tools that categorize people into clusters such as by ethnicity or gender.
AI-based technologies can be a force for good but they can also “have negative, even catastrophic, effects if they are used without sufficient regard to how they affect people’s human rights,” Bachelet said in a statement.
Her comments came with a new U.N. report that examines how countries and businesses have rushed into applying AI systems that affect people’s lives and livelihoods without setting up proper safeguards to prevent discrimination and other harms.
She didn't call for an outright ban of facial recognition technology, but said governments should halt the scanning of people's features in real time until they can show the technology is accurate, won't discriminate and meets certain privacy and data protection standards.
While countries weren't mentioned by name in the report, China in particular has been among the countries that have rolled out facial recognition technology — particularly as part of surveillance in the western region of Xinjiang where many of its minority Uyghers live.
The report also voices wariness about tools that try to deduce people's emotional and mental states by analyzing their facial expressions or body movements, saying such technology is susceptible to bias, misinterpretations and lacks scientific basis.
“The use of emotion recognition systems by public authorities, for instance for singling out individuals for police stops or arrests or to assess the veracity of statements during interrogations, risks undermining human rights, such as the rights to privacy, to liberty and to a fair trial,” the report says.
The report’s recommendations echo the thinking of many political leaders in Western democracies, who hope to tap into AI's economic and societal potential while addressing growing concerns about the reliability of tools that can track and profile individuals and make recommendations about who gets access to jobs, loans and educational opportunities.
European regulators have already taken steps to rein in the riskiest AI applications. Proposed regulations outlined by European Union officials this year would ban some uses of AI, such as real-time scanning of facial features, and tightly control others that could threaten people's safety or rights.
U.S. President Joe Biden's administration has voiced similar concerns about such applications, though it hasn't yet outlined a detailed approach to curtailing them. A newly formed group called the Trade and Technology Council, jointly led by American and European officials, has sought to collaborate on developing shared rules for AI and other tech policy.
Efforts to set limits on the riskiest uses have been backed by Microsoft and other U.S. tech giants that hope to guide the rules affecting the technology they've helped to build.
“If you think about the ways that AI could be used in a discriminatory fashion, or to further strengthen discriminatory tendencies, it is pretty scary," said U.S. Commerce Secretary Gina Raimondo during a virtual conference in June. “We have to make sure we don’t let that happen.”
She was speaking with Margrethe Vestager the European Commission’s executive vice president for the digital age, who suggested some AI uses should be off-limits completely in “democracies like ours,” such as social scoring that can close off someone’s privileges in society, and “broad, blanket use of remote biometric identification in public space.”
She said there's something fundamental about being able to say, “I live in a real society. I’m not living in the trailer of a horror movie that I don’t want to see the end of.”
———-
O'Brien reported from Providence, Rhode Island.