Amazon face-detection technology shows gender and racial bias, researchers say

/ AP

Facial-detection technology that Amazon is marketing to law enforcement often misidentifies women, particularly those with darker skin, according to researchers from MIT and the University of Toronto. Privacy and civil rights advocates have called on Amazon to stop marketing its Rekognition service because of worries about discrimination against minorities.

Some Amazon investors have also asked the company to stop out of fear that it makes Amazon vulnerable to lawsuits.

The researchers said that in their tests, Amazon's technology labeled darker-skinned women as men 31 percent of the time. Lighter-skinned women were misidentified 7 percent of the time. Darker-skinned men had a 1 percent error rate, while lighter-skinned men had none.

Artificial intelligence can mimic the biases of their human creators as they make their way into everyday life. The new study, released late Thursday, warns of the potential of abuse and threats to privacy and civil liberties from facial-detection technology.

Demonstrators hold images of Amazon CEO Jeff Bezos near their faces during a Halloween-themed protest at Amazon headquarters over the company's facial recognition system, "Rekognition," Oct. 31, 2018, in Seattle. Elaine Thompson / AP

Matt Wood, general manager of artificial intelligence with Amazon's cloud-computing unit, said the study uses a "facial analysis" and not "facial recognition" technology. Wood said facial analysis "can spot faces in videos or images and assign generic attributes such as wearing glasses; recognition is a different technique by which an individual face is matched to faces in videos and images."

In a Friday post on the Medium website, MIT Media Lab researcher Joy Buolamwini responded that companies should check all systems that analyze human faces for bias.

"If you sell one system that has been shown to have bias on human faces, it is doubtful your other face-based products are also completely bias free," she wrote.

Amazon's reaction shows that it isn't taking the "really grave concerns revealed by this study seriously," said Jacob Snow, an attorney with the American Civil Liberties Union.

Buolamwini and Inioluwa Deborah Raji of the University of Toronto said they studied Amazon's technology because the company has marketed it to law enforcement. Raji's LinkedIn account says she is currently a research mentee for artificial intelligence at Google, which competes with Amazon in offering cloud-computing services.

Buolamwini and Raji say Microsoft and IBM have improved their facial-recognition technology since researchers discovered similar problems in a May 2017 study. Their second study, which included Amazon, was done in August 2018. Their paper will be presented on Monday at an artificial intelligence conference in Honolulu.

Wood said Amazon has updated its technology since the study and done its own analysis with "zero false positive matches."

Amazon's website credits Rekognition for helping the Washington County Sheriff Office in Oregon speed up how long it took to identify suspects from hundreds of thousands of photo records.

First published on January 25, 2019

© 2019 The Associated Press. All Rights Reserved. This material may not be published, broadcast, rewritten, or redistributed.

Amazon Protest

Amazon facial technology shows bias, researchers say

Facial-detection technology that Amazon markets to law enforcement often misidentifies women, particularly those with darker skin, according to new research

updated 1M ago

Texas student killed, another injured as school bus collides with train

The district said the bus driver was rushed to a hospital in an ambulance

updated 27M ago

"Pizzagate" restaurant survives arson attempt

Investigators say the suspect is a "white male, 25 – 30 years old, with blonde hair, mustache and a beard"

updated 47M ago

Chef José Andrés pledges help to federal employees

For weeks, thousands of federal employees have been coming to kitchens operated by Andrés' nonprofit to pick up a free hot meal

updated 53M ago

Congress passes deal to reopen government – live updates

President Trump announced that Democrats and Republicans had reached a deal to reopen the government Friday afternoon

updated 49M ago

"Pizzagate" restaurant survives arson attempt

Investigators say the suspect is a "white male, 25 – 30 years old, with blonde hair, mustache and a beard"

updated 47M ago

Chef José Andrés pledges help to federal employees

For weeks, thousands of federal employees have been coming to kitchens operated by Andrés' nonprofit to pick up a free hot meal

updated 53M ago

Congress passes deal to reopen government – live updates

President Trump announced that Democrats and Republicans had reached a deal to reopen the government Friday afternoon

updated 49M ago

Trump agreed to reopen the government for 3 weeks. Here's what comes next

Senate Minority Leader Chuck Schumer said they will work to reopen the government "today"

1H ago

Trump to sign bill to reopen government for 3 weeks

He announced this development on the government shutdown at the White House Friday afternoon

1H ago

Endangered lemurs could help humans fight disease

Madagascar's lemurs could hold the key to solving human diseases like Alzheimer's and diabetes, but they're at risk of being wiped out

2H ago

Bahamian restaurateur to share GoFundMe riches

She's met her goal and donations keep coming: "People from all over the Bahamas are asking for help," Maryann Rolle says

2H ago

7 dead, hundreds missing after dam collapse floods town in sludge

Brazilian mining company Vale SA said in a statement that the flow reached the community of Vila Ferteco and an administrative office

2H ago

Detained American's brother says lawyer "was chosen for him"

"We remain in the dark about who made the choice if Paul didn't," David Whelan says

4H ago

Australians suffer as heatwave knocks out power, fuels fires

Dizzying temps well over 110 degrees are setting records across the country as drought parched lands are scorched by wildfire

9H ago

"Top Chef" star Fatima Ali has died at 29

In a letter to her 18-year-old self, Ali advised herself to "enjoy the next 10 years that you have, because you will never get that valuable time back"

2H ago

Oswalt surprises Twitter troll with act of kindness

Patton Oswalt helped pay for Vietnam veteran Michael Beatty's medical expenses after Beatty bashed him on social media

3H ago

Rapper Nelly seeks dismissal of sexual assault lawsuit

The rapper Nelly is asking a U.S. court to dismiss a British woman's lawsuit that alleges he sexually assaulted her after a concert in England

3H ago

Kim Porter's cause of death revealed

Coroner office officials say former model and actress Kim Porter died last year ​from lobar pneumonia

3H ago

"Princess Diaries 3" in the works

In the words of Mia Thermopolis: "Shut. Up."

8H ago

Amazon facial technology shows bias, researchers say

Facial-detection technology that Amazon markets to law enforcement often misidentifies women, particularly those with darker skin, according to new research

updated 1M ago

Endangered lemurs could help humans fight disease

Madagascar's lemurs could hold the key to solving human diseases like Alzheimer's and diabetes, but they're at risk of being wiped out

2H ago

"We've entered a new era" of climate concern, survey finds

A new survey shows Americans are more convinced than ever about the impact of climate change

3H ago

11,000 at Microsoft trapped in "reply all" loop

Social-media posts by employees describe some of the hazards — and horrors — that can come from hitting "reply all"

4H ago

Hope fading for Mars Opportunity rover

NASA engineers have not given up trying to revive the Opportunity Mars rover in the wake of a dust storm last year – but "we're getting close to the end"

5H ago

Father who lost son to addiction seeks justice from drug makers

Members of the Sackler family are accused of marketing the drug, even though they knew how addictive it can be

1H ago

Salmonella outbreak linked to pet hedgehogs

These prickly little mammals are increasingly popular as pets, but don't kiss or snuggle them, health officials warn

1H ago

Head injuries common in e-scooter crashes, study finds

This trendy mode of transportation has a hazardous downside

4H ago

"The Happiness Project" author on how to combat loneliness

One in 10 Americans say they feel lonely or isolated from those around them all or most of the time, according to a Pew Research Center survey

6H ago

Whole Foods recalls wraps, other products with spinach due to salmonella risk

Ready-to-eat products sold at the grocery chain's stores in eight states may be contaminated by bacterial infection

8H ago

Bitcoin no longer worth the mining cost, JPMorgan says

Running high-powered computers to process data blocks costs more than the cryptocurrency is worth, analysts find

2H ago

Fiat Chrysler recalls 182K pickups for power steering failures

It's the second recall in just over two weeks for the automaker, which has also recalled cars over exploding airbags

3H ago

Bahamian restaurateur to share GoFundMe riches

She's met her goal and donations keep coming: "People from all over the Bahamas are asking for help," Maryann Rolle says

2H ago

9 tax deductions you can no longer claim

Don't count on these popular deductions to reduce your tax bill this year – they're gone as part of broader tax cuts

4H ago

Ketchup "caviar" and other Valentine's Day's promotions

With consumers set to open their wallets to show their love, food companies are cooking up some V-Day treats

4H ago

Amazon facial technology shows bias, researchers say

Facial-detection technology that Amazon markets to law enforcement often misidentifies women, particularly those with darker skin, according to new research

updated 1M ago

Cop shot dead by her colleague while "playing with firearms"

A probable cause statement from Gardner's office says Hendren and Alix were "playing with firearms" when the shooting occurred

updated 16M ago

Video showing cops' deadly struggle with teen sparks outrage

A Maryland prosecutor said his office "is not empowered to prosecute tragic acts" after the death of Anton Black

2H ago

Rapper Nelly seeks dismissal of sexual assault lawsuit

The rapper Nelly is asking a U.S. court to dismiss a British woman's lawsuit that alleges he sexually assaulted her after a concert in England

3H ago

Video shows predawn raid on Roger Stone's house

FBI agents in combat gear fanned out just before dawn in front of Florida home of Trump​'s former campaign adviser

4H ago  Original Article