Check your artificial intelligence ‘bossware’ tools for bias, says U.S. agency head

May 18, 2023, 8:53 AM

The head of the U.S. agency charged with enforcing civil rights in the workplace says artificial intelligence-driven “bossware” tools that closely track the whereabouts, keystrokes and productivity of workers can also run afoul of discrimination laws.

Charlotte Burrows, chair of the Equal Employment Opportunity Commission, told The Associated Press that the agency is trying to educate employers and technology providers about their use of these surveillance tools as well as AI tools that streamline the work of evaluating job prospects.

And if they aren’t careful with say, draconian schedule-monitoring algorithms that penalize breaks for pregnant women or Muslims taking time to pray, or allowing faulty software to screen out graduates of women’s or historically Black colleges – they can’t blame AI when the EEOC comes calling.

“I’m not shy about using our enforcement authority when it’s necessary,” Burrows said. “We want to work with employers, but there’s certainly no exemption to the civil rights laws because you engage in discrimination some high-tech way.”

The federal agency put out its latest set of guidance Thursday on the use of automated systems in employment decisions such as who to hire or promote. It explains how to interpret a key provision of the Civil Rights Act of 1964 known as Title VII that bars job discrimination based on race, color, national origin, religion or sex, which includes bias against gay, lesbian and transgender workers.

Burrows said one important example involves widely-used resumé screeners and whether or not they can produce a biased result if they are based on biased data.

“What will happen is that there’s an algorithm that is looking for patterns that reflect patterns that it’s already familiar with,” she said. “It will be trained on data that comes from its existing employees. And if you have a non-diverse set of employees currently, you’re likely to end up with kicking out people inadvertently who don’t look like your current employees.”

Amazon, for instance, abandoned its own resume-scanning tool to recruit top talent after finding it favored men for technical roles — in part because it was comparing job candidates against the company’s own male-dominated tech workforce.

sending similar warnings for the past year, with previous sets of guidance about how some AI tools could discriminate against people with disabilities and violate the Americans with Disabilities Act.

In some cases, the EEOC has taken action. In March, the operator of tech job-search website Dice.com settled with the agency to end an investigation over allegations it was allowing job posters to exclude workers of U.S. national origin in favor of immigrants seeking work visas. To settle the case, the parent company, DHI Group, agreed to rewrite its programming to “scrape” for discriminatory language such as “H-1Bs Only,” a reference to a type of work visa.

Much of the EEOC’s work involves investigating the complaints filed by employees who believe they were discriminated against. And while it’s hard for job applicants to know if a biased hiring tool resulted in them being denied a job, Burrows said there is “generally more awareness” among workers about the tools that are increasingly being used to monitor their productivity.

Those tools have ranged from radio frequency devices to track nurses, to monitoring the minute-by-minute tightly controlled schedule of warehouse workers and delivery drivers, to tracking keystrokes or computer mouse clicks as many office employees started working from home during the pandemic. Some might violate civil rights laws, depending on how they’re being used.

Burrows noted that the National Labor Relations Board is also looking at such AI tools. The NLRB sent a memo last year warning that overly intrusive surveillance and management tools can impair the rights of workers to communicate with each other about union activity or unsafe conditions.

“I think that the best approach there — I’m not saying not to use it, it’s not per se illegal — but is to really think what it is that employers are looking to measure and maybe measure that directly,” Burrows said. “If you’re trying to see if the work is getting done, maybe check that the work is getting done.”

United States News

Associated Press

Stock market today: Asian shares mixed after Wall Street hits 2023 high

Asian shares were mixed on Monday after Wall Street reached a 20-month high ahead of a week that includes essential U.S. inflation data and the Federal Reserve’s final rate decision of the year. U.S. futures were lower and oil prices rose to recover some of their sharp losses in recent months. Hong Kong’s Hang Seng […]

52 minutes ago

FILE - Sen. James Lankford, R-Okla., speaks to media about Israel, Wednesday, Oct. 18, 2023, on Cap...

Associated Press

New US aid for Ukraine by year-end seems increasingly out of reach as GOP ties it to border security

A deal to provide further U.S. assistance to Ukraine by year-end appears to be increasingly out of reach for President Joe Biden.

3 hours ago

Associated Press

Downpours, high winds prompt weather warnings in Northeast

NEW YORK (AP) — Parts of the northeast were bracing for a stormy night Sunday, with high winds and heavy rains bringing threats of flooding and power outages through the Monday morning commute. Flood watches were in effect in New York, New Jersey, Connecticut and southern New England through Monday. The National Weather Service said […]

6 hours ago

Associated Press

Woman arrested after driving her vehicle through a religious group on a sidewalk, Montana police say

BILLINGS, Mont. (AP) — A woman has been arrested after she drove her vehicle several times at or through a religious group demonstrating on a sidewalk, hitting and injuring one man, Montana police said Sunday. Genevienne Rancuret, 55, was pulled over by police in Billings on Saturday a few hours after the episode and taken […]

6 hours ago

Associated Press

Students and lawmakers gather at Philadelphia temple to denounce antisemitism

PHILADELPHIA (AP) — Students, lawmakers and religious leaders joined forces Sunday at a temple in Philadelphia to strongly denounce antisemitism on college campuses and in their communities. The gathering at Congregation Rodeph Shalom came one day after University of Pennsylvania President Liz Magill resigned amid criticism over her testimony at a congressional hearing. Magill was […]

7 hours ago

Associated Press

Illinois man who confessed to 2004 sexual assault and murder of 3-year-old girl dies in prison

CHICAGO (AP) — A man who confessed to the 2004 sexual assault and murder of a 3-year-old Illinois girl has died in a state prison, according to state records. Scott Eby, 52, an inmate at the Menard Correctional Center, died Thursday, according to an online inmate notification system. The death of Riley Fox, whose body […]

8 hours ago

Sponsored Articles

Follow @KTAR923...

The best ways to honor our heroes on Veterans Day and give back to the community

Veterans Day is fast approaching and there's no better way to support our veterans than to donate to the Military Assistance Mission.


Midwestern University

Midwestern University: innovating Arizona health care education

Midwestern University’s Glendale Campus near Loop 101 and 59th Avenue is an established leader in health care education and one of Arizona’s largest and most valuable health care resources.



Key dates for Arizona sports fans to look forward to this fall

Fall brings new beginnings in different ways for Arizona’s professional sports teams like the Cardinals and Coyotes.

Check your artificial intelligence ‘bossware’ tools for bias, says U.S. agency head