Check your artificial intelligence ‘bossware’ tools for bias, says U.S. agency head

May 18, 2023, 8:53 AM

FILE - The emblem of the U.S. Equal Employment Opportunity Commission is shown on a podium in Vail,...

FILE - The emblem of the U.S. Equal Employment Opportunity Commission is shown on a podium in Vail, Colo., Tuesday, Feb. 16, 2016, in Denver. Charlotte Burrows, chair of the Equal Employment Opportunity Commission, told The Associated Press, Thursday, May 18, 2023, that the agency is trying to educate employers and technology providers about their use of these surveillance tools as well as AI tools that streamline the work of evaluating job prospects. (AP Photo/David Zalubowski, File)
Credit: ASSOCIATED PRESS

(AP Photo/David Zalubowski, File)

The head of the U.S. agency charged with enforcing civil rights in the workplace says artificial intelligence-driven “bossware” tools that closely track the whereabouts, keystrokes and productivity of workers can also run afoul of discrimination laws.

Charlotte Burrows, chair of the Equal Employment Opportunity Commission, told The Associated Press that the agency is trying to educate employers and technology providers about their use of these surveillance tools as well as AI tools that streamline the work of evaluating job prospects.

And if they aren’t careful with say, draconian schedule-monitoring algorithms that penalize breaks for pregnant women or Muslims taking time to pray, or allowing faulty software to screen out graduates of women’s or historically Black colleges – they can’t blame AI when the EEOC comes calling.

“I’m not shy about using our enforcement authority when it’s necessary,” Burrows said. “We want to work with employers, but there’s certainly no exemption to the civil rights laws because you engage in discrimination some high-tech way.”

The federal agency put out its latest set of guidance Thursday on the use of automated systems in employment decisions such as who to hire or promote. It explains how to interpret a key provision of the Civil Rights Act of 1964 known as Title VII that bars job discrimination based on race, color, national origin, religion or sex, which includes bias against gay, lesbian and transgender workers.

Burrows said one important example involves widely-used resumé screeners and whether or not they can produce a biased result if they are based on biased data.

“What will happen is that there’s an algorithm that is looking for patterns that reflect patterns that it’s already familiar with,” she said. “It will be trained on data that comes from its existing employees. And if you have a non-diverse set of employees currently, you’re likely to end up with kicking out people inadvertently who don’t look like your current employees.”

Amazon, for instance, abandoned its own resume-scanning tool to recruit top talent after finding it favored men for technical roles — in part because it was comparing job candidates against the company’s own male-dominated tech workforce.

sending similar warnings for the past year, with previous sets of guidance about how some AI tools could discriminate against people with disabilities and violate the Americans with Disabilities Act.

In some cases, the EEOC has taken action. In March, the operator of tech job-search website Dice.com settled with the agency to end an investigation over allegations it was allowing job posters to exclude workers of U.S. national origin in favor of immigrants seeking work visas. To settle the case, the parent company, DHI Group, agreed to rewrite its programming to “scrape” for discriminatory language such as “H-1Bs Only,” a reference to a type of work visa.

Much of the EEOC’s work involves investigating the complaints filed by employees who believe they were discriminated against. And while it’s hard for job applicants to know if a biased hiring tool resulted in them being denied a job, Burrows said there is “generally more awareness” among workers about the tools that are increasingly being used to monitor their productivity.

Those tools have ranged from radio frequency devices to track nurses, to monitoring the minute-by-minute tightly controlled schedule of warehouse workers and delivery drivers, to tracking keystrokes or computer mouse clicks as many office employees started working from home during the pandemic. Some might violate civil rights laws, depending on how they’re being used.

Burrows noted that the National Labor Relations Board is also looking at such AI tools. The NLRB sent a memo last year warning that overly intrusive surveillance and management tools can impair the rights of workers to communicate with each other about union activity or unsafe conditions.

“I think that the best approach there — I’m not saying not to use it, it’s not per se illegal — but is to really think what it is that employers are looking to measure and maybe measure that directly,” Burrows said. “If you’re trying to see if the work is getting done, maybe check that the work is getting done.”

United States News

FILE - Jackson residents and supporters march with members of the Poor People's Campaign of Mississ...

Associated Press

Mississippi harms free speech by requiring state permits before protests, lawsuit says

JACKSON, Miss. (AP) — A new Mississippi law will restrict free speech by requiring people to obtain permission from state law enforcement officials for any protest near the statehouse, Governor’s Mansion or other state government buildings in the capital city of Jackson, according to a lawsuit that seeks to block the mandate from taking effect […]

11 hours ago

FILE - Sen. John Barrasso, R-Wyo., speaks during a Senate Energy and Natural Resources hearing, May...

Associated Press

Kentucky pauses incentives for battery maker whose federal loan was nixed after claims of China ties

NASHVILLE, Tenn. (AP) — Kentucky officials say they won’t start paying out $21 million in economic incentives for a proposed electric vehicle battery facility until the company further explains why the U.S. Department of Energy abruptly rejected a $200 million loan for the project after some congressional Republicans argued the firm has improper ties to […]

11 hours ago

FILE - California Attorney General Rob Bonta speaks at a news conference at the Capitol in Sacramen...

Associated Press

California attorney general blames Florida for charter flight that took migrants to Sacramento

Florida appears to have arranged for a group of migrants to be transported from Texas to California and dropped off in Sacramento, California's attorney general said.

11 hours ago

FILE - A Norfolk Southern freight train rolls through downtown Pittsburgh, on March 26, 2018. Norfo...

Associated Press

Norfolk Southern is first railroad to give all workers sick time but all see progress in labor talks

OMAHA, Neb. (AP) — Norfolk Southern became the first major freight railroad with making progress with nearly 60% of all rail workers securing this basic benefit since the start of the year. All of the major freight railroads have said they are committed to resolving this key issue that nearly led to a strike in […]

11 hours ago

FILE - Workers harvest wild blueberries at the Ridgeberry Farm Friday, July 27, 2012, in Appleton, ...

Associated Press

Wild blueberry production takes a dip in the face of drought

PORTLAND, Maine (AP) — The nation’s production of wild blueberries slipped a bit last year as some growers contended with drought. Wild blueberries are smaller than their cultivated cousins and are widely used in frozen and processed products such as smoothie mixes. Maine is the only state in the U.S. where the blueberries are harvested […]

11 hours ago

FILE - Binance CEO Changpeng Zhao answers a question during a Zoom meeting interview with The Assoc...

Associated Press

SEC says crypto firm Binance mishandled funds, violated securities laws

WASHINGTON (AP) — The world’s largest cryptocurrency exchange Binance and its founder Changpeng Zhao are accused of misusing investor funds, operating as an unregistered exchange and violating a slew of U.S. securities laws in a lawsuit filed by the SEC. Filed in the U.S. District Court for the District of Columbia, the Securities and Exchange […]

11 hours ago

Sponsored Articles

...

SANDERSON FORD

Thank you to Al McCoy for 51 years as voice of the Phoenix Suns

Sanderson Ford wants to share its thanks to Al McCoy for the impact he made in the Valley for more than a half-decade.

(Desert Institute for Spine Care in Arizona Photo)...

Desert Institute for Spine Care in Arizona

5 common causes for chronic neck pain

Neck pain can debilitate one’s daily routine, yet 80% of people experience it in their lives and 20%-50% deal with it annually.

(Photo by Michael Matthey/picture alliance via Getty Images)...

Cox Communications

Valley Boys & Girls Club uses esports to help kids make healthy choices

KTAR’s Community Spotlight focuses on the Boys & Girls Club of the Valley and the work to incorporate esports into children's lives.

Check your artificial intelligence ‘bossware’ tools for bias, says U.S. agency head