YouTube sends gun videos to 9-year-olds: ‘It’s not the kids. It’s the algorithms,’ study finds

May 16, 2023, 12:00 PM

FILE - The YouTube app is displayed on an iPad in Baltimore on March 20, 2018. YouTube is great at ...

FILE - The YouTube app is displayed on an iPad in Baltimore on March 20, 2018. YouTube is great at sending users videos that it thinks they'll like based on their interests. But new research shows the site's powerful algorithms can also flood young users with violent and disturbing content. The non-profit Tech Transparency Project created YouTube accounts mimicking the behavior of young boys with an interest in first-person shooter games. (AP Photo/Patrick Semansky, File)
Credit: ASSOCIATED PRESS

(AP Photo/Patrick Semansky, File)

WASHINGTON (AP) — When researchers at a nonprofit that studies social media wanted to understand the connection between YouTube videos and gun violence, they set up accounts on the platform that mimicked the behavior of typical boys living in the U.S.

They simulated two nine-year-olds who both liked video games, especially first-person shooter games. The accounts were identical, except that one clicked on the videos recommended by YouTube, and the other ignored the platform’s suggestions.

The account that clicked on YouTube’s suggestions was soon flooded with graphic videos about school shootings, tactical gun training videos and how-to instructions on making firearms fully automatic. One video featured an elementary school-age girl wielding a handgun; another showed a shooter using a .50 caliber gun to fire on a dummy head filled with lifelike blood and brains. Many of the videos violate YouTube’s own policies against violent or gory content.

The findings show that despite YouTube’s rules and content moderation efforts, the platform is failing to stop the spread of frightening videos that could traumatize vulnerable children — or send them down dark roads of extremism and violence.

“Video games are one of the most popular activities for kids. You can play a game like ”Call of Duty” without ending up at a gun shop — but YouTube is taking them there,” said Katie Paul, director of the Tech Transparency Project, the research group that published its findings about YouTube on Tuesday. “It’s not the video games, it’s not the kids. It’s the algorithms.”

The accounts that followed YouTube’s suggested videos received 382 different firearms-related videos in a single month, or about 12 per day. The accounts that ignored YouTube’s recommendations still received some gun-related videos, but only 34 in total.

The researchers also created accounts mimicking 14-year-old boys who liked video games; those accounts also received similar levels of gun- and violence-related content.

One of the videos recommended for the accounts was titled “How a Switch Works on a Glock (Educational Purposes Only).” YouTube later removed the video after determining it violated its rules; an almost identical video popped up two weeks later with a slightly altered name; that video remains available.

Messages seeking comment from YouTube were not immediately returned on Tuesday. Executives at the platform, which is owned by Google, have said that identifying and removing harmful content is a priority, as is protecting its youngest users. YouTube requires users under 17 to get their parent’s permission before using their site; accounts for users younger than 13 are linked to the parental account.

Along with TikTok, the video sharing platform is one of the most popular sites for children and teens. Both sites have been eating disorders and self-harm. Critics of social media have also pointed to the links between social media, radicalization and real-world violence.

The perpetrators behind many recent mass shootings have posts on YouTube, the shooter behind the attack on a 2018 attack on a school in Parkland, Fla., that killed 17 wrote “I wanna kill people,” “I’m going to be a professional school shooter” and “I have no problem shooting a girl in the chest.”

The neo-Nazi gunman who killed eight people earlier this month at a Dallas-area shopping center also had a YouTube account that included videos about assembling rifles, the serial killed Jeffrey Dahmer and a clip from a school shooting scene in a television show.

In some cases, YouTube has already removed some of the videos identified by researchers at the Tech Transparency Project, but in other instances the content remains available. Many big tech companies rely on automated systems to flag and remove content that violates their rules, but Paul said the findings from the Project’s report show that greater investments in content moderation are needed.

In the absence of federal regulation, social media companies can target young users with potentially harmful content designed to keep them coming back for more, said Shelby Knox, campaign director of the advocacy group Parents Together. Knox’s group has called out platforms like YouTube, Instagram and TikTok for making it easy for children and teens to find content about suicide, guns, violence and drugs.

“Big Tech platforms like TikTok have chosen their profits, their stockholders, and their companies over children’s health, safety, and even lives over and over again,” Knox said in response to a report published earlier this year that showed TikTok was recommending harmful content to teens.

TikTok has defended its site and its policies, which prohibit users younger than 13. Its rules also prohibit videos that encourage harmful behavior; users who search for content about topics including eating disorders automatically receive a prompt offering mental health resources.

United States News

FILE - Chris Licht attends the 16th annual CNN Heroes All-Star Tribute on Dec. 11, 2022, in New Yor...

Associated Press

CNN ousts CEO Chris Licht after a brief, tumultuous tenure

CNN ousted chief executive Chris Licht after a tumultuous year leading the struggling news network.

19 hours ago

FILE - Republican U.S. Rep. Chris Stewart looks on during his town hall meeting on March 31, 2017, ...

Associated Press

Utah to hold election for retiring congressman’s seat in November

SALT LAKE CITY (AP) — Utah Gov. Spencer Cox said on Wednesday that the election to replace resigning U.S. Rep. Chris Stewart will take place in the fall, expediting the timeline prescribed by state law to ensure the six-term Republican’s seat doesn’t remain vacant for more than a few months. Stewart informed Cox, also a […]

19 hours ago

The Connecticut State Capitol building is seen in Hartford, Conn., Monday, Oct. 1, 2012. Connecticu...

Associated Press

Connecticut to adjourn largely bipartisan session in contrast to rancor in other states

HARTFORD, Conn. (AP) — Connecticut’s Democratic-controlled General Assembly passed protections for abortion providers and gave more power to libraries facing book challenges — and they did it with Republican support. All but 13 Republicans voted for the major gun control bill that’s already being challenged in court. Bucking the partisan rancor seen in other legislatures […]

19 hours ago

Associated Press

6 arrested in alleged scheme to fraudulently collect millions in COVID aid meant for renters

SEATTLE (AP) — Six people from Washington, Arizona and Texas have been arrested and accused of fraudulently obtaining millions of dollars of COVID-19 aid from an assistance program meant for renters, federal prosecutors said. U.S. Attorney Nick Brown, Western District of Washington, on Wednesday announced the arrests and charges of wire fraud and money laundering. […]

19 hours ago

Associated Press

2 Connecticut officers fired over treatment of man paralyzed in police van after 2022 arrest

The City of New Haven, Connecticut, fired two police officers Wednesday for what authorities called their reckless actions and lack of compassion toward Richard “Randy” Cox, who was injured and became paralyzed in the back of a police van after his arrest last year. City police commissioners voted to dismiss Jocelyn Lavandier and Luis Rivera […]

19 hours ago

President Joe Biden speaks during a cabinet meeting at the White House, Wednesday, June 7, 2023, in...

Associated Press

Biden vetoes bill to cancel student debt relief

WASHINGTON (AP) — President Joe Biden on Wednesday vetoed legislation that would have canceled his plan to forgive student debt. The measure had been pushed by Republicans, but it garnered a handful of Democratic votes in the Senate as well. “It is a shame for working families across the country that lawmakers continue to pursue […]

19 hours ago

Sponsored Articles

...

DAY & NIGHT AIR CONDITIONING, HEATING AND PLUMBING

Here are the biggest tips to keep your AC bill low this summer

PHOENIX — In Arizona during the summer, having a working air conditioning unit is not just a pleasure, but a necessity. No one wants to walk from their sweltering car just to continue to be hot in their home. As the triple digits hit around the Valley and are here to stay, your AC bill […]

...

OCD & Anxiety Treatment Center

5 mental health myths you didn’t know were made up

Helping individuals understand mental health diagnoses like obsessive compulsive spectrum disorder or generalized anxiety disorder isn’t always an easy undertaking. After all, our society tends to spread misconceptions about mental health like wildfire. This is why being mindful about how we talk about mental health is so important. We can either perpetuate misinformation about already […]

...

OCD & Anxiety Treatment Center

How to identify the symptoms of 3 common anxiety disorders

Living with an anxiety disorder can be debilitating and cause significant stress for those who suffer from the condition.

YouTube sends gun videos to 9-year-olds: ‘It’s not the kids. It’s the algorithms,’ study finds