Facebook & Instagram algorithms allegedly push sexist & misogynistic content on blank accounts
"We unleashed Facebook and Instagram’s algorithms on blank accounts. They served up sexism and misogyny", 20 July 2024
How do the algorithms of Facebook and Instagram affect what you see in your news feed? To find out, Guardian Australia unleashed them on a completely blank smartphone linked to a new, unused email address.
Three months later, without any input, they were riddled with sexist and misogynistic content.
The John Doe profiles were set up in April as generic 24-year-old males. Facebook was able to gather some other information, such as the phone’s type and its location in Melbourne, but we opted out of ad tracking so it could not tell what we were doing outside of the app.
Facebook had little to rely upon in the absence of any likes, comments or accounts added as friends. Meanwhile, Instagram makes users follow at least five accounts to start, so we chose the popular recommended accounts, including the prime minister and Bec Judd.
Meta says its algorithms rank content according to what people are interested in, but we wanted to find out where it would take us in the absence of such inputs. We scrolled through the feed every couple of weeks to check what was being served up.
What did we see?
Initially Facebook served up jokes from The Office and other sitcom-related memes alongside posts from 7 News, Daily Mail and Ladbible. A day later it began showing Star Wars memes and gym or “dudebro”-style content.
By day three, “trad Catholic”-type memes began appearing and the feed veered into more sexist content.
Three months later, The Office, Star Wars, and now The Boys memes continue to punctuate the feed, now interspersed with highly sexist and misogynistic images that have have appeared in the feed without any input from the user.
On Instagram, while the explore page has filled with scantily-clad women, the feed is largely innocuous, mostly recommending Melbourne-related content and foodie influencers.
What does Meta say?
Meta was approached for comment but refused to respond on the record.
In its submission to the federal parliament’s social media inquiry, Meta says it uses “a range of different algorithms” to help rank content shown in feeds on Facebook and Instagram, with some helping “us understand what content is most meaningful to people so we can order it accordingly in their feeds”.
The company said that what people see is “heavily influenced by their own choices and actions” and “each person’s feed is highly personalised and specific to them”.
Dr Stephanie Wescott
Meta said it also uses the ranking to assess whether a post is likely to be problematic, but does not violate community standards. That includes clickbait, unoriginal news stories and posts fact-checked as false.
It’s ‘baked into the model’
Guardian Australia’s findings align with similar experiments carried out in 2022 and 2024 in Australia and Ireland on YouTube and TikTok, in which multiple accounts set up as young men and teens were funnelled to “Manosphere” content.
Dr Stephanie Wescott, a lecturer in humanities and social sciences at Monash University, conducted research into the influence of Manosphere influencers like Andrew Tate on school-aged boys and told Guardian Australia our investigation results for Facebook were not surprising.
Nicholas Carah, an associate professor in digital media at the University of Queensland, said the experiment showed how “baked into the model” serving up such content to young men is on Facebook.
Wescott said platforms need to answer questions on how the algorithms work because currently they are unaccountable.
“They’re beyond reproach and they don’t seem to be willing to put any sort of alterations or restrictions on their algorithm.”
‘River of complete garbage’
The quality of what is served on Facebook to every user in Australia had declined in the past few years, Carah says, coinciding with Meta’s decision to deprioritise news as it gears up to fight against paying media companies under Australia’s news media bargaining code.
The social services minister, Amanda Rishworth, says combatting misogynistic attitudes and behaviour in the online and offline world will help achieve the national plan to end violence against women and children in one generation.
“Around 25% of teenage boys in Australia look up to social media personalities who perpetuate harmful gender stereotypes and condone violence against women - this is shocking,” she says.
“And particularly if this content is being served up in young men’s social feeds without any interaction whatsoever, social media companies need to do more.”