The Guardian reports <\/a>that their team\u2019s account prompted them to watch typical social media content of cute animals, funny videos and so on. <\/p>\n\n\n\nThen, they watched a self-help post meant for men. The video was a legitimate resource about men\u2019s mental health, however, the algorithm then began to suggest Tate video edits. <\/p>\n\n\n\n
After closing the app and opening it again they were shown four Tate videos out of a total 20 displayed on their For You page. <\/p>\n\n\n\n
After closing the app and opening it again a week later, Tate video edits made up the first eight consecutive suggested posts.<\/p>\n\n\n\n
In part, this is due to Tate\u2019s clever manipulation of social media platforms. Following his removal from Instagram and TikTok in 2022, Tate reportedly enlisted members of Hustlers University to maintain his social media presence. <\/p>\n\n\n\n
These followers were asked to create accounts reposting content from his videos, podcasts, and more. Sometimes with an expectation of a set number of posts per day or per week. This maintained the saturation of social media with his content, despite the lack of Tate\u2019s personal presence. <\/p>\n\n\n\n
In a 2022 statement to the New York Times, a TikTok spokesperson stated, \u201cMisogyny is a hateful ideology that is not tolerated on TikTok,\u201d adding that an investigation into Tate\u2019s content was ongoing and accounts in violation were being removed. <\/p>\n\n\n\n
At this point in time, Instagram has many accounts using Tate’s likeness and content that remain active, while TikTok has moderated the content more effectively. <\/p>\n\n\n\n
Will Fleisher, an AI ethicist at Georgetown University\u2019s Centre for Digital Ethics, says social media companies have a responsibility to ensure that their social platforms and algorithms are designed in a way that will not cause harm to users. <\/p>\n\n\n\n
\u201cI think all of us have a moral responsibility not to harm others. And so, when you’re designing these systems, you need to design with that in mind.\u201d <\/p>\n\n\n\n
Regulating social media algorithms is easier said than done, however. According to Fleisher, the legal enforcement of this responsibility would not be a simple process. <\/p>\n\n\n\n
\u201cWe have good reasons not to want the government or other powerful entities to be restricting people’s speech in an intense way,\u201d says Fleisher.\u201d <\/p>\n\n\n\n
\u201cThere’s a difficult tradeoff there between avoiding having an overly empowered government censoring people, which can just as easily be used to harm people, and the sort of responsibility we all have to make sure that people aren\u2019t being harmed\u201d <\/p>\n\n\n\n
When it comes to software developers, “They’re not necessarily in that kind of government situation…they’re not enforcing the laws,\u201d says Fleisher. <\/p>\n\n\n\n
\u201cIt’s certainly within their power to, and I think is the moral requirement that they think about and design to mitigate or avoid those kinds of problems,\u201d he adds. <\/p>\n\n\n\n
TikTok\u2019s 2022 statement also claimed that the company was pursuing measures to strengthen detection models against misogynistic content. <\/p>\n\n\n\n
Fleisher says that training an AI system to do this job would be difficult. \u201cYou’ve got the goal of making sure you find all the objectionable content, but if you make it too sensitive to subtle features it’s likely to catch other kinds of things and eliminate them.\u201d <\/p>\n\n\n\n
This means that marginalised creators might find themselves among the accounts being censored. <\/p>\n\n\n\n
Says Fleisher, \u201cIt’s a known problem that content filters are filtering out important conversations among people in marginalised groups who are trying to resist oppression, because if it was uttered by other people, it would be problematic.” <\/p>\n\n\n\n
In other words, accounts on social media who use flagged language while discussing the oppression faced by a marginalised group would be censored by an algorithm in the same way as accounts using the language as hate speech. <\/p>\n\n\n\n
Fleisher says it may be impossible for AI to distinguish between the two types of speech. <\/p>\n\n\n\n
The alternative is human moderation, he says, to which there are two big impediments. <\/p>\n\n\n\n
“One is the cost of getting an adequate number of experts on a topic who can tell the difference between hate speech and perfectly appropriate camaraderie in marginalised communities,\u201d Fleisher says. <\/p>\n\n\n\n
\u201cIt’s a non-trivial expense, but it’s been done. There’s been human content moderation on all these platforms before,\u201d he argues. <\/p>\n\n\n\n
The other impediment? Political. The issue can be traced back to 2018, when Facebook\u2019s human content moderation team came under fire. <\/p>\n\n\n\n
“That team was accused of anti-conservative bias, and it was a big, huge scandal. Zuckerberg ended up firing all the people on the human content moderation team, and they implemented an algorithm instead,\u201d says Fleisher. <\/p>\n\n\n\n
What resulted from the firing was a proliferation of fake news on Facebook that the human content moderation team had been effective at catching prior to their removal. <\/p>\n\n\n\n
\u201cIt seems to me that right now, given our current level of technology, the appropriate way to deal with these problems is human moderation,\u201d Fleisher concludes. <\/p>\n\n\n\n
Like Fleisher, Cousineau worries that the monetary cost of responsibly moderating social media will dissuade developers. <\/p>\n\n\n\n
\u201cYou cannot escape having to talk about not just the social spaces of young men spending time online and learning about masculinity from these people,\u201d says Luc Cousineau, \u201cbut the way that the companies that furnish this information to them make money and curate content.” <\/p>\n\n\n\n
Fleisher agrees. \u201cOften people pay attention to things that anger them,\u201d he says. <\/p>\n\n\n\n
In other words, there is precious little motivation for social media companies and software developers to design systems which will eradicate misogynistic content on their apps. <\/p>\n\n\n\n
Controversy drives user interaction, and the cult following amassed by creators with misogynistic beliefs increases usership, benefiting social media companies. <\/p>\n\n\n\n
Before being removed from the platform, Andrew Tate amassed an Instagram following of more than 4 million and his TikTok videos received millions of views. <\/p>\n\n\n\n