It’s easy to forget how miraculous social media is. Even twenty years ago, it would have been effectively impossible to communicate with people around the world as easily and efficiently as we do today, whether you wanted to discuss serious political issues or, more likely, share cat pictures. But while social media, particularly Facebook, brings the world closer together, it has also had to face the stark challenge of fitting so many different cultures and perspectives into the same space. And the company’s struggles to define what’s hate speech and what’s just ignorant, what’s an extreme but not a violent viewpoint and what’s advocating for terrorism, bring to the fore just how hard of a situation they find themselves in.
ProPublica had a long article yesterday on how Facebook drafts the policies that determine what posts get deleted and what posts get kept, and the process behind it. It’s a fascinating read on a number of levels, and there’s much that will likely both interest and enrage people. But what’s most arresting is that Facebook, and its rapidly expanding army of censors, is out of their depth. ProPublica points out early on that Facebook’s approach literally protects “white men” over “black children,” which sounds staggeringly tone deaf on the face of it, but the explanation is somehow even more ridiculous: Facebook sorts people into “protected groups” and “subsets,” so, for example, saying women can’t drive wouldn’t be, to their rules, an example of misogyny, because you’re complaining about women drivers, who are a subset of women.
The reason is that Facebook deletes curses, slurs, calls for violence and several other types of attacks only when they are directed at “protected categories”—based on race, sex, gender identity, religious affiliation, national origin, ethnicity, sexual orientation and serious disability/disease. It gives users broader latitude when they write about “subsets” of protected categories. White men are considered a group because both traits are protected, while female drivers and black children, like radicalized Muslims, are subsets, because one of their characteristics is not protected.
That Facebook’s approach is a mess is hardly surprising — these are insanely complicated waters to navigate — but it’s perhaps to be expected. Facebook is run by website engineers and software developers, and they’re struggling to impose a logical and nuanced framework on human behavior. Which… duh. Why should they succeed in a task that humanity’s been trying to achieve, without success, for centuries?
It’s no secret that people across a divide can have very different viewpoints on the same issue, and there’s been substantial debate on how much blame Facebook’s algorithms deserve for building the filter bubbles that users of the site experience, versus our own obligation to pop said bubbles. The hate speech situation is different though. In this case, we’re not talking about news feeds mitigated, but raw, unfiltered emotion and belief. Beliefs are tougher to handle than lies trying to pose as truth.
Where does ignorant speech become hate speech? Who gets to decide what is acceptable for a person’s personal page? How do we create standards that are applicable across cultures? Across the whole freaking world? That’s Facebook’s self-appointed job. No wonder it’s struggling.