Facebook in India has been selective in curbing hate speech, misinformation and inflammatory posts \u2013 particularly anti-Muslim content \u2013 according to leaked documents obtained by The Associated Press, even as its own employees cast doubt over the company\u2019s motivations and interests.
From research as recent as March of this year to company memos that date back to 2019, the internal company documents on India highlight Facebook\u2019s constant struggles in quashing abusive content on its platforms in the world\u2019s biggest democracy and the company\u2019s largest growth market.
Communal and religious tensions in India have a history of boiling over on social media and stoking violence.
The so-called Facebook Papers, leaked by whistleblower Frances Haugen, show that the company has been aware of the problems for years, raising questions over whether it has done enough to address these issues.
Many critics and digital experts say it has failed to do so, especially in cases where members of Prime Minister Narendra Modi\u2019s ruling Bharatiya Janata Party (BJP) are involved.
Across the world, Facebook has become increasingly important in politics, and India is no different.
Modi has been credited for leveraging the platform to his party\u2019s advantage during elections, and reporting from The Wall Street Journal last year cast doubt over whether Facebook was selectively enforcing its policies on hate speech to avoid blowback from the BJP.
Both Modi and Facebook chairman and CEO Mark Zuckerberg have exuded bonhomie, memorialised by a 2015 image of the two hugging at the Facebook headquarters.
The leaked documents include a trove of internal company reports on hate speech and misinformation in India. In some cases, much of it was intensified by its own \u201crecommended\u201d feature and algorithms.
But they also include the company staffers\u2019 concerns over the mishandling of these issues and their discontent expressed about the viral \u201cmalcontent\u201d on the platform.
According to the documents, Facebook saw India as one of the most \u201cat risk countries\u201d in the world and identified both Hindi and Bengali languages as priorities for \u201cautomation on violating hostile speech\u201d. Yet, Facebook did not have enough local language moderators or content-flagging in place to stop misinformation that at times led to real-world violence.
In a statement to the AP, Facebook said it has \u201cinvested significantly in technology to find hate speech in various languages, including Hindi and Bengali\u201d which has resulted in a \u201creduced amount of hate speech that people see by half\u201d in 2021.
\u201cHate speech against marginalised groups, including Muslims, is on the rise globally. So we are improving enforcement and are committed to updating our policies as hate speech evolves online,\u201d a company spokesperson said.<\/p>\n\n\n\n
Findings through test user account Anti-Muslim propaganda Dithered in curbing divisive content Facebook in India has been selective in curbing hate speech, misinformation an…<\/p>\n","protected":false},"author":4,"featured_media":12560,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[36],"tags":[],"class_list":["post-12555","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-c102-muslim-minorities"],"acf":[],"yoast_head":"\n
<\/strong>This AP story, along with others being published, is based on disclosures made to the Securities and Exchange Commission and provided to Congress in redacted form by former Facebook employee turned whistleblower Haugen\u2019s legal counsel. The redacted versions were obtained by a consortium of news organisations, including the AP.
Back in February 2019 and ahead of a general election when concerns of misinformation were running high, a Facebook employee wanted to understand what a new user in the country saw on their news feed if all they did was follow pages and groups solely recommended by the platform itself.
The employee created a test user account and kept it live for three weeks, a period during which an extraordinary event shook India \u2013 a suicide attack in Indian-administered Kashmir had killed more than 40 Indian soldiers, bringing the country to near war with rival Pakistan.
In the note, titled \u201cAn Indian Test User\u2019s Descent into a Sea of Polarising, Nationalistic Messages\u201d, the employee whose name is redacted, said they were \u201cshocked\u201d by the content flooding the news feed which \u201chas become a near constant barrage of polarising nationalist content, misinformation, and violence and gore\u201d.
Seemingly benign and innocuous groups recommended by Facebook quickly morphed into something else altogether, where hate speech, unverified rumours and viral content ran rampant.
The recommended groups were inundated with fake news, anti-Pakistan rhetoric and Islamophobic content. Much of the content was extremely graphic.
One included a man holding the bloodied head of another man covered in a Pakistani flag, with an Indian flag in the place of his head. Its \u201cPopular Across Facebook\u201d feature showed a slew of unverified content related to the retaliatory Indian strikes into Pakistan after the bombings, including an image of a napalm bomb from a video game clip debunked by one of Facebook\u2019s fact-check partners.
\u201cFollowing this test user\u2019s News Feed, I have seen more images of dead people in the past three weeks than I have seen in my entire life total,\u201d the researcher wrote.
It sparked deep concerns over what such divisive content could lead to in the real world, where local news outlets at the time were reporting on Kashmiris being attacked in the fallout.
\u201cShould we as a company have an extra responsibility for preventing integrity harms that result from recommended content?\u201d the researcher asked in their conclusion.
The memo, circulated with other employees, did not answer that question. But it did expose how the platform\u2019s own algorithms or default settings played a part in spurring such malcontent.
The employee noted that there were clear \u201cblind spots,\u201d particularly in \u201clocal language content\u201d. They said they hoped these findings would start conversations on how to avoid such \u201cintegrity harms\u201d, especially for those who \u201cdiffer significantly\u201d from the typical US user.
Even though the research was conducted during three weeks that were not an average representation, they acknowledged that it did show how such \u201cunmoderated\u201d and problematic content \u201ccould totally take over\u201d during \u201ca major crisis event\u201d.
The Facebook spokesperson said the test study \u201cinspired deeper, more rigorous analysis\u201d of its recommendation systems and \u201ccontributed to product changes to improve them\u201d.
\u201cSeparately, our work on curbing hate speech continues and we have further strengthened our hate classifiers, to include four Indian languages,\u201d the spokesperson said.<\/p>\n\n\n\n
<\/strong>Other research files on misinformation in India highlight just how massive a problem it is for the platform.
In January 2019, a month before the test user experiment, another assessment raised similar alarms about misleading content. In a presentation circulated to employees, the findings concluded that Facebook\u2019s misinformation tags weren\u2019t clear enough for users, underscoring that it needed to do more to stem hate speech and fake news.
Users told the researchers that \u201cclearly labelling information would make their lives easier\u201d.
Again, it was noted that the platform did not have enough local language fact-checkers, which meant a lot of content went unverified.
Alongside misinformation, the leaked documents reveal another problem plaguing Facebook in India: anti-Muslim propaganda, especially by hardline Hindu supremacist groups.
India is Facebook\u2019s largest market with at least 340 million users \u2013 nearly 400 million Indians also use the company\u2019s messaging service WhatsApp. But both have been accused of being vehicles to spread hate speech and fake news against minorities.
In February 2020, these tensions came to life on Facebook when a politician from Modi\u2019s party uploaded a video on the platform in which he called on his supporters to remove mostly Muslim protesters from a road in New Delhi if the police did not. Violent riots erupted within hours, killing 53 people, most of them Muslims.
Only after thousands of views and shares did Facebook remove the video.
In April last year, misinformation targeting Muslims again went viral on its platform as the hashtag \u201cCoronajihad\u201d flooded news feeds, blaming the Muslim community for a surge in COVID-19 cases. The hashtag was popular on Facebook for days but was later removed by the company.
For Mohammad Abbas, a 54-year-old Muslim preacher in New Delhi, those messages were alarming.
Some video clips and posts purportedly showed Muslims spitting on authorities and hospital staff. They were quickly proven to be fake, but by then India\u2019s communal fault lines, still stressed by deadly riots a month earlier, were again split wide open.
The misinformation triggered a wave of violence, business boycotts and hate speech towards Muslims. Thousands from the community, including Abbas, were confined to institutional quarantine for weeks across the country. Some were even sent to jails, only to be later exonerated by courts.
\u201cPeople shared fake videos on Facebook claiming Muslims spread the virus. What started as lies on Facebook became truth for millions of people,\u201d Abbas said.<\/p>\n\n\n\n
<\/strong>Criticisms of Facebook\u2019s handling of such content were amplified in August last year when The Wall Street Journal published a series of stories detailing how the company had internally debated whether to classify a Hindu legislator belonging to Modi\u2019s BJP as a \u201cdangerous individual\u201d \u2013 a classification that would ban him from the platform \u2013 after a series of anti-Muslim posts from his account.
The documents reveal the leadership dithered on the decision, prompting concerns by some employees, of whom one wrote that Facebook was only designating non-Hindu extremist organisations as \u201cdangerous\u201d.
The documents also show how the company\u2019s South Asia policy head, herself had shared what many felt were Islamophobic posts on her personal Facebook profile. At the time, she had also argued that classifying the politician as dangerous would hurt Facebook\u2019s prospects in India.
The author of a December 2020 internal document on the influence of powerful political actors on Facebook policy decisions notes that \u201cFacebook routinely makes exceptions for powerful actors when enforcing content policy\u201d.
The document also cites a former Facebook chief security officer saying that outside of the United States, \u201clocal policy heads are generally pulled from the ruling political party and are rarely drawn from disadvantaged ethnic groups, religious creeds or casts\u201d which \u201cnaturally bends decision-making towards the powerful\u201d.
Months later, the India official quit Facebook. The company also removed the politician from the platform, but documents show many company employees felt the platform had mishandled the situation, accusing it of selective bias to avoid being in the crosshairs of the Indian government.
\u201cSeveral Muslim colleagues have been deeply disturbed\/hurt by some of the language used in posts from the Indian policy leadership on their personal FB profile,\u201d an employee wrote.
Another wrote that \u201cbarbarism\u201d was being allowed to \u201cflourish on our network\u201d.
It is a problem that has continued for Facebook, according to the leaked files.
As recently as March this year, the company was internally debating whether it could control the \u201cfear mongering, anti-Muslim narratives\u201d pushed by the Rashtriya Swayamsevak Sangh (RSS), a far-right Hindu supremacist group which Modi is also a part of, on its platform.
In one document titled \u201cLotus Mahal\u201d, the company noted that members with links to the BJP had created multiple Facebook accounts to amplify anti-Muslim content, ranging from \u201ccalls to oust Muslim populations from India\u201d and \u201cLove Jihad\u201d, an unproven conspiracy theory by Hindu groups who accuse Muslim men of using interfaith marriages to coerce Hindu women to change their religion.
The research found that much of this content was \u201cnever flagged or actioned\u201d since Facebook lacked \u201cclassifiers\u201d and \u201cmoderators\u201d in Hindi and Bengali languages. Facebook said it added hate speech classifiers in Hindi starting in 2018 and introduced Bengali in 2020.
The employees also wrote that Facebook had not yet \u201cput forth a nomination for designation of this group given political sensitivities\u201d.
The company said its designations process includes a review of each case by relevant teams across the company and are agnostic to region, ideology or religion and focus instead on indicators of violence and hate. It did not, however, reveal whether the Hindu nationalist group had since been designated as \u201cdangerous\u201d.<\/p>\n","protected":false},"excerpt":{"rendered":"