Stanford Graduate School of Business

Facial Recognition Technology Can Expose Political Orientation From Naturalistic Facial Images

To appear in Scientific Reports (by Nature)

Download the preprint here.

One-sentence summary

We show that facial recognition algorithms can expose people’s political views from their social media profile pictures, posing dramatic risks to privacy and civil liberties. 

Summary of the findings

Using the profile pictures of over one million participants, we show that a widespread facial recognition algorithm can expose people’s political orientation with stunning accuracy. Political orientation was correctly classified in 72% of liberal–conservative face pairs, remarkably better than chance (50%). Accuracy was similar across countries (the U.S., Canada, and the UK) and online platforms (Facebook and a dating website). 

Importantly, we have not created a privacy-invading tool. Very much like in the context of our previous work on sexual orientation and Facebook Likes, we are warning against existing technologies that have been used for years by companies and governments. Do not shoot the messenger.  

Ramifications of the findings

Widespread use of facial recognition technology poses dramatic risks to privacy and civil liberties. Ubiquitous CCTV cameras and giant databases of facial images, ranging from public social network profiles to national ID card registers, make it alarmingly easy to identify individuals, as well as track their location and social interactions. 

Pervasive surveillance is not the only risk brought about by facial recognition. Apart from identifying individuals, facial recognition algorithms can identify their traits. Like humans, facial recognition algorithms can accurately infer gender, age, ethnicity, or emotions. Unfortunately, the list of personal attributes that can be inferred from the face extends well beyond those few obvious examples. Past work has shown that widely used facial recognition technologies can expose people’s sexual orientation and personality. This work shows that it can also expose political orientation.

While many other digital footprints are revealing of political orientation and other intimate traits, facial recognition can be used without subjects’ consent or knowledge. Facial images can be easily (and covertly) taken by law enforcement or obtained from digital or traditional archives, including social networks, dating platforms, photo-sharing websites, and government databases. They are often easily accessible; Facebook and LinkedIn profile pictures, for instance, can be accessed by anyone without a person’s consent or knowledge. Thus, the privacy threats posed by facial recognition technology are, in many ways, unprecedented.

Some may doubt whether the accuracies reported here are high enough to cause concern. Yet, our estimates unlikely constitute an upper limit of what is possible. Progress in computer vision and AI is unlikely to slow down anytime soon. Moreover, even modestly accurate predictions can have tremendous impact when applied to large populations in high-stakes contexts, such as elections. For example, even a crude estimate of an audience’s psychological traits can drastically boost the efficiency of propaganda and mass persuasion. We hope that scholars, policymakers, engineers, and citizens will take notice.

# # # #

Filters close

Showing results

110 of 6020
Newswise:Video Embedded newswise-expert-panels-on-covid-19-pandemic-notable-excerpts-quotes-and-videos-available
Released: 18-Jun-2021 2:10 PM EDT
Newswise Expert Panels on COVID-19 Pandemic: Notable excerpts, quotes and videos available

Newswise is hosting a series of Expert Panels discussion on unique aspects of the COVID-19 pandemic. This tip sheet includes some notable quotes from the panelists.

Released: 16-Jun-2021 1:10 PM EDT
Establishing Juneteenth As National Holiday is Opportunity to Create "New America"
Binghamton University, State University of New York

The Senate has unanimously passed a bill to establish Juneteenth, a holiday commemorating the end of slavery in the United States, as a federal holiday. This is an historic moment and an opportunity to create a “new America,” according to Anne Bailey, professor of history at Binghamton University, State University of New York and director of the Harriet Tubman Center for the Study of Freedom and Equity.

Newswise: Keeping the peace
Released: 14-Jun-2021 5:55 PM EDT
Keeping the peace
Washington University in St. Louis

New research from Washington University in St. Louis sheds light on how — and in what context — peacekeepers can contain the spread of violence in fragile post-conflict areas.

Released: 8-Jun-2021 12:45 PM EDT
2021 Gov Race is Currently Murphy’s to Lose
Rutgers University-New Brunswick

Governor Phil Murphy currently has a clear path to reelection victory, according to the latest Rutgers-Eagleton Poll.

Newswise: Political science professors sign statement warning of threats to US democracy
Released: 8-Jun-2021 12:10 PM EDT
Political science professors sign statement warning of threats to US democracy
University of Notre Dame

Five University of Notre Dame professors who specialize in different areas of democracy studies recently signed a strong statement of concern issued by the think tank New America warning of the serious threats to democracy in the U.S.

Showing results

110 of 6020