Word embeddings quantify 100 years of gender and ethnic stereotypes

• Published in: Proceedings of the National Academy of Sciences - PNAS Vol. 115; no. 16; pp. E3635 - E3644
• Main Authors: Garg, Nikhil, Schiebinger, Londa, Jurafsky, Dan, Zou, James
• Format: Journal Article
• Language: English
• Published: United States National Academy of Sciences 17.04.2018
• Series: PNAS Plus
• Subjects: Demographics; Embedded systems; Embedding; Ethnicity; Gender; Immigration; Learning algorithms; Machine learning; Minority & ethnic groups; Occupations; Physical Sciences; PNAS Plus; Social discrimination learning; Social Sciences; Stereotypes; United States > US; ethnic stereotypes; word embedding; gender stereotypes
• ISSN: 0027-8424; 1091-6490; 1091-6490
• DOI: 10.1073/pnas.1720347115

Word embeddings are a powerful machine-learning framework that represents each English word by a vector. The geometric relationship between these vectors captures meaningful semantic relationships between the corresponding words. In this paper, we develop a framework to demonstrate how the temporal dynamics of the embedding helps to quantify changes in stereotypes and attitudes toward women and ethnic minorities in the 20th and 21st centuries in the United States. We integrate word embeddings trained on 100 y of text data with the US Census to show that changes in the embedding track closely with demographic and occupation shifts over time. The embedding captures societal shifts—e.g., the women’s movement in the 1960s and Asian immigration into the United States—and also illuminates how specific adjectives and occupations became more closely associated with certain populations over time. Our framework for temporal analysis of word embedding opens up a fruitful intersection between machine learning and quantitative social science.