Psychological trait inferences from women’s clothing: human and machine prediction

Hannes Rosenbusch*, Maya Aghaei, Anthony M. Evans, Marcel Zeelenberg

*Corresponding author for this work

Research output: Contribution to JournalArticleAcademicpeer-review

Abstract

People use clothing to make personality inferences about others, and these inferences steer social behaviors. The current work makes four contributions to the measurement and prediction of clothing-based person perception: first, we integrate published research and open-ended responses to identify common psychological inferences made from clothes (Study 1). We find that people use clothes to make inferences about happiness, sexual interest, intelligence, trustworthiness, and confidence. Second, we examine consensus (i.e., interrater agreement) for clothing-based inferences (Study 2). We observe that characteristics of the inferring observer contribute more to the drawn inferences than the observed clothes, which entails low to medium levels of interrater agreement. Third, the current work examines whether a computer vision model can use image properties (i.e., pixels alone) to replicate human inferences (Study 3). While our best model outperforms a single human rater, its absolute performance falls short of reliability conventions in psychological research. Finally, we introduce a large database of clothing images with psychological labels and demonstrate its use for exploration and replication of psychological research. The database consists of 5000 images of (western) women’s clothing items with psychological inferences annotated by 25 participants per clothing item.

Original languageEnglish
Pages (from-to)479-501
Number of pages23
JournalJournal of Computational Social Science
Volume4
Issue number2
Early online date22 Sept 2020
DOIs
Publication statusPublished - Nov 2021

Bibliographical note

Publisher Copyright:
© 2020, The Author(s).

Keywords

  • Computational social science
  • Computer vision
  • Digital aesthetics
  • Fashion
  • Neural networks

Fingerprint

Dive into the research topics of 'Psychological trait inferences from women’s clothing: human and machine prediction'. Together they form a unique fingerprint.

Cite this