TY - GEN
T1 - Attitudes Toward Facial Analysis AI
T2 - 2024 ACM Conference on Fairness, Accountability, and Transparency, FAccT 2024
AU - Ullstein, Chiara
AU - Engelmann, Severin
AU - Papakyriakopoulos, Orestis
AU - Ikkatai, Yuko
AU - Arnez-Jordan, Naira Paola
AU - Caleno, Rose
AU - Mboya, Brian
AU - Higuma, Shuichiro
AU - Hartwig, Tilman
AU - Yokoyama, Hiromi
AU - Grossklags, Jens
N1 - Publisher Copyright:
© 2024 Owner/Author.
PY - 2024/6/3
Y1 - 2024/6/3
N2 - Computer vision AI systems present one of the most radical technical transformations of our time. Such systems are given unparalleled epistemic power to impose meaning on visual data, despite their inherent semantic ambiguity. This epistemic power is particularly evident in computer vision AI that interprets the meaning of human faces. The goal of this work is to empirically document laypeople's perceptions of the epistemic and ethical complexity of computer vision AI through a large-scale qualitative study with participants in Argentina, Japan, Kenya, and the USA (N=4,468). We developed a vignette scenario about a fictitious company that analyzes people's portraits using computer vision AI to make a variety of inferences about people based on their faces. For each inference that the fictitious company draws (e.g., age, skin color, intelligence), we ask participants from all countries to reason about how they evaluate computer vision AI inference-making. In a series of workshops, we collaborated as a multinational research team to develop a codebook that captures people's different justifications of facial analysis AI inferences to create a comprehensive justification portfolio. Our study reveals similarities in justification patterns, but also significant intra-country and inter-country diversity in response to different facial inferences. For example, participants from Argentina, Japan, Kenya, and the USA vastly disagree over the reasonableness of AI classifications such as beautiful or skin color. They tend to agree in their opposition to AI-drawn inferences intelligence and trustworthiness. Adding much-needed non-Western perspectives to debates on computer vision ethics, our results suggest that, contrary to popular justifications for facial classification technologies, there is no such thing as a "common sense"facial classification that accords simply with a general, homogeneous "human intuition."
AB - Computer vision AI systems present one of the most radical technical transformations of our time. Such systems are given unparalleled epistemic power to impose meaning on visual data, despite their inherent semantic ambiguity. This epistemic power is particularly evident in computer vision AI that interprets the meaning of human faces. The goal of this work is to empirically document laypeople's perceptions of the epistemic and ethical complexity of computer vision AI through a large-scale qualitative study with participants in Argentina, Japan, Kenya, and the USA (N=4,468). We developed a vignette scenario about a fictitious company that analyzes people's portraits using computer vision AI to make a variety of inferences about people based on their faces. For each inference that the fictitious company draws (e.g., age, skin color, intelligence), we ask participants from all countries to reason about how they evaluate computer vision AI inference-making. In a series of workshops, we collaborated as a multinational research team to develop a codebook that captures people's different justifications of facial analysis AI inferences to create a comprehensive justification portfolio. Our study reveals similarities in justification patterns, but also significant intra-country and inter-country diversity in response to different facial inferences. For example, participants from Argentina, Japan, Kenya, and the USA vastly disagree over the reasonableness of AI classifications such as beautiful or skin color. They tend to agree in their opposition to AI-drawn inferences intelligence and trustworthiness. Adding much-needed non-Western perspectives to debates on computer vision ethics, our results suggest that, contrary to popular justifications for facial classification technologies, there is no such thing as a "common sense"facial classification that accords simply with a general, homogeneous "human intuition."
KW - artificial intelligence
KW - computer vision
KW - facial analysis AI
KW - human faces
KW - participatory AI ethics
UR - http://www.scopus.com/inward/record.url?scp=85196658072&partnerID=8YFLogxK
U2 - 10.1145/3630106.3659038
DO - 10.1145/3630106.3659038
M3 - Conference contribution
AN - SCOPUS:85196658072
T3 - 2024 ACM Conference on Fairness, Accountability, and Transparency, FAccT 2024
SP - 2273
EP - 2301
BT - 2024 ACM Conference on Fairness, Accountability, and Transparency, FAccT 2024
PB - Association for Computing Machinery, Inc
Y2 - 3 June 2024 through 6 June 2024
ER -