bioRxiv ScienceSearch

Biology subjects

Ryali, C.

Publications and source records attributed to Ryali, C..

2 recordsLinked to original sources

Beauty-in-averageness and its contextual modulations: A Bayesian statistical account

Understanding how humans perceive the likability of high-dimensional \"objects\" such as faces is an important problem in both cognitive science and AI/ML. Existing models of human preferences generally assume these preferences to be fixed. However, human assessment of facial attractiveness have been found to be highly context-dependent. Specifically, the classical Beauty-in-Averageness (BiA) effect, whereby a face blended from two original faces is judged to be more attractive than the originals, is significantly diminished or reversed when the original faces are recognizable, or when the morph is mixed-race/mixed gender and the attractiveness judgment is preceded by a race/gender categorization. This effect, dubbed Ugliness-in-Averageness (UiA), has previously been attributed to a disfluency account, which is both qualitative and clumsy in explaining BiA. We hypothesize, instead, that these contextual influences on face processing result from the dependence of attractiveness perception on an element of statistical typicality, and from an attentional mechanism that restricts face representation to a task-relevant subset of features, thus redefining typicality within that subspace. Furthermore, we propose a principled explanation of why statistically atypical objects are less likable: they incur greater encoding or processing cost associated with a greater prediction error, when the brain uses predictive coding to compare the actual stimulus properties with those expected from its associated categorical prototype. We use simulations to show our model provides a parsimonious, statistically grounded, and quantitative account of contextual dependence of attractiveness. We also validate our model using experimental data from a gender categorization task. Finally, we make model predictions for a proposed experiment that can disambiguate the previous disfluency account and our statistical typicality theory.

animal behavior and cognition

Computational modeling of social face perception in humans: Leveraging the active appearance model

Face processing plays a central role in human social life. Humans readily infer social traits (e.g. attractiveness and trustworthiness) from a strangers face. Previous attempts to characterize the facial (physiognomic) features underlying social processing have lacked either systematicity or interpretability. Here, we utilize a statistical framework to tackle this problem, by learning a vector space to represent faces, and a linear mapping from this face space into human social trait judgments. Specifically, we obtain a face space by training the Active Appearance Model on large datasets of face images. Based on human evaluations of numerous social traits on these images, we then use regression to find linear combinations of facial features (what we call Linear Trait Axis, or LTA) that best predict human social judgments. Our model achieves state-of-the-art performance in overall predictive accuracy - comparable to the best convolutional neural network and better than human prediction of other human ratings. To interpret the LTAs, we regress them against a large repertoire of geometric features. To understand the relationship between the facial features that underlie different social, emotional, and demographic traits, we present a novel \"dual space analysis\" that characterizes the geometric relationship among LTA vectors. It shows that facial features important for social trait perception are largely distinct from those underlying demographic and emotion perception, contrary to previous suggestions that social trait perception is driven by over-generalization of relatively primitive demographic and emotion perception processes. In addition, we present a novel correlation decomposition analysis that quantifies how correlations in trait judgments (e.g. between attractiveness and babyfacedness) independently arise from (1) shared facial features among traits, and (2) correlation in the distribution of facial features in the human population.

animal behavior and cognition