Sangam: A Confluence of Knowledge Streams

A computational framework for emotion understanding

Show simple item record

dc.contributor Saxe, Rebecca
dc.contributor Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences
dc.creator Houlihan, Sean Dae
dc.date 2023-01-19T18:41:56Z
dc.date 2023-01-19T18:41:56Z
dc.date 2022-09
dc.date 2022-09-28T17:20:02.298Z
dc.date.accessioned 2023-02-17T20:19:31Z
dc.date.available 2023-02-17T20:19:31Z
dc.identifier https://hdl.handle.net/1721.1/147271
dc.identifier https://orcid.org/0000-0001-5003-9278
dc.identifier.uri http://localhost:8080/xmlui/handle/CUHPOERS/242529
dc.description The organizing principle of this thesis is that human emotion understanding reflects a model-based solution to a large class of ill-posed inverse problems. To interpret someone's expression, or predict how that person would react in a future situation, observers reason over a logically- and causally-structured intuitive theory of other minds. For this work, I chose a domain that is perceptually and socially rich, yet highly constrained: a real-life high-stakes televised one-shot prisoner's dilemma. In the first set of studies, I illustrate that forward predictions play a critical role in emotion understanding. Intuitive hypotheses about what someone is likely to feel guide how observers interpret and reason about expressive behavior. By simulating human causal reasoning as abductive inference over latent emotion representations, a parameter-free Bayesian model captured surprising patterns of social cognition. In the second set of studies, I formalize emotion prediction as a probabilistic generative model. Mental contents inferred via the inversion of an intuitive theory of mind generate the basis for inferring how others will evaluate, or 'appraise', a situation. The Inferred Appraisals model extends inverse planning to simulate how observers infer others' reactions, in the terms of utilities, prediction errors, and counterfactuals on rich social preferences for fairness and reputation. I show that the joint posterior distribution of inferred appraisals provides a powerful method for discovering the latent structure of the human intuitive theory of emotions. In the third set of studies, I build a stimulus-computable model of emotion understanding. This work emphasizes the importance of testing whether computational models can use emotion-relevant information in service of social cognition. I suggest that building computer systems that approach human-level emotional intelligence requires generative models, where inferred appraisals function as latent causal explanations that link behavior, mental contents, and world states.
dc.description Ph.D.
dc.format application/pdf
dc.publisher Massachusetts Institute of Technology
dc.rights In Copyright - Educational Use Permitted
dc.rights Copyright MIT
dc.rights http://rightsstatements.org/page/InC-EDU/1.0/
dc.title A computational framework for emotion understanding
dc.type Thesis


Files in this item

Files Size Format View
houlihan-daeda-phd-bcs-2022-thesis.pdf 3.805Mb application/pdf View/Open

This item appears in the following Collection(s)

  • DSpace@MIT [2699]
    DSpace@MIT is a digital repository for MIT's research, including peer-reviewed articles, technical reports, working papers, theses, and more.

Show simple item record

Search DSpace


Advanced Search

Browse