Seminal
The magazine and atlas of EU-funded researchA new publication from the web and AI team at Scott Charnley

Atlas / Finland

Marie Skłodowska-Curie Action · Running

ACMod Affective Computing Models: from Facial Expression to Mind-Reading

Coordinator
Oulun Yliopisto, Finland
Runs
1 March 2024 to 29 February 2028
Status
Running
EU funding
€846k
Total cost
—
Partners
15 organisations in 8 countries
Type
Marie Skłodowska-Curie Action
Grant agreement
101130271

What the project is doing

In the project's own words, from its summary on CORDIS.

Mind reading plays an indispensable role in human social interaction and communication. One of the key factors in mind reading is facial expression analysis. It is thus crucial to understand and model facial behaviors reflecting mental states to enhance communication experience with robots and other intelligent agents in either real social interaction or augmented virtual environments. As well, consistent cross-cultural disagreement about the emotion and intensity conveyed by gold-standard universal facial expressions questions the universality hypothesis.

In recent years, even though automatic facial expression analysis has achieved excellent progress, the research of emotion understanding in realistic environment across cultures is still lacking. Substantial psychological works support the use of the appraisal theory for internal emotion detection through facial behaviors, while research in computer science mainly focuses on facial modelling but ignoring the underlying biologically-driven mechanism.

Therefore, we plan to reconstruct facial macro- and micro-expressions and digitise emotion appraisal, collect 4D (dynamic 3D) facial expression dataset with culture diversity and develop autonomous 4D facial model based on the collected 4D data and cultural emotion appraisal theory, and push forward commercialisation. ACMod project aims to advance the state of the art in understanding and modelling naturalistic facial behaviours in social interaction cross various cultures, which is essential to the next generation of human-computer interaction, robotics and augmented virtual reality techniques.

This project will open up a new avenue for modelling facial behaviors by taking a fundamentally different and interdisciplinary approach, combining theories and techniques in e.g. psychology and computer science with an emphasis on social interaction applications. The project will promote knowledge exchange between EU and East Asian partners to foster the researchers involved.

Topics

Who is involved

OrganisationCityCountryRole
Oulun YliopistoOuluFinlandCoordinator
School of Animation and Digital Arts, Communication University of ChinaBeijingChinaAssociatedpartner
Valossa Labs OyOuluFinlandAssociatedpartner
MazediaSaint-HerblainFranceAssociatedpartner
Nantes UniversiteNantesFranceParticipant
Satya Wacana Christian UniversitySidorejoIDAssociatedpartner
Universiti Telekom Sdn BhdKuala LumpurMYAssociatedpartner
University of MalayaKuala LumpurMYAssociatedpartner
Chiang Mai UniversityChiang MaiTHAssociatedpartner
OLD Chiang Mai Cultural CenterChiang MaiTHAssociatedpartner
Bournemouth UniversityPooleUnited KingdomAssociatedpartner
University of GlasgowGlasgowUnited KingdomAssociatedpartner
University of Portsmouth Higher Education CorporationPortsmouthUnited KingdomAssociatedpartner
Visionmetric LimitedCanterburyUnited KingdomAssociatedpartner
University of Engineering and Technology - Vietnam National University - Ha NoiHanoiVNAssociatedpartner

Source: CORDIS, European Commission. Data of 5 Nov 2026, reused under the Commission's reuse policy. View on CORDIS · Grant DOI