EMHCAM Embodied Multimodal Human Communication and Modelling
- Coordinator
- Kobenhavns Universitet, Denmark
- Runs
- 1 January 2027 to 31 December 2030
- Status
- Running
- EU funding
- €4.7m
- Total cost
- —
- Partners
- 18 organisations in 9 countries
- Type
- Marie Skłodowska-Curie Action
- Grant agreement
- 101310000
What the project is doing
In the project's own words, from its summary on CORDIS.
The EMHCAM Doctoral Network will train 15 doctoral candidates to advance European research in Embodied Multimodal Human Communication And Modelling. Despite rapid progress in language and vision AI, current systems lack grounding in the embodied and context-dependent nature of human communication. This limits progress in key application domains such as socially interactive agents, accessibility technologies and health-related human–machine interaction.
EMHCAM addresses this gap by integrating three research communities — gesture and cognitive interaction studies, multimodal corpus development and multimodal data science — into a single, coherent doctoral training network. The network tackles three interconnected scientific challenges: 1) developing new theoretical accounts of how speech and gesture jointly structure communication across languages, speaker profiles and interaction settings; 2) creating the next generation of embodied multimodal corpora, linking audio–visual and motion-captured data with shared annotation conventions and making them available through ethical data-sharing methods; 3) designing computational models that analyse and generate multimodal behaviour, including LLM-based generation pipelines and context-aware behavioural modelling.
The resulting resources — open multimodal datasets, validated annotation schemes, evaluation benchmarks and ethically robust modelling pipelines — will have concrete impact across academia and industry. Application areas include intelligent hearing aid design, socially interactive agents for mental healthcare and multimodal learning technologies. By combining advanced technical training, strong industry participation and an interdisciplinary, cross-European research environment, EMHCAM will produce a new generation of researchers equipped to shape human-centred, trustworthy and inclusive multimodal technologies in line with European strategic priorities.
Topics
Who is involved
| Organisation | City | Country | Role |
|---|---|---|---|
| Kobenhavns Universitet | Kobenhavn | Denmark | Coordinator |
| Katholieke Universiteit Leuven | Leuven | Belgium | Participant |
| Johann Wolfgang Goethe-Universitaet Frankfurt Am Main | Frankfurt Am Main | Germany | Participant |
| Universitaet Bielefeld | Bielefeld | Germany | Participant |
| WS Audiology A/S | Lynge | Denmark | Associatedpartner |
| iMotions A/S | Copenhagen | Denmark | Associatedpartner |
| Endurae Voice Technology Ou | Tallinn | Estonia | Associatedpartner |
| Universidad Pompeu Fabra | Barcelona | Spain | Participant |
| Sorbonne Universite | Paris | France | Participant |
| Université de Montpellier Paul-Valéry | Montpellier | France | Associatedpartner |
| Aryza Ireland Limited | Dublin | Ireland | Associatedpartner |
| The Provost, Fellows, Foundation Scholars & the Other Members of Board, of the College of the Holy & Undivided Trinity of Queen Elizabeth Near Dublin | Dublin | Ireland | Participant |
| Kungliga Tekniska Hoegskolan | Stockholm | Sweden | Participant |
| Linneuniversitetet | Vaxjo | Sweden | Participant |
| Lunds Universitet | Lund | Sweden | Associatedpartner |
| Stockholms Universitet | Stockholm | Sweden | Associatedpartner |
| Tobii AB | Danderyd | Sweden | Associatedpartner |
| University College London | London | United Kingdom | Participant |
Source: CORDIS, European Commission. Data of 5 Nov 2026, reused under the Commission's reuse policy. View on CORDIS · Grant DOI