Seminal
The magazine and atlas of EU-funded researchA new publication from the web and AI team at Scott Charnley

Atlas / Netherlands

Research and Innovation Action · Running

UTTER Unified Transcription and Translation for Extended Reality

Coordinator
Universiteit Van Amsterdam, Netherlands
Runs
1 October 2022 to 30 September 2025
Status
Running
EU funding
€4.1m
Total cost
€4.1m
Partners
5 organisations in 4 countries
Type
Research and Innovation Action
Grant agreement
101070631

What the project is doing

In the project's own words, from its summary on CORDIS.

The aim of UTTER is to leverage large language models to build the next generation of multimodal eXtended reality (XR) technologies for transcription, translation, summarisation, and minuting. We will make these technologies scalable, adaptable, contextualised, robust, explainable, and emotion-aware. We will increase the context-sensitivity of the technologies, so they can take into account the full history of the conversation, as well as its wider context.

We will introduce confidence-aware models, which can take into account their own limitations. We will develop explainable models, so the human user can know why the model made the decisions it did. We will improve adaptation, so that domain-specific and language-specific models can be quickly rolled out. For these advances we will make use of pre-trained eXtended reality (XR) models, which optimally combine text and speech signals, and are trained efficiently with adapters and prompting.

We will also develop efficient methods to deploy such large and complex models, so that they can put into production in an energy-efficient manner. Our use-case prototypes will cover (i) A personal assistant for meetings that can improve communication in the online world and (ii) an advanced customer service assistant to support global markets. These prototypes will be developed and tested throughout the project, with annual releases and evaluations.

Through our cascaded grant programme, and our release of tools to facilitate the use of pre-trained XR models, will enable the take-up and development of these technologies throughout Europe.

Topics

Who is involved

OrganisationCityCountryRole
Universiteit Van AmsterdamAmsterdamNetherlandsCoordinator
Naver FranceParisFranceParticipant
Instituto De TelecomunicacoesGloria E Vera CruzPortugalParticipant
Unbabel Unipessoal, LdaPorto AltoPortugalParticipant
The University of EdinburghEdinburghUnited KingdomAssociatedpartner

Source: CORDIS, European Commission. Data of 5 Nov 2026, reused under the Commission's reuse policy. View on CORDIS · Grant DOI