Seminal
The magazine and atlas of EU-funded researchA new publication from the web and AI team at Scott Charnley

Atlas / Czechia

Marie Skłodowska-Curie Action · Running

RAVIOLI Retrieval-Augmented VIsion-Language Models for Open-vocabulary LocalizatIon

Coordinator
Ceske Vysoke Uceni Technicke V Praze, Czechia
Runs
1 September 2025 to 31 August 2027
Status
Running
EU funding
€192k
Total cost
—
Partners
2 organisations in 2 countries
Type
Marie Skłodowska-Curie Action
Grant agreement
101205297

What the project is doing

In the project's own words, from its summary on CORDIS.

The proposed research project, RAVIOLI (Retrieval-Augmented VIsion-Language Models for Open-vocabulary LocalizatIon), aims to significantly advance the field of segmentation by innovatively integrating retrieval-based predictions from a memory with the original predictions of a vision-language model (VLM) through a learnable fusion model. Addressing a critical gap in existing methods, which often struggle to adapt to new or complex classes and domains, RAVIOLI seeks to enhance the accuracy, adaptability, and granularity of segmentation tasks across various applications, from autonomous vehicles to medical imaging.

Importantly, there has been no similar attempt to learn a fusion model with these properties in any open-vocabulary dense task, such as segmentation, making our approach truly pioneering. The ambitious scope of this project lies in its aim to create a tailored, flexible, robust, and scalable solution that will redefine the capabilities of vision-language models, setting a new standard in the field of open-vocabulary segmentation.

The project will be hosted by the Visual Recognition Group (VRG) at the Czech Technical University in Prague (CTU) under the supervision of Prof. Giorgos Tolias. The fellow, Bill Psomas, with a strong background in computer vision (CV) and deep learning (DL), is well-equipped to lead this research, which will further supported by a secondment at AImageLab, University of Modena and Reggio Emilia (UNIMORE) working with Prof.

Rita Cucchiara.

Who is involved

OrganisationCityCountryRole
Ceske Vysoke Uceni Technicke V PrazePrahaCzechiaCoordinator
Universita Degli Studi Di Modena E Reggio EmiliaModenaItalyAssociatedpartner

Source: CORDIS, European Commission. Data of 5 Nov 2026, reused under the Commission's reuse policy. View on CORDIS · Grant DOI