RAVIOLI Retrieval-Augmented VIsion-Language Models for Open-vocabulary LocalizatIon
- Coordinator
- Ceske Vysoke Uceni Technicke V Praze, Czechia
- Runs
- 1 September 2025 to 31 August 2027
- Status
- Running
- EU funding
- €192k
- Total cost
- —
- Partners
- 2 organisations in 2 countries
- Type
- Marie Skłodowska-Curie Action
- Grant agreement
- 101205297
What the project is doing
In the project's own words, from its summary on CORDIS.
The proposed research project, RAVIOLI (Retrieval-Augmented VIsion-Language Models for Open-vocabulary LocalizatIon), aims to significantly advance the field of segmentation by innovatively integrating retrieval-based predictions from a memory with the original predictions of a vision-language model (VLM) through a learnable fusion model. Addressing a critical gap in existing methods, which often struggle to adapt to new or complex classes and domains, RAVIOLI seeks to enhance the accuracy, adaptability, and granularity of segmentation tasks across various applications, from autonomous vehicles to medical imaging.
Importantly, there has been no similar attempt to learn a fusion model with these properties in any open-vocabulary dense task, such as segmentation, making our approach truly pioneering. The ambitious scope of this project lies in its aim to create a tailored, flexible, robust, and scalable solution that will redefine the capabilities of vision-language models, setting a new standard in the field of open-vocabulary segmentation.
The project will be hosted by the Visual Recognition Group (VRG) at the Czech Technical University in Prague (CTU) under the supervision of Prof. Giorgos Tolias. The fellow, Bill Psomas, with a strong background in computer vision (CV) and deep learning (DL), is well-equipped to lead this research, which will further supported by a secondment at AImageLab, University of Modena and Reggio Emilia (UNIMORE) working with Prof.
Rita Cucchiara.
Who is involved
| Organisation | City | Country | Role |
|---|---|---|---|
| Ceske Vysoke Uceni Technicke V Praze | Praha | Czechia | Coordinator |
| Universita Degli Studi Di Modena E Reggio Emilia | Modena | Italy | Associatedpartner |
Source: CORDIS, European Commission. Data of 5 Nov 2026, reused under the Commission's reuse policy. View on CORDIS · Grant DOI