ELLIOT European Large Open Multi-Modal Foundation Models For Robust Generalization On Arbitrary Data Streams
- Coordinator
- Ethniko Kentro Erevnas Kai Technologikis Anaptyxis, Greece
- Runs
- 1 July 2025 to 30 June 2029
- Status
- Running
- EU funding
- €25.0m
- Total cost
- €25.0m
- Partners
- 37 organisations in 14 countries
- Type
- Research and Innovation Action
- Grant agreement
- 101214398
What the project is doing
In the project's own words, from its summary on CORDIS.
At the heart of ELLIOT is the development of open Multimodal Generalist Foundation Models (MGFMs): AI systems designed to learn general knowledge and patterns from massive amounts of data of various types — from videos, images, and text to sensor signals, industrial time series, and satellite feeds — and efficiently transfer the generic knowledge learned in generalist manner to a wide variety of downstream tasks. Unlike current foundation models that face significant challenges in terms of generalisation capabilities and support for multimodal data, ELLIOT’s models will be capable of robust generalisation across conditions not seen during the training, coping well with dynamic, noisy, and temporally-evolving multimodal data streams.
Real and synthetic data, to mitigate data scarcity, will be leveraged for training MGFMs and for further adapting them for specific downstream tasks in domains like media, earth observation, robot perception, mobility, computer engineering and workflow automation. Real data used for training will include data directly provided by members of the consortium as well as data from relevant European Data Spaces, while complementary synthetic data will be generated by exploiting existing generative AI capabilities as well as new ones developed in the project.
European HPC infrastructure is directly included in the consortium to ensure the availability of the necessary computing resources.
Topics
Who is involved
| Organisation | City | Country | Role |
|---|---|---|---|
| Ethniko Kentro Erevnas Kai Technologikis Anaptyxis | Thermi Thessaloniki | Greece | Coordinator |
| Nxai GmbH | Linz | Austria | Participant |
| De Vlaamse Radio En Televisieomroeporganisatie NV | Bruxelles / Brussel | Belgium | Participant |
| Katholieke Universiteit Leuven | Leuven | Belgium | Participant |
| Ecole Polytechnique Federale De Lausanne | Lausanne | Switzerland | Associatedpartner |
| Eidgenoessische Technische Hochschule Zuerich | Zuerich | Switzerland | Associatedpartner |
| Ceske Vysoke Uceni Technicke V Praze | Praha | Czechia | Participant |
| Robotwin Sro | Praha | Czechia | Participant |
| Albert-Ludwigs-Universitaet Freiburg | Freiburg | Germany | Participant |
| Cispa - Helmholtz-Zentrum Fur Informationssicherheit Ggmbh | Saarbrucken | Germany | Participant |
| Eberhard Karls Universitaet Tuebingen | Tuebingen | Germany | Participant |
| ELLIS Institute Tübingen gGmbH | Tubingen | Germany | Participant |
| Forschungszentrum Julich GmbH | Julich | Germany | Participant |
| Johann Wolfgang Goethe-Universitaet Frankfurt Am Main | Frankfurt Am Main | Germany | Participant |
| Ludwig-Maximilians-Universitaet Muenchen | Planegg | Germany | Participant |
| Prior Labs GmbH | Freiburg Im Breisgau | Germany | Participant |
| Barcelona Supercomputing Center Centro Nacional De Supercomputacion | Barcelona | Spain | Participant |
| Centre De Visio per Computador | Cerdanyola del Valles | Spain | Participant |
| Deimos Engineering and Systems Slu | Puertollano | Spain | Participant |
| Deimos Space Sociedad Limitada Unipersonal | Tres Cantos (Madrid) | Spain | Third party |
| Departament De Territori, Habitatge I Transicio Ecologica | Barcelona | Spain | Participant |
| Fundacion De La Comunitat Valenciana Unidad Ellis Alicante | San Vicente Del Raspeig/San Vicent | Spain | Participant |
| Openchip Software Technologies SL | Barcelona | Spain | Participant |
| Universitat De Valencia | Valencia | Spain | Participant |
| Aalto Korkeakoulusaatio Sr | Espoo | Finland | Participant |
| Csc-Tieteen Tietotekniikan Keskus Oy | Espoo | Finland | Participant |
| Letxbe | Paris | France | Participant |
| Valeo Comfort and Driving Assistance | Creteil | France | Participant |
| Voxist | Saint-Mande | France | Participant |
| Cineca Consorzio Interuniversitario | Casalecchio Di Reno Bo | Italy | Participant |
| Universita Degli Studi Di Modena E Reggio Emilia | Modena | Italy | Participant |
| Universita Degli Studi Di Trento | Trento | Italy | Participant |
| Technische Universiteit Eindhoven | Eindhoven | Netherlands | Participant |
| Universiteit Van Amsterdam | Amsterdam | Netherlands | Participant |
| Globaz SA | Oliveira De Azemeis | Portugal | Participant |
| Institut Jozef Stefan | Ljubljana | Slovenia | Participant |
| Deimos Space UK Limited | Harwell Oxford Oxfordshire | United Kingdom | Third party |
Source: CORDIS, European Commission. Data of 5 Nov 2026, reused under the Commission's reuse policy. View on CORDIS · Grant DOI