Seminal
The magazine and atlas of EU-funded researchA new publication from the web and AI team at Scott Charnley

Atlas / Spain

Research and Innovation Action · Finished

SAFEXPLAIN Safe and Explainable Critical Embedded Systems Based on Ai

Coordinator
Barcelona Supercomputing Center Centro Nacional De Supercomputacion, Spain
Runs
1 October 2022 to 30 September 2025
Status
Finished
EU funding
€3.9m
Total cost
€3.9m
Partners
6 organisations in 4 countries
Type
Research and Innovation Action
Grant agreement
101069595

What the project is doing

In the project's own words, from its summary on CORDIS.

Deep Learning (DL) techniques are key for most future advanced software functions in Critical Autonomous AI-based Systems (CAIS) in cars, trains and satellites. Hence, those CAIS industries depend on their ability to design, implement, qualify, and certify DL-based software products under bounded effort/cost. There is a fundamental gap between Functional Safety (FUSA) requirements of CAIS and the nature of DL solutions needed to satisfy those requirements.

The lack of transparency (mainly explainability and traceability), and the data-dependent and stochastic nature of DL software clash against the need for deterministic, verifiable and pass/fail test-based software solutions for CAIS.SAFEXPLAIN tackles this challenge by providing a novel and flexible approach to allow the certification – hence adoption – of DL-based solutions in CAIS by (1) architecting transparent DL solutions that allow explaining why they satisfy FUSA requirements, with end-to-end traceability, with specific approaches to explain whether predictions can be trusted, and with strategies to reach (and prove) correct operation, in accordance with certification standards.

SAFEXPLAIN will also (2) devise alternative and increasingly complex FUSA design safety patterns for different DL usage levels (i.e. with varying safety requirements) that will allow using DL in any CAIS functionality, for varying levels of criticality and fault tolerance. SAFEXPLAIN brings together a highly skilled and complementary consortium to successfully tackle this endeavor including 3 research centers, RISE (AI expertise), IKR (FUSA expertise), and BSC (platform expertise); and 3 CAIS case studies, automotive (NAV), space (AIKO), and railway (IKR).

SAFEXPLAIN DL-based solutions are assessed in an industrial toolset (EXI). Finally, to prove that transparency levels are fully compliant with FUSA, solutions are reviewed by internal certification experts (EXI), and external ones subcontracted for an independent assessment.

Topics

Who is involved

OrganisationCityCountryRole
Barcelona Supercomputing Center Centro Nacional De SupercomputacionBarcelonaSpainCoordinator
Ikerlan S. CoopMondragonSpainParticipant
Aiko SRLTorinoItalyParticipant
Exida Development SRLColleretto Giacosa ToItalyParticipant
Navinfo Europe BVEindhovenNetherlandsParticipant
Rise Research Institutes of Sweden ABBorasSwedenParticipant

Source: CORDIS, European Commission. Data of 5 Nov 2026, reused under the Commission's reuse policy. View on CORDIS · Grant DOI