Seminal
The magazine and atlas of EU-funded researchA new publication from the web and AI team at Scott Charnley

Atlas / France

European Research Council grant · Running

HI-Audio Hybrid and Interpretable Deep neural audio machines

Coordinator
Institut Mines-Telecom, France
Runs
1 October 2022 to 30 September 2027
Status
Running
EU funding
€2.5m
Total cost
€2.5m
Partners
1 organisations in 1 countries
Type
European Research Council grant
Grant agreement
101052978

What the project is doing

In the project's own words, from its summary on CORDIS.

Machine Listening, or AI for Sound, is defined as the general field of Artificial Intelligence applied to audio analysis, understanding and synthesis by a machine. The access to ever increasing super-computing facilities, combined with the availability of huge data repositories (although largely unannotated), has led to the emergence of a significant trend with pure data-driven machine learning approaches. The field has rapidly moved towards end-to-end neural approaches which aim to directly solve the machine learning problem for raw acoustic signals but often only loosely taking into account the nature and structure of the processed data.

The main consequences are that the models are 1) overly complex, require massive amounts of data to be trained and extreme computing power to be efficient (in terms of task performance), and 2) remain largely unexplainable and non-interpretable. To overcome these major shortcomings, we believe that our prior knowledge about the nature of the processed data, their generation process and their perception by humans should be explicitly exploited in neural-based machine learning frameworks.

The aim of HI-Audio is to build such hybrid deep approaches combining parameter-efficient and interpretable signal models, musicological and physics-based models, with highly tailored, deep neural architectures. The research directions pursued in HI-Audio will exploit novel deterministic and statistical audio and sound environment models with dedicated neural auto-encoders and generative networks and target specific applications including speech and audio scene analysis, music information retrieval and sound transformation and synthesis.

Topics

Who is involved

OrganisationCityCountryRole
Institut Mines-TelecomPalaiseauFranceCoordinator

Source: CORDIS, European Commission. Data of 5 Nov 2026, reused under the Commission's reuse policy. View on CORDIS · Grant DOI