Seminal
The magazine and atlas of EU-funded researchA new publication from the web and AI team at Scott Charnley

Atlas / Spain

European Research Council grant · Running

PROSODY-SENSES Prosody across senses: Testing a reconceptualization of prosody as a modality-neutral component of language governing spoken, visual and tactile signals

Coordinator
Universidad Pompeu Fabra, Spain
Runs
1 January 2027 to 31 December 2031
Status
Running
EU funding
€2.5m
Total cost
—
Partners
1 organisations in 1 countries
Type
European Research Council grant
Grant agreement
101263450

What the project is doing

In the project's own words, from its summary on CORDIS.

In Bill Clinton’s famous assertion, “I did NOT have sexual relations with that woman,” he employed speech prominence and grouping cues—namely pitch, duration, and intensity—on the negative element to convey a counterexpectational meaning. Prosody functions as a central organizing mechanism in human speech, emphasizing and segmenting information through the use of prominence and grouping patterns, thereby strongly influencing language comprehension.

Although primarily regarded as a unimodal phenomenon confined to the spoken signal, prosodic events frequently coincide with visual communicative cues, such as head or hand gestures, and also with tactile interactions. PROSODY-SENSES seeks to transform our understanding of language prosody by fully integrating its sensory dimensions (spoken, visual, tactile). The project draws upon research in linguistics and cognitive sciences research, aiming to empirically test the groundbreaking proposal that prosody functions as a modality-neutral (or sensory-independent) component of language orchestrating in a flexible way how spoken, visual, and tactile signals express phrasal prominence and grouping across two main language modalities (spoken and sign languages).

The proposal will be evaluated through dynamic analyses of acoustic, kinetic, and tactile pressure patterns of prosody across two strands. Strand 1 will analyze how spoken languages with different prosodic typologies (tonal and non-tonal) exploit the different sensory signals when expressing prosody, and strand 2 will examine their utilization in both sign language and tactile sign language, as employed by deaf and deafblind individuals.

This project aims to enhance our scientific understanding of human language by investigating its adaptability across various sensory signals and language modalities. It holds the potential to substantiate the modality-neutral hypothesis of prosody, thereby significantly advancing a multisensory and inclusive perspective of language.

Topics

Who is involved

OrganisationCityCountryRole
Universidad Pompeu FabraBarcelonaSpainCoordinator

Source: CORDIS, European Commission. Data of 5 Nov 2026, reused under the Commission's reuse policy. View on CORDIS · Grant DOI