Seminal
The magazine and atlas of EU-funded researchA new publication from the web and AI team at Scott Charnley

Atlas / Spain

European Research Council grant · Running

SCLIT Scaling and Concentration Laws in Information Theory

Coordinator
Universitat Politecnica De Catalunya, Spain
Runs
1 December 2024 to 30 November 2029
Status
Running
EU funding
€2.5m
Total cost
€2.5m
Partners
2 organisations in 2 countries
Type
European Research Council grant
Grant agreement
101142747

What the project is doing

In the project's own words, from its summary on CORDIS.

Shannon’s 1948 paper established the mathematical foundations of digital compression and transmission and paved the way for the information age. A notion embedded in Shannon’s and most work in Information Theory is the concept of rate, defined as the exponential growth rate of the number of messages. The probabilistic law governing general information processing systems may be such that the optimal number of messages does not scale exponentially with the length of the sequences.

The vast majority of the Information Theory literature assumes an exponential number of messages and thus, ignores the rich amount of possible scaling functions in important settings. When the system probability law is such that the optimal rate scaling is not exponential, standard techniques cannot be applied and new techniques must be sought. A fundamental understanding of the impact of general scaling laws is crucial to harvesting the potential gains in practical system design.

This project is aimed at contributing towards the ambitious goal of providing a unified framework for the study of Information Theory with arbitrary scaling laws. The unified framework will be based on information spectrum and concentration techniques will also consider the penalties incurred by sub-optimal decoding for systems described by general probabilistic laws. The project will also provide coding solutions that approach the theoretical limits.

This unconventional and challenging treatment of Information Theory will advance the area and will contribute to Information Sciences and Systems disciplines where Information Theory is relevant. A comprehensive study of the fundamental limits and optimal code design with general scaling laws will represent a major step forward in the field, with the potential to provide new tools and techniques to solve open problems in close disciplines.

Topics

Who is involved

OrganisationCityCountryRole
Universitat Politecnica De CatalunyaBarcelonaSpainCoordinator
The Chancellor Masters and Scholars of the University of CambridgeCambridgeUnited KingdomParticipant

Source: CORDIS, European Commission. Data of 5 Nov 2026, reused under the Commission's reuse policy. View on CORDIS · Grant DOI