A New Mutual Information Estimator for Continuous Censored Variables
Entropy · 11.06.2026 · 28 (6) · 677
DOI: 10.3390/e28060677 ↗Kurz gefasst
Fachartikel in der Zeitschrift Entropy, online erschienen am 11.06.2026. Verfasst von Ima Bernada und 2 weiteren Autor:innen. Beteiligte Einrichtung: Bordeaux Population Health, Institut National de la Santé et de la Recherche Médicale, 33000 Bordeaux, France. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 18 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: ANR Precision medicine with longitudinal data, ANR.
Abstract (Originalsprache)
Estimating dependency relationships between variables is an important issue in statistics. Mutual information (MI) is a measure of dependency which quantifies the amount of shared information between two variables. It is free of distribution assumption and captures both linear and non-linear dependencies. MI estimation methods were primarily developed for datasets with exclusively discrete variables, exclusively continuous variables, or a mixture of both. In practice, complex variables containing both discrete and continuous values (discrete-continuous variables), specifically continuous censored variables, are often present in real datasets (e.g., biological measures from analytical tools with lower detection limit). Methods have been developed to handle discrete-continuous data, but their effectiveness on the specific case of continuous censored data has not yet been evaluated. We propose a new estimation method based on the decomposition of the MI formula, with a first part handling the censoring status of the data, and a second part handling its continuous section. This estimation method works as a correction, as it takes in parameter one MI estimator for continuous data, and makes it able to handling censoring. We constructed different simulation scenarios of pairs of correlated censored log-normal variables, by varying the censoring rate, correlation, and sample size. We evaluated our correction on a few existing estimators previously developed for continuous, mixed or discrete-continuous data. We compared the selected estimators, with and without the correction, on these different scenarios. We found that the correction globally enables to reduce bias, and allows convergence towards the true MI value as the number of observations increases.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Bordeaux Population Health, Institut National de la Santé et de la Recherche Médicale, 33000 Bordeaux, France.
- Laboratoire de Probabilités, Statistique et Modélisation, Institut National des Sciences Mathématiques et de Leurs Interactions, Centre National de la Recherche Scientifique, Sorbonne Université, 75005 Paris, France.
ORCID-Profile: Ima Bernada
Förderung
- ANR Precision medicine with longitudinal data
- ANR
Zitieren
APA
Bernada, I., Samieri, C., & Nuel, G. (2026). A New Mutual Information Estimator for Continuous Censored Variables. Entropy, 28(6), 677. https://doi.org/10.3390/e28060677
Vancouver
Bernada I, Samieri C, Nuel G. A New Mutual Information Estimator for Continuous Censored Variables. Entropy. 2026;28(6):677. doi:10.3390/e28060677
BibTeX
@article{Bernada2026,
author = {Bernada, Ima and Samieri, Cécilia and Nuel, Grégory},
title = {A New Mutual Information Estimator for Continuous Censored Variables},
journal = {Entropy},
year = {2026},
volume = {28},
number = {6},
pages = {677},
doi = {10.3390/e28060677}
}
EUVIMED