The Information Efficiency Metric (IEM): An Info-Metric Approach for Quantifying AI Language Model Performance
Information · 22.03.2026 · 17 (3) · 307
DOI: 10.3390/info17030307 ↗Kurz gefasst
Fachartikel in der Zeitschrift Information, online erschienen am 22.03.2026. Verfasst von Ljerka Luić und 2 weiteren Autor:innen. Die Arbeit nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: University North.
Abstract (Originalsprache)
The interaction between humans and artificial intelligence has become a critical channel for information exchange, yet no quantitative, theoretically grounded framework exists for measuring information efficiency in human–AI communication. This study empirically validated an info-metrics framework operationalizing information efficiency through three dimensions—information density (D), relevance (R), and redundancy (Q)—synthesized into an information efficiency metric (IEM). We analyzed 60 AI responses from ChatGPT 5.2 and Claude Opus 4.5 across factual, analytical, and creative question types using combined coding, automated structural measures, and human evaluation of informational units. The results showed that information density and relevance positively contributed to IEM, while redundancy had a negative contribution. Efficiency varied by task type, with factual prompts showing the highest variability across models and highest efficiency. Contrary to expectations, creative responses did not exhibit higher redundancy, suggesting that expressive diversity does not necessarily constitute informational noise. The framework offers a task-sensitive, theoretically grounded approach to evaluating human–AI information exchange beyond correctness or subjective quality judgment, supporting systems-oriented optimization of conversational AI protocols.
Förderung
- University North
Zitieren
APA
Luić, L., Barbić, M., & Rončević, M. (2026). The Information Efficiency Metric (IEM): An Info-Metric Approach for Quantifying AI Language Model Performance. Information, 17(3), 307. https://doi.org/10.3390/info17030307
Vancouver
Luić L, Barbić M, Rončević M. The Information Efficiency Metric (IEM): An Info-Metric Approach for Quantifying AI Language Model Performance. Information. 2026;17(3):307. doi:10.3390/info17030307
BibTeX
@article{Lui2026,
author = {Luić, Ljerka and Barbić, Maja and Rončević, Marijana},
title = {The Information Efficiency Metric (IEM): An Info-Metric Approach for Quantifying AI Language Model Performance},
journal = {Information},
year = {2026},
volume = {17},
number = {3},
pages = {307},
doi = {10.3390/info17030307}
}
EUVIMED