EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

The Information Efficiency Metric (IEM): An Info-Metric Approach for Quantifying AI Language Model Performance

Ljerka Luić, Maja Barbić, Marijana Rončević

Information · 22.03.2026 · 17 (3) · 307

DOI: 10.3390/info17030307 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Information, online erschienen am 22.03.2026. Verfasst von Ljerka Luić und 2 weiteren Autor:innen. Die Arbeit nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: University North.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The interaction between humans and artificial intelligence has become a critical channel for information exchange, yet no quantitative, theoretically grounded framework exists for measuring information efficiency in human–AI communication. This study empirically validated an info-metrics framework operationalizing information efficiency through three dimensions—information density (D), relevance (R), and redundancy (Q)—synthesized into an information efficiency metric (IEM). We analyzed 60 AI responses from ChatGPT 5.2 and Claude Opus 4.5 across factual, analytical, and creative question types using combined coding, automated structural measures, and human evaluation of informational units. The results showed that information density and relevance positively contributed to IEM, while redundancy had a negative contribution. Efficiency varied by task type, with factual prompts showing the highest variability across models and highest efficiency. Contrary to expectations, creative responses did not exhibit higher redundancy, suggesting that expressive diversity does not necessarily constitute informational noise. The framework offers a task-sensitive, theoretically grounded approach to evaluating human–AI information exchange beyond correctness or subjective quality judgment, supporting systems-oriented optimization of conversational AI protocols.

Förderung

  • University North

Zitieren

APA

Luić, L., Barbić, M., & Rončević, M. (2026). The Information Efficiency Metric (IEM): An Info-Metric Approach for Quantifying AI Language Model Performance. Information, 17(3), 307. https://doi.org/10.3390/info17030307

Vancouver

Luić L, Barbić M, Rončević M. The Information Efficiency Metric (IEM): An Info-Metric Approach for Quantifying AI Language Model Performance. Information. 2026;17(3):307. doi:10.3390/info17030307

BibTeX
@article{Lui2026,
  author = {Luić, Ljerka and Barbić, Maja and Rončević, Marijana},
  title = {The Information Efficiency Metric (IEM): An Info-Metric Approach for Quantifying AI Language Model Performance},
  journal = {Information},
  year = {2026},
  volume = {17},
  number = {3},
  pages = {307},
  doi = {10.3390/info17030307}
}
Kostenlos starten →