EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

The Same Corpus, Two Conclusions: How Analyst Choices Can Determine Cross-Platform Findings

Mirko Laquintana, Remo Pareschi

Information · 09.11.2026 · 17 (11) · 1120

DOI: 10.3390/info17111120 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Information, online erschienen am 09.11.2026. Verfasst von Mirko Laquintana und 1 weiteren Autor:innen. Die Arbeit nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Enterprises and Made in Italy.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Cross-platform web analytics compares sources differing radically in document length, editorial form, and corpus assembly. We show that four routine analyst choices—the unit at which sub-document predictions are aggregated, the summary measure, the relevance criterion, and the order in which documents reach the topic model—can change substantive conclusions about platforms, the three of them decisively and the fourth only where the disagreeing measures do not both separate the pair, while conventional robustness checks detect them only in part. On Ukraine-related discourse from The Guardian, Reddit, and five military OSINT Telegram channels, argmax aggregation took the newspaper’s negative share from 59.3% at sentence level to 90.7% at item level—a movement produced by length, not content, and therefore an error for any comparison meant to be independent of verbosity; a length-invariant measure removed the apparent lead, and which source then looks most negative depends on whose lengths are imposed. Differing relevance criteria reversed which platforms appeared most similar; across twenty-two document orderings, that reversal held in direction but not magnitude. We report and retract the finding in full. The one within-source result we expected to survive, tested blind against pre-specified criteria, is carried by one Telegram channel and reversed in another. No claim about the platforms survives. Several failures share a structure: a figure aggregating heterogeneous units describes none of them. We close with reporting requirements for cross-platform work.

Förderung

  • Ministry of Enterprises and Made in Italy

Zitieren

APA

Laquintana, M., & Pareschi, R. (2026). The Same Corpus, Two Conclusions: How Analyst Choices Can Determine Cross-Platform Findings. Information, 17(11), 1120. https://doi.org/10.3390/info17111120

Vancouver

Laquintana M, Pareschi R. The Same Corpus, Two Conclusions: How Analyst Choices Can Determine Cross-Platform Findings. Information. 2026;17(11):1120. doi:10.3390/info17111120

BibTeX
@article{Laquintana2026,
  author = {Laquintana, Mirko and Pareschi, Remo},
  title = {The Same Corpus, Two Conclusions: How Analyst Choices Can Determine Cross-Platform Findings},
  journal = {Information},
  year = {2026},
  volume = {17},
  number = {11},
  pages = {1120},
  doi = {10.3390/info17111120}
}
Kostenlos starten →