The Same Corpus, Two Conclusions: How Analyst Choices Can Determine Cross-Platform Findings
Information · 09.11.2026 · 17 (11) · 1120
DOI: 10.3390/info17111120 ↗Kurz gefasst
Fachartikel in der Zeitschrift Information, online erschienen am 09.11.2026. Verfasst von Mirko Laquintana und 1 weiteren Autor:innen. Die Arbeit nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Enterprises and Made in Italy.
Abstract (Originalsprache)
Cross-platform web analytics compares sources differing radically in document length, editorial form, and corpus assembly. We show that four routine analyst choices—the unit at which sub-document predictions are aggregated, the summary measure, the relevance criterion, and the order in which documents reach the topic model—can change substantive conclusions about platforms, the three of them decisively and the fourth only where the disagreeing measures do not both separate the pair, while conventional robustness checks detect them only in part. On Ukraine-related discourse from The Guardian, Reddit, and five military OSINT Telegram channels, argmax aggregation took the newspaper’s negative share from 59.3% at sentence level to 90.7% at item level—a movement produced by length, not content, and therefore an error for any comparison meant to be independent of verbosity; a length-invariant measure removed the apparent lead, and which source then looks most negative depends on whose lengths are imposed. Differing relevance criteria reversed which platforms appeared most similar; across twenty-two document orderings, that reversal held in direction but not magnitude. We report and retract the finding in full. The one within-source result we expected to survive, tested blind against pre-specified criteria, is carried by one Telegram channel and reversed in another. No claim about the platforms survives. Several failures share a structure: a figure aggregating heterogeneous units describes none of them. We close with reporting requirements for cross-platform work.
Förderung
- Ministry of Enterprises and Made in Italy
Zitieren
APA
Laquintana, M., & Pareschi, R. (2026). The Same Corpus, Two Conclusions: How Analyst Choices Can Determine Cross-Platform Findings. Information, 17(11), 1120. https://doi.org/10.3390/info17111120
Vancouver
Laquintana M, Pareschi R. The Same Corpus, Two Conclusions: How Analyst Choices Can Determine Cross-Platform Findings. Information. 2026;17(11):1120. doi:10.3390/info17111120
BibTeX
@article{Laquintana2026,
author = {Laquintana, Mirko and Pareschi, Remo},
title = {The Same Corpus, Two Conclusions: How Analyst Choices Can Determine Cross-Platform Findings},
journal = {Information},
year = {2026},
volume = {17},
number = {11},
pages = {1120},
doi = {10.3390/info17111120}
}
EUVIMED