EUVIMEDEUVIMED entdecken
Crossref

What counts as a multimodal metaphor and metonymy? Evolution of inter-rater reliability across rounds of annotation

Paula Pérez Sobrino, Samantha Ford

Language and Cognition · 2023-12 · 15 (4) · 786-814

DOI: 10.1017/langcog.2023.26 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Language and Cognition, online erschienen am 20.07.2023. Verfasst von Paula Pérez Sobrino und 1 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 66 Literaturangaben. Gefördert von: Gobierno de Aragón, Ministerio de Ciencia e Innovación.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

An open question in research on multimodal figuration is how to mitigate the analyst’s bias in identifying and interpreting metaphor and metonymy; an issue that determines the generalizability of the findings. Little is known about the causes that motivate different annotations. Inter-rater reliability tests are useful to investigate the sources of variation in annotations by independent researchers that can help inform and refine protocols. Inspired by existing procedures for verbal, visual, and filmic metaphor identification, we formulated instructions to identify multimodal metaphor and metonymy and tested it against a corpus of 21 generic advertisements and 21 genre-specific advertisements (mobile phones). Two independent researchers annotated the advertisements in six rounds. A joint discussion followed each round to consider conflicting annotations and refine the protocol for the ensuing round. By examining the evolution of inter-rater reliability results, we found that (1) we reached similar levels of agreement for the identification of metaphor and metonymy, although converging on the interpretation of metonymy was more difficult; (2) some genre specificities made it easier to agree on the annotations for mobile advertisements than for the general advertisements; and (3) there was a consistent increase in the kappa scores reaching substantial agreement by the sixth round.

Förderung

  • Gobierno de Aragón
  • Ministerio de Ciencia e Innovación

Zitieren

APA

Sobrino, P. P., & Ford, S. (2023). What counts as a multimodal metaphor and metonymy? Evolution of inter-rater reliability across rounds of annotation. Language and Cognition, 15(4), 786-814. https://doi.org/10.1017/langcog.2023.26

Vancouver

Sobrino PP, Ford S. What counts as a multimodal metaphor and metonymy? Evolution of inter-rater reliability across rounds of annotation. Language and Cognition. 2023;15(4):786-814. doi:10.1017/langcog.2023.26

BibTeX
@article{Sobrino2023,
  author = {Sobrino, Paula Pérez and Ford, Samantha},
  title = {What counts as a multimodal metaphor and metonymy? Evolution of inter-rater reliability across rounds of annotation},
  journal = {Language and Cognition},
  year = {2023},
  volume = {15},
  number = {4},
  pages = {786--814},
  doi = {10.1017/langcog.2023.26}
}
Kostenlos starten →