EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

An Embedding-Based Semantic Analysis Approach: A Preliminary Study on Redundancy Detection in Psychological Concepts Operationalized by Scales

Zhen Huang iD, Yitian Long, Kaiping Peng, Song Tong iD

Journal of Intelligence · 16.01.2025 · 13 (1) · 11

DOI: 10.3390/jintelligence13010011 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Intelligence, online erschienen am 16.01.2025. Verfasst von Zhen Huang und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Social Sciences, Tsinghua University, Beijing 100084, China. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ping An Project of Institute for Global Industry, Tsinghua University, Self-Funded Project of the Institute for Global Industry, Tsinghua University, Humanities and Social Science Fund of the Ministry of Education of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

As psychological research progresses, the issue of concept overlap becomes increasing evident, adding to participant burden and complicating data interpretation. This study introduces an Embedding-based Semantic Analysis Approach (ESAA) for detecting redundancy in psychological concepts, which are operationalized through their respective scales, using natural language processing techniques. The ESAA utilizes OpenAI’s text-embedding-3-large model to generate high-dimensional semantic vectors (i.e., embeddings) of scale items and applies hierarchical clustering to group semantically similar items, revealing potential redundancy. Three preliminary experiments evaluated the ESAA’s ability to (1) identify semantically similar items, (2) differentiate semantically distinct items, and (3) uncover overlap between scales of concepts known for redundancy issues. Additionally, comparative analyses assessed the ESAA’s robustness and incremental validity against the advanced chatbots based on GPT-4. The results demonstrated that the ESAA consistently produced stable outcomes and outperformed all evaluated chatbots. As an objective approach for analyzing relationships between concepts operationalized as scales, the ESAA holds promise for advancing research on theory refinement and scale optimization.

Schlagwörter

Stichwörter der Autor:innen

GPThierarchical clusteringpsychological scalesredundancy detection

Autor:innen und Institutionen

  • School of Social Sciences, Tsinghua University, Beijing 100084, China.
  • Wuhan Britain-China School, Wuhan 430000, China.
  • Department of Psychological and Cognitive Sciences, Tsinghua University, Beijing 100084, China.

ORCID-Profile: Zhen Huang, Song Tong

Förderung

  • Ping An Project of Institute for Global Industry, Tsinghua University
  • Self-Funded Project of the Institute for Global Industry, Tsinghua University
  • Humanities and Social Science Fund of the Ministry of Education of China

Zitieren

APA

Huang, Z., Long, Y., Peng, K., & Tong, S. (2025). An Embedding-Based Semantic Analysis Approach: A Preliminary Study on Redundancy Detection in Psychological Concepts Operationalized by Scales. Journal of Intelligence, 13(1), 11. https://doi.org/10.3390/jintelligence13010011

Vancouver

Huang Z, Long Y, Peng K, Tong S. An Embedding-Based Semantic Analysis Approach: A Preliminary Study on Redundancy Detection in Psychological Concepts Operationalized by Scales. Journal of Intelligence. 2025;13(1):11. doi:10.3390/jintelligence13010011

BibTeX
@article{Huang2025,
  author = {Huang, Zhen and Long, Yitian and Peng, Kaiping and Tong, Song},
  title = {An Embedding-Based Semantic Analysis Approach: A Preliminary Study on Redundancy Detection in Psychological Concepts Operationalized by Scales},
  journal = {Journal of Intelligence},
  year = {2025},
  volume = {13},
  number = {1},
  pages = {11},
  doi = {10.3390/jintelligence13010011}
}
Kostenlos starten →