EUVIMEDAtrasti EUVIMED
Open access · CC BY 4.0

Ideology and Policy Preferences in Synthetic Data: The Potential of LLMs for Public Opinion Analysis

Keyeun Lee, Jaehyuk Park, Suh-hee Choi, Changkeun Lee

Media and Communication · 2025-05-22 · 13

DOI: 10.17645/mac.9677 ↗

At a glance

Journal article in Media and Communication, published online on 2025-05-22. Written by Keyeun Lee and 3 co-authors. Cited 5 times so far (Crossref); 40 references. The full text is freely available (open access, CC BY 4.0).

SantraukaBibliografiniai duomenysCiteRelated studies

Abstract (original language)

This study investigates whether large language models (LLMs) can meaningfully extend or generate synthetic public opinion survey data on labor policy issues in South Korea. Unlike prior work conducted on people’s general sociocultural values or specific political topics such as voting intentions, our research examines policy preferences on tangible social and economic topics, offering deeper insights for news media and data analysts. In two key applications, we first explore whether LLMs can predict public sentiment on emerging or rapidly evolving issues using existing survey data. We then assess how LLMs generate synthetic datasets resembling real-world survey distributions. Our findings reveal that while LLMs capture demographic and ideological traits with reasonable accuracy, they tend to overemphasize ideological orientation for politically charged topics—a bias that is more pronounced in fully synthetic data, raising concerns about perpetuating societal stereotypes. Despite these challenges, LLMs hold promise for enhancing data-driven journalism and policy research, particularly in polarized societies. We call for further study into how LLM-based predictions align with human responses in diverse sociopolitical settings, alongside improved tools and guidelines to mitigate embedded biases.

Cite

APA

Lee, K., Park, J., Choi, S., & Lee, C. (2025). Ideology and Policy Preferences in Synthetic Data: The Potential of LLMs for Public Opinion Analysis. Media and Communication, 13. https://doi.org/10.17645/mac.9677

Vancouver

Lee K, Park J, Choi S, Lee C. Ideology and Policy Preferences in Synthetic Data: The Potential of LLMs for Public Opinion Analysis. Media and Communication. 2025;13. doi:10.17645/mac.9677

BibTeX
@article{Lee2025,
  author = {Lee, Keyeun and Park, Jaehyuk and Choi, Suh-hee and Lee, Changkeun},
  title = {Ideology and Policy Preferences in Synthetic Data: The Potential of LLMs for Public Opinion Analysis},
  journal = {Media and Communication},
  year = {2025},
  volume = {13},
  doi = {10.17645/mac.9677}
}
Start for free →