EUVIMEDObjevte EUVIMED
QuerschnittstudieOpen access

The Impact of Performance Expectancy, Workload, Risk, and Satisfaction on Trust in ChatGPT: Cross-Sectional Survey Analysis

Avishek Choudhury iD, Hamid Shamszare iD

JMIR Human Factors · 2024-05-27 · 11 · e55399

DOI: 10.2196/55399 ↗

At a glance

Querschnittstudie in JMIR Human Factors, published online on 2024-05-27. Written by Avishek Choudhury and 1 co-authors. Institution: Industrial and Management Systems Engineering, Benjamin M. Statler College of Engineering and Mineral Resources, West Virginia University, Morgantown…. Major MEDLINE topics: Trust, Workload. Cited 71 times so far (Crossref); 47 references. The full text is freely available in PubMed Central.

AbstraktSubjectsBibliografické údajeCiteRelated studies

Abstract (original language)

Background

ChatGPT (OpenAI) is a powerful tool for a wide range of tasks, from entertainment and creativity to health care queries. There are potential risks and benefits associated with this technology. In the discourse concerning the deployment of ChatGPT and similar large language models, it is sensible to recommend their use primarily for tasks a human user can execute accurately. As we transition into the subsequent phase of ChatGPT deployment, establishing realistic performance expectations and understanding users’ perceptions of risk associated with its use are crucial in determining the successful integration of this artificial intelligence (AI) technology.

Objective

The aim of the study is to explore how perceived workload, satisfaction, performance expectancy, and risk-benefit perception influence users’ trust in ChatGPT.

Methods

A semistructured, web-based survey was conducted with 607 adults in the United States who actively use ChatGPT. The survey questions were adapted from constructs used in various models and theories such as the technology acceptance model, the theory of planned behavior, the unified theory of acceptance and use of technology, and research on trust and security in digital environments. To test our hypotheses and structural model, we used the partial least squares structural equation modeling method, a widely used approach for multivariate analysis.

Results

A total of 607 people responded to our survey. A significant portion of the participants held at least a high school diploma (n=204, 33.6%), and the majority had a bachelor’s degree (n=262, 43.1%). The primary motivations for participants to use ChatGPT were for acquiring information (n=219, 36.1%), amusement (n=203, 33.4%), and addressing problems (n=135, 22.2%). Some participants used it for health-related inquiries (n=44, 7.2%), while a few others (n=6, 1%) used it for miscellaneous activities such as brainstorming, grammar verification, and blog content creation. Our model explained 64.6% of the variance in trust. Our analysis indicated a significant relationship between (1) workload and satisfaction, (2) trust and satisfaction, (3) performance expectations and trust, and (4) risk-benefit perception and trust.

Conclusions

The findings underscore the importance of ensuring user-friendly design and functionality in AI-based applications to reduce workload and enhance user satisfaction, thereby increasing user trust. Future research should further explore the relationship between risk-benefit perception and trust in the context of AI chatbots.

Subjects

MeSH terms (MEDLINE)

TrustWorkloadHumansCross-Sectional StudiesFemaleAdultMaleSurveys and QuestionnairesMiddle AgedPersonal SatisfactionUnited StatesArtificial IntelligenceRisk Assessment

Author keywords

ChatGPTalgorithmsartificial intelligencechatbotscross-sectional surveydecision-makingdeep learninghealth carehealth care decision-makinghealth care managementhealth-related decision-makingpractical modelspredictive analyticspredictive modelspredictive system

Authors and institutions

  • Industrial and Management Systems Engineering, Benjamin M. Statler College of Engineering and Mineral Resources, West Virginia University, Morgantown, WV, United States.

ORCID profiles: Avishek Choudhury, Hamid Shamszare

Cite

APA

Choudhury, A., & Shamszare, H. (2024). The Impact of Performance Expectancy, Workload, Risk, and Satisfaction on Trust in ChatGPT: Cross-Sectional Survey Analysis. JMIR Human Factors, 11, e55399. https://doi.org/10.2196/55399

Vancouver

Choudhury A, Shamszare H. The Impact of Performance Expectancy, Workload, Risk, and Satisfaction on Trust in ChatGPT: Cross-Sectional Survey Analysis. JMIR Human Factors. 2024;11:e55399. doi:10.2196/55399

BibTeX
@article{Choudhury2024,
  author = {Choudhury, Avishek and Shamszare, Hamid},
  title = {The Impact of Performance Expectancy, Workload, Risk, and Satisfaction on Trust in ChatGPT: Cross-Sectional Survey Analysis},
  journal = {JMIR Human Factors},
  year = {2024},
  volume = {11},
  pages = {e55399},
  doi = {10.2196/55399}
}
Start for free →