Developing Validity Evidence for a Novel Pediatric Telemedicine Assessment Tool (PTAT) for Pediatric Residents: A Pilot Study
Academic Pediatrics · 2026-01 · 26 (1) · 103145
DOI: 10.1016/j.acap.2025.103145 ↗Kurz gefasst
Validierungsstudie in der Zeitschrift Academic Pediatrics, 2026-01. Verfasst von Theresa E Scott und 4 weiteren Autor:innen. Beteiligte Einrichtung: Weill Cornell Medicine (TE Scott), Department of Pediatrics, New York, NY. Electronic address: tes9045@med.cornell.edu. Hauptthemen laut MEDLINE: Internship and Residency, Pediatrics, Telemedicine, Clinical Competence. Die Arbeit nennt 19 Literaturangaben. Gefördert von: Weill Cornell Medicine.
Abstract (Originalsprache)
OBJECTIVES: Telemedicine use among pediatric residents has grown in recent years, accompanied by the development of best practices and curricula that outline essential telemedicine skills. However, there is a notable lack of methods to assess these skills. Our work aims to address this gap by designing and building validity evidence for a novel pediatric telemedicine assessment tool, the Pediatric Telemedicine Assessment Tool (PTAT). METHODS: The PTAT was created by the study team. Multiple sources of validity evidence were collected, including content validity, internal structure, response process, and relationship to other variables. The PTAT was studied using standardized patient telemedicine encounters with pediatric residents. Twenty-one residents performed a telemedicine encounter that was scored using the PTAT. Recruited faculty scored the encounters and were surveyed on PTAT usability using a modified Systems Usability Scale (SUS). Descriptive statistics and interrater reliability (intraclass correlation [ICC]) were calculated. RESULTS: The PTAT consists of 16 items scored on a four-point rating scale; it also includes a five-point overall global skills assessment (GSA). Compared to post-graduate year-1 (PGY-1) residents, PGY-2-4 residents had more telemedicine experience (92% vs 25%, P = 0.003) and higher PTAT (1.39 vs 1.21, P = 0.02) and GSA scores (1.67 vs 1.00, P = 0.002). The PTAT items had moderate overall interrater reliability (ICC = 0.6 [95% CI = 0.50-0.68]). The faculty reported "above average" usability. CONCLUSIONS: The PTAT demonstrated multiple sources of validity evidence including content validity, internal structure, response process, and relationship to other variables. It may be used as a tool to structure formative feedback for resident use of telemedicine in standardized patient encounters.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Weill Cornell Medicine (TE Scott), Department of Pediatrics, New York, NY. Electronic address: tes9045@med.cornell.edu.
- Weill Cornell Medicine (A An), Division of Biostatistics, Department of Population Health Sciences, New York, NY.
- Pediatrix Medical Group of Florida at Winnie Palmer Hospital for Women & Babies (NP Black), Orlando, Fla.
- University of California, Davis (S-TT Li), Department of Pediatrics, Sacramento, Calif.
- Weill Cornell Medicine (EL Abramson), Department of Pediatrics, New York, NY.
Förderung
- Weill Cornell Medicine
Zitieren
APA
Scott, T. E., An, A., Black, N. P., Li, S. T., & Abramson, E. L. (2026). Developing Validity Evidence for a Novel Pediatric Telemedicine Assessment Tool (PTAT) for Pediatric Residents: A Pilot Study. Academic Pediatrics, 26(1), 103145. https://doi.org/10.1016/j.acap.2025.103145
Vancouver
Scott TE, An A, Black NP, Li ST, Abramson EL. Developing Validity Evidence for a Novel Pediatric Telemedicine Assessment Tool (PTAT) for Pediatric Residents: A Pilot Study. Academic Pediatrics. 2026;26(1):103145. doi:10.1016/j.acap.2025.103145
BibTeX
@article{Scott2026,
author = {Scott, Theresa E and An, Anjile and Black, Nicole Paradise and Li, Su-Ting T and Abramson, Erika L},
title = {Developing Validity Evidence for a Novel Pediatric Telemedicine Assessment Tool (PTAT) for Pediatric Residents: A Pilot Study},
journal = {Academic Pediatrics},
year = {2026},
volume = {26},
number = {1},
pages = {103145},
doi = {10.1016/j.acap.2025.103145}
}
EUVIMED