EUVIMEDEUVIMED entdecken
Validierungsstudie

Developing Validity Evidence for a Novel Pediatric Telemedicine Assessment Tool (PTAT) for Pediatric Residents: A Pilot Study

Theresa E Scott, Anjile An, Nicole Paradise Black, Su-Ting T Li, Erika L Abramson

Academic Pediatrics · 2026-01 · 26 (1) · 103145

DOI: 10.1016/j.acap.2025.103145 ↗

Kurz gefasst

Validierungsstudie in der Zeitschrift Academic Pediatrics, 2026-01. Verfasst von Theresa E Scott und 4 weiteren Autor:innen. Beteiligte Einrichtung: Weill Cornell Medicine (TE Scott), Department of Pediatrics, New York, NY. Electronic address: tes9045@med.cornell.edu. Hauptthemen laut MEDLINE: Internship and Residency, Pediatrics, Telemedicine, Clinical Competence. Die Arbeit nennt 19 Literaturangaben. Gefördert von: Weill Cornell Medicine.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

OBJECTIVES: Telemedicine use among pediatric residents has grown in recent years, accompanied by the development of best practices and curricula that outline essential telemedicine skills. However, there is a notable lack of methods to assess these skills. Our work aims to address this gap by designing and building validity evidence for a novel pediatric telemedicine assessment tool, the Pediatric Telemedicine Assessment Tool (PTAT). METHODS: The PTAT was created by the study team. Multiple sources of validity evidence were collected, including content validity, internal structure, response process, and relationship to other variables. The PTAT was studied using standardized patient telemedicine encounters with pediatric residents. Twenty-one residents performed a telemedicine encounter that was scored using the PTAT. Recruited faculty scored the encounters and were surveyed on PTAT usability using a modified Systems Usability Scale (SUS). Descriptive statistics and interrater reliability (intraclass correlation [ICC]) were calculated. RESULTS: The PTAT consists of 16 items scored on a four-point rating scale; it also includes a five-point overall global skills assessment (GSA). Compared to post-graduate year-1 (PGY-1) residents, PGY-2-4 residents had more telemedicine experience (92% vs 25%, P = 0.003) and higher PTAT (1.39 vs 1.21, P = 0.02) and GSA scores (1.67 vs 1.00, P = 0.002). The PTAT items had moderate overall interrater reliability (ICC = 0.6 [95% CI = 0.50-0.68]). The faculty reported "above average" usability. CONCLUSIONS: The PTAT demonstrated multiple sources of validity evidence including content validity, internal structure, response process, and relationship to other variables. It may be used as a tool to structure formative feedback for resident use of telemedicine in standardized patient encounters.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Internship and ResidencyPediatricsTelemedicineClinical CompetenceEducational MeasurementHumansPilot ProjectsReproducibility of ResultsMaleFemale

Stichwörter der Autor:innen

assessmentgeneral pediatricsresident educationtelemedicine

Autor:innen und Institutionen

  • Weill Cornell Medicine (TE Scott), Department of Pediatrics, New York, NY. Electronic address: tes9045@med.cornell.edu.
  • Weill Cornell Medicine (A An), Division of Biostatistics, Department of Population Health Sciences, New York, NY.
  • Pediatrix Medical Group of Florida at Winnie Palmer Hospital for Women & Babies (NP Black), Orlando, Fla.
  • University of California, Davis (S-TT Li), Department of Pediatrics, Sacramento, Calif.
  • Weill Cornell Medicine (EL Abramson), Department of Pediatrics, New York, NY.

Förderung

  • Weill Cornell Medicine

Zitieren

APA

Scott, T. E., An, A., Black, N. P., Li, S. T., & Abramson, E. L. (2026). Developing Validity Evidence for a Novel Pediatric Telemedicine Assessment Tool (PTAT) for Pediatric Residents: A Pilot Study. Academic Pediatrics, 26(1), 103145. https://doi.org/10.1016/j.acap.2025.103145

Vancouver

Scott TE, An A, Black NP, Li ST, Abramson EL. Developing Validity Evidence for a Novel Pediatric Telemedicine Assessment Tool (PTAT) for Pediatric Residents: A Pilot Study. Academic Pediatrics. 2026;26(1):103145. doi:10.1016/j.acap.2025.103145

BibTeX
@article{Scott2026,
  author = {Scott, Theresa E and An, Anjile and Black, Nicole Paradise and Li, Su-Ting T and Abramson, Erika L},
  title = {Developing Validity Evidence for a Novel Pediatric Telemedicine Assessment Tool (PTAT) for Pediatric Residents: A Pilot Study},
  journal = {Academic Pediatrics},
  year = {2026},
  volume = {26},
  number = {1},
  pages = {103145},
  doi = {10.1016/j.acap.2025.103145}
}
Kostenlos starten →