EUVIMEDEUVIMED entdecken
Open Access

Psychometric Evaluation of the Modified Neonatal Resuscitation Program Adherence Assessment Tool When Utilized for In Situ Simulation and Telesimulation Scenarios

Sophia Martens, Misty Melendi iD, Allison Zanno iD, Anya Cutler iD, Leah M Seften, Sierra Soghikian, Tara Palnitkar iD, Leah Mallory iD, Tania D Strout iD

American Journal of Perinatology · 01.07.2026 · 43 (09) · 1170-1177

DOI: 10.1055/a-2722-7228 ↗

Auf einen Blick

Die mNRP wurde in 96 Simulationen für In-situ- und Telesimulation geprüft. Die Reliabilität und Validität waren in beiden Formaten insgesamt unterstützt.

Fragestellung

Wie zuverlässig und valide ist das modifizierte NRP-(mNRP)-Tool zur Bewertung der Teamleistung in In-situ- und Telesimulationsszenarien?

Methode

Methodische Sekundäranalyse von Daten aus einer größeren Simulationsstudie; Itemanalysen nach Classical Test Theory, Reliabilität, explorative Faktorenanalyse und Interrater-Reliabilität.

Ergebnisse

96 Simulationen. Cronbachs α: 0,76 (onsite) und 0,78 (TS). EFA ergab 3 Komponenten (onsite) und 4 Komponenten (TS). Niedrigstes vs. höchstes Quartil: p < 0,001; IRR 0,5 bis 0,9.

Schlussfolgerung der Autor:innen

Die Befunde liefern Evidenz für Reliabilität und Validität des mNRP-Tools in In-situ- und Telesimulationsformaten.

Kernaussagen

  • 96 Simulationen wurden analysiert
  • Cronbachs α: 0,76 bzw. 0,78
  • IRR zwischen 0,5 und 0,9

Deutsche Zusammenfassung: KI-gestützt aus dem Original-Abstract erstellt; alle Zahlen wurden automatisch mit dem Original abgeglichen. Maßgeblich ist der Original-Abstract.

Kurz gefasst

Fachartikel in der Zeitschrift American Journal of Perinatology, erschienen am 01.07.2026. Verfasst von Sophia Martens und 8 weiteren Autor:innen. Beteiligte Einrichtung: Medical Student, Tufts University School of Medicine, Portland, Maine, United States. Hauptthemen laut MEDLINE: Resuscitation, Simulation Training, Clinical Competence, Guideline Adherence. Die Arbeit nennt 23 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NIGMS NIH HHS, National Institute of General Medical Sciences.

Auf einen BlickAbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Neonatal resuscitation is a high acuity, low occurrence event that requires precision, teamwork, and rapid decision-making. Simulation using Neonatal Resuscitation Program (NRP) guidelines allows teams to build competency and preparedness, improving neonatal outcomes. Accurate, reliable performance evaluation during simulation is essential to the provision of meaningful feedback. Evidence supporting the reliability and validity of existing tools when used in telesimulation (TS) is limited. We sought to evaluate the psychometric properties of the modified NRP (mNRP) tool when assessing interprofessional team performance in onsite and TS environments. We employed a methodological design to conduct secondary analyses of data from a larger study using simulation to enhance resuscitation skills as assessed by the mNRP. Item-level data from 96 simulations were subjected to Classical Test Theory-based item analyses, including evaluation of item difficulty, discrimination, and item-to-total correlation; reliability; and exploratory factor analysis (EFA). Interrater reliability (IRR) between novice and expert raters was assessed for a subset of cases. Item difficulties reflected a desirable mix of difficulty in endorsement, suggesting that items capture a range of guideline adherence. Most item discrimination (range: 0.05–0.81) and corrected item-total correlation (range: 0.005–0.68) values had moderate-to-strong, positive correlations with total scores, indicating discriminative ability. EFA yielded three and four components for the onsite and TS groups, respectively. Cronbach's α was 0.76 (onsite) or 0.78 (TS). Lowest versus highest mNRP quartiles differed significantly in both formats (p < 0.001 for each), supporting construct validity. IRR ranged from 0.5 to 0.9, supporting moderate to good agreement between novice and expert raters. Findings provide evidence supporting the reliability and validity of the mNRP tool when applied in both the in situ and TS settings. IRR was acceptable for expert and novice evaluators. This analysis provides additional validity evidence for the mNRP when used to evaluate interprofessional team performance in both onsite and TS formats.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

ResuscitationSimulation TrainingClinical CompetenceGuideline AdherenceHumansPsychometricsReproducibility of ResultsInfant, NewbornFemalePatient Care Team

Autor:innen und Institutionen

  • Medical Student, Tufts University School of Medicine, Portland, Maine, United States.
  • Division of Neonatology, Barbara Bush Children's Hospital at Maine Medical Center, Maine Health, Tufts University School of Medicine, Portland, Maine, United States.
  • Maine Health, Maine Medical Center, Portland, Barbara Bush Children's Hospital, Tufts University School of Medicine, Portland, Maine, United States.
  • Maine Health Institute for Research, Center for Interdisciplinary and Population Health Research, Portland, Maine, United States.
  • Maine Health, Maine Medical Center, Portland, Barbara Bush Children's Hospital, Portland, Maine, United States.
  • Pediatric Hospital Medicine, Hannaford Simulation Center, Tufts University School of Medicine, Maine Health, Maine Medical Center, Portland, Barbara Bush Children's Hospital, Tufts University School of Medicine, Portlan…

ORCID-Profile: Misty Melendi, Allison Zanno, Anya Cutler, Tara Palnitkar, Leah Mallory, Tania D Strout

Förderung

  • NIGMS NIH HHS
  • National Institute of General Medical Sciences

Zitieren

APA

Martens, S., Melendi, M., Zanno, A., Cutler, A., Seften, L. M., Soghikian, S., Palnitkar, T., Mallory, L., & Strout, T. D. (2026). Psychometric Evaluation of the Modified Neonatal Resuscitation Program Adherence Assessment Tool When Utilized for In Situ Simulation and Telesimulation Scenarios. American Journal of Perinatology, 43(09), 1170-1177. https://doi.org/10.1055/a-2722-7228

Vancouver

Martens S, Melendi M, Zanno A, Cutler A, Seften LM, Soghikian S, et al. Psychometric Evaluation of the Modified Neonatal Resuscitation Program Adherence Assessment Tool When Utilized for In Situ Simulation and Telesimulation Scenarios. American Journal of Perinatology. 2026;43(09):1170-1177. doi:10.1055/a-2722-7228

BibTeX
@article{Martens2026,
  author = {Martens, Sophia and Melendi, Misty and Zanno, Allison and Cutler, Anya and Seften, Leah M and Soghikian, Sierra and Palnitkar, Tara and Mallory, Leah and Strout, Tania D},
  title = {Psychometric Evaluation of the Modified Neonatal Resuscitation Program Adherence Assessment Tool When Utilized for In Situ Simulation and Telesimulation Scenarios},
  journal = {American Journal of Perinatology},
  year = {2026},
  volume = {43},
  number = {09},
  pages = {1170--1177},
  doi = {10.1055/a-2722-7228}
}
Kostenlos starten →