EUVIMEDEUVIMED entdecken
ValidierungsstudieOpen Access

Coding of Childhood Psychiatric and Neurodevelopmental Disorders in Electronic Health Records of a Large Integrated Health Care System: Validation Study

Jiaxiao M Shi iD, Vicki Y Chiu iD, Chantal C Avila iD, Sierra Lewis iD, Daniella Park iD, Morgan R Peltier iD, Darios Getahun iD

JMIR Mental Health · 2024

DOI: 10.2196/56812 ↗

Kurz gefasst

Validierungsstudie in der Zeitschrift JMIR Mental Health, 2024. Verfasst von Jiaxiao M Shi und 6 weiteren Autor:innen. Beteiligte Einrichtung: Department of Research and Evaluation, Kaiser Permanente Southern California, Pasadena, CA, United States. Hauptthemen laut MEDLINE: Electronic Health Records, Delivery of Health Care, Integrated, COVID-19, Neurodevelopmental Disorders. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 28 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Mental, emotional, and behavioral disorders are chronic pediatric conditions, and their prevalence has been on the rise over recent decades. Affected children have long-term health sequelae and a decline in health-related quality of life. Due to the lack of a validated database for pharmacoepidemiological research on selected mental, emotional, and behavioral disorders, there is uncertainty in their reported prevalence in the literature.

Objectives

We aimed to evaluate the accuracy of coding related to pediatric mental, emotional, and behavioral disorders in a large integrated health care system’s electronic health records (EHRs) and compare the coding quality before and after the implementation of the International Classification of Diseases, Tenth Revision, Clinical Modification ( ICD-10-CM ) coding as well as before and after the COVID-19 pandemic.

Methods

Medical records of 1200 member children aged 2-17 years with at least 1 clinical visit before the COVID-19 pandemic (January 1, 2012, to December 31, 2014, the ICD-9-CM coding period; and January 1, 2017, to December 31, 2019, the ICD-10-CM coding period) and after the COVID-19 pandemic (January 1, 2021, to December 31, 2022) were selected with stratified random sampling from EHRs for chart review. Two trained research associates reviewed the EHRs for all potential cases of autism spectrum disorder (ASD), attention-deficit hyperactivity disorder (ADHD), major depression disorder (MDD), anxiety disorder (AD), and disruptive behavior disorders (DBD) in children during the study period. Children were considered cases only if there was a mention of any one of the conditions (yes for diagnosis) in the electronic chart during the corresponding time period. The validity of diagnosis codes was evaluated by directly comparing them with the gold standard of chart abstraction using sensitivity, specificity, positive predictive value, negative predictive value, the summary statistics of the F -score, and Youden J statistic. κ statistic for interrater reliability among the 2 abstractors was calculated.

Results

The overall agreement between the identification of mental, behavioral, and emotional conditions using diagnosis codes compared to medical record abstraction was strong and similar across the ICD-9-CM and ICD-10-CM coding periods as well as during the prepandemic and pandemic time periods. The performance of AD coding, while strong, was relatively lower compared to the other conditions. The weighted sensitivity, specificity, positive predictive value, and negative predictive value for each of the 5 conditions were as follows: 100%, 100%, 99.2%, and 100%, respectively, for ASD; 100%, 99.9%, 99.2%, and 100%, respectively, for ADHD; 100%, 100%, 100%, and 100%, respectively for DBD; 87.7%, 100%, 100%, and 99.2%, respectively, for AD; and 100%, 100%, 99.2%, and 100%, respectively, for MDD. The F -score and Youden J statistic ranged between 87.7% and 100%. The overall agreement between abstractors was almost perfect (κ=95%).

Conclusions

Diagnostic codes are quite reliable for identifying selected childhood mental, behavioral, and emotional conditions. The findings remained similar during the pandemic and after the implementation of the ICD-10-CM coding in the EHR system.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Electronic Health RecordsDelivery of Health Care, IntegratedCOVID-19Neurodevelopmental DisordersMental DisordersHumansChildAdolescentChild, PreschoolMaleFemaleInternational Classification of DiseasesClinical Coding

Stichwörter der Autor:innen

ADADHDASDDBDMDDaccuracyanxiety disordersattention deficit hyperactivity disorderautismautism spectrum disorderautisticbabiesbabybehaviorbehavioral

Autor:innen und Institutionen

  • Department of Research and Evaluation, Kaiser Permanente Southern California, Pasadena, CA, United States.
  • Department of Psychiatry, Jersey Shore University Medical Center, Neptune, NJ, United States.

ORCID-Profile: Jiaxiao M Shi, Vicki Y Chiu, Chantal C Avila, Sierra Lewis, Daniella Park, Morgan R Peltier, Darios Getahun

Zitieren

APA

Shi, J. M., Chiu, V. Y., Avila, C. C., Lewis, S., Park, D., Peltier, M. R., & Getahun, D. (2024). Coding of Childhood Psychiatric and Neurodevelopmental Disorders in Electronic Health Records of a Large Integrated Health Care System: Validation Study. JMIR Mental Health. https://doi.org/10.2196/56812

Vancouver

Shi JM, Chiu VY, Avila CC, Lewis S, Park D, Peltier MR, et al. Coding of Childhood Psychiatric and Neurodevelopmental Disorders in Electronic Health Records of a Large Integrated Health Care System: Validation Study. JMIR Mental Health. 2024. doi:10.2196/56812

BibTeX
@article{Shi2024,
  author = {Shi, Jiaxiao M and Chiu, Vicki Y and Avila, Chantal C and Lewis, Sierra and Park, Daniella and Peltier, Morgan R and Getahun, Darios},
  title = {Coding of Childhood Psychiatric and Neurodevelopmental Disorders in Electronic Health Records of a Large Integrated Health Care System: Validation Study},
  journal = {JMIR Mental Health},
  year = {2024},
  doi = {10.2196/56812}
}
Kostenlos starten →