EUVIMEDEUVIMED entdecken
Open Access

Time on Your Side: Aggregating Data in Difference‐In‐Differences Studies

Summer Rak, Laura A Hatfield iD, Carrie E Fry iD

Health Services Research · 2025

DOI: 10.1111/1475-6773.14636 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Health Services Research, 2025. Verfasst von Summer Rak und 2 weiteren Autor:innen. Beteiligte Einrichtung: RTI International, Research Triangle Park, North Carolina, USA. Hauptthemen laut MEDLINE: Police. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NIDA NIH HHS, NIA NIH HHS, National Institute on Aging.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objective

To compare the performance of difference‐in‐differences estimators fit to data aggregated to different time scales. Study Setting and Design In simulations, we generated monthly observations for 50–100 units over 6 years from both a parametric model and a resampling simulation. The simulation scenarios varied panel balance, treatment timing, and true treatment effects. Our target parameters were static and dynamic average effects of treatment on the treated (ATT) estimated via linear regression (for common timing scenarios) and Callaway and Sant'Anna (2021) estimators (for staggered timing scenarios). We compared estimates from monthly, quarterly, and yearly data using bias, standard error, root mean squared error (RMSE), power, and Type I error. We also conducted a case study to illustrate the real‐world impacts of these decisions. Data Sources and Analytic Sample We used data from a study of police retraining for the resampling simulations and case study. These data included counts of use‐of‐force incidents and dates of training enrollment for 8614 officers each month from 2011 to 2016. Principal Findings Results from the simulation varied across performance metrics, estimation methods, target estimands, and data structures. In general, the choice of time aggregation was more consequential when estimating dynamic (versus static) treatment effects, in unbalanced (versus balanced) panel data, and in the resampling simulations (where data had less autocorrelation). Although time aggregation mattered little in many scenarios, coarser aggregation was preferable in resampling simulations of staggered timing scenarios. The re‐analysis of police training data was sensitive to time aggregation.

Conclusions

In many scenarios, time aggregation has little impact on difference‐in‐differences estimators. However, when estimating dynamic effects, especially in staggered timing settings and unbalanced data, we found a tradeoff between precision and power, with finer aggregations being more powerful but less precise. In addition, estimators that use a single reference time point are more sensitive to noise in data measured at finer time scales.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

PoliceHumansTime FactorsComputer SimulationData Interpretation, StatisticalModels, StatisticalBiasLinear Models

Stichwörter der Autor:innen

causal inferencerepeated measuressimulation studystatistical data analysis

Autor:innen und Institutionen

  • RTI International, Research Triangle Park, North Carolina, USA.
  • Statistics and Data Science, NORC at the University of Chicago, Chicago, Illinois, USA.
  • Department of Health Policy, Vanderbilt University School of Medicine, Nashville, Tennessee, USA.

ORCID-Profile: Laura A Hatfield, Carrie E Fry

Förderung

  • NIDA NIH HHS
  • NIA NIH HHS
  • National Institute on Aging
  • National Institute on Drug Abuse

Zitieren

APA

Rak, S., Hatfield, L. A., & Fry, C. E. (2025). Time on Your Side: Aggregating Data in Difference‐In‐Differences Studies. Health Services Research. https://doi.org/10.1111/1475-6773.14636

Vancouver

Rak S, Hatfield LA, Fry CE. Time on Your Side: Aggregating Data in Difference‐In‐Differences Studies. Health Services Research. 2025. doi:10.1111/1475-6773.14636

BibTeX
@article{Rak2025,
  author = {Rak, Summer and Hatfield, Laura A and Fry, Carrie E},
  title = {Time on Your Side: Aggregating Data in Difference‐In‐Differences Studies},
  journal = {Health Services Research},
  year = {2025},
  doi = {10.1111/1475-6773.14636}
}
Kostenlos starten →