EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Privacy-Aware Clinical NLP with Differentially Private Fine-Tuning of Large Language Models

Susan Lopez, Joseph Hill

Frontiers in Biotechnology and Genetics · 30.12.2025 · 2 (1) · 61-68

DOI: 10.71465/fbg549 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Biotechnology and Genetics, online erschienen am 30.12.2025. Verfasst von Susan Lopez und 1 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The integration of Large Language Models (LLMs) into clinical workflows promises to revolutionize medical informatics by automating tasks such as clinical note summarization, diagnostic coding, and patient triage. However, the deployment of these models is severely constrained by the sensitivity of clinical data and stringent regulatory frameworks regarding Protected Health Information (PHI). Standard de-identification techniques often fail to prevent memorization of training data, leaving models vulnerable to membership inference and reconstruction attacks. This paper presents a comprehensive framework for Privacy-Aware Clinical NLP, utilizing Differentially Private Fine-Tuning (DP-FT) on transformer-based architectures. We propose a hybrid approach that integrates Low-Rank Adaptation (LoRA) with Differentially Private Stochastic Gradient Descent (DP-SGD) to mitigate the computational overhead and utility degradation typically associated with private training. By injecting calibrated Gaussian noise into the gradient updates of low-rank adapters while keeping the pre-trained backbone frozen, we achieve a rigorous privacy guarantee without catastrophic forgetting. Our experimental results on the MIMIC-III and MIMIC-IV datasets demonstrate that our method retains high clinical utility in Named Entity Recognition (NER) and summarization tasks while satisfying strict differential privacy budgets (ε

Zitieren

APA

Lopez, S., & Hill, J. (2025). Privacy-Aware Clinical NLP with Differentially Private Fine-Tuning of Large Language Models. Frontiers in Biotechnology and Genetics, 2(1), 61-68. https://doi.org/10.71465/fbg549

Vancouver

Lopez S, Hill J. Privacy-Aware Clinical NLP with Differentially Private Fine-Tuning of Large Language Models. Frontiers in Biotechnology and Genetics. 2025;2(1):61-68. doi:10.71465/fbg549

BibTeX
@article{Lopez2025,
  author = {Lopez, Susan and Hill, Joseph},
  title = {Privacy-Aware Clinical NLP with Differentially Private Fine-Tuning of Large Language Models},
  journal = {Frontiers in Biotechnology and Genetics},
  year = {2025},
  volume = {2},
  number = {1},
  pages = {61--68},
  doi = {10.71465/fbg549}
}
Kostenlos starten →