EUVIMEDSkopri EUVIMED
Open access · CC BY-NC-ND 4.0

Privacy-Aware Clinical NLP with Differentially Private Fine-Tuning of Large Language Models

Susan Lopez, Joseph Hill

Frontiers in Biotechnology and Genetics · 2025-12-30 · 2 (1) · 61-68

DOI: 10.71465/fbg549 ↗

At a glance

Journal article in Frontiers in Biotechnology and Genetics, published online on 2025-12-30. Written by Susan Lopez and 1 co-authors. The full text is freely available (open access, CC BY-NC-ND 4.0).

AstrattDettalji biblijografiċiCiteRelated studies

Abstract (original language)

The integration of Large Language Models (LLMs) into clinical workflows promises to revolutionize medical informatics by automating tasks such as clinical note summarization, diagnostic coding, and patient triage. However, the deployment of these models is severely constrained by the sensitivity of clinical data and stringent regulatory frameworks regarding Protected Health Information (PHI). Standard de-identification techniques often fail to prevent memorization of training data, leaving models vulnerable to membership inference and reconstruction attacks. This paper presents a comprehensive framework for Privacy-Aware Clinical NLP, utilizing Differentially Private Fine-Tuning (DP-FT) on transformer-based architectures. We propose a hybrid approach that integrates Low-Rank Adaptation (LoRA) with Differentially Private Stochastic Gradient Descent (DP-SGD) to mitigate the computational overhead and utility degradation typically associated with private training. By injecting calibrated Gaussian noise into the gradient updates of low-rank adapters while keeping the pre-trained backbone frozen, we achieve a rigorous privacy guarantee without catastrophic forgetting. Our experimental results on the MIMIC-III and MIMIC-IV datasets demonstrate that our method retains high clinical utility in Named Entity Recognition (NER) and summarization tasks while satisfying strict differential privacy budgets (ε

Cite

APA

Lopez, S., & Hill, J. (2025). Privacy-Aware Clinical NLP with Differentially Private Fine-Tuning of Large Language Models. Frontiers in Biotechnology and Genetics, 2(1), 61-68. https://doi.org/10.71465/fbg549

Vancouver

Lopez S, Hill J. Privacy-Aware Clinical NLP with Differentially Private Fine-Tuning of Large Language Models. Frontiers in Biotechnology and Genetics. 2025;2(1):61-68. doi:10.71465/fbg549

BibTeX
@article{Lopez2025,
  author = {Lopez, Susan and Hill, Joseph},
  title = {Privacy-Aware Clinical NLP with Differentially Private Fine-Tuning of Large Language Models},
  journal = {Frontiers in Biotechnology and Genetics},
  year = {2025},
  volume = {2},
  number = {1},
  pages = {61--68},
  doi = {10.71465/fbg549}
}
Start for free →