EUVIMEDEUVIMED entdecken
Crossref

Web Scraping Techniques for Surgical Research: A Technical Tutorial With a Worked Example in Publication Data Mining

Andrew C Kuo, Rachel L Wolansky iD, Lorenzo Hiraldo iD, Joseph Sujka, Paul C Kuo iD

The American Surgeon™ · 2026-10 · 92 (10) · 2508-2514

DOI: 10.1177/00031348261441678 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The American Surgeon™, online erschienen am 09.04.2026. Verfasst von Andrew C Kuo und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Surgery, University of South Florida, Tampa, FL, USA. Hauptthemen laut MEDLINE: Data Mining, Internet, Biomedical Research, General Surgery. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 12 Literaturangaben. Gefördert von: NIGMS NIH HHS, NIH.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Web scraping—the automated extraction of data from websites—has become an essential technique for researchers seeking to collect large-scale data that would be impractical to gather manually. Surgeon-scientists increasingly encounter publicly available web data relevant to outcomes research, health services analysis, workforce studies, and policy work, yet technical guidance on implementing web scrapers remains limited in the surgical literature.

Methods

This tutorial provides a clinician-oriented technical guide to web scraping for surgical research. We present key concepts including static vs dynamic websites, CSS selectors, browser automation, rate limiting, and ethical considerations. A complete worked example demonstrates the full pipeline by scraping a surgical research group’s publication page ( https://www.onetomapanalytics.com ) to build a structured bibliometric database.

Results

The worked example successfully extracts structured publication data—including titles, author lists, abstracts, keywords, and PubMed links—from a JavaScript-rendered website, producing an analysis-ready data set. We demonstrate how this pipeline generalizes to other surgical research applications including hospital price transparency data, residency program characteristics, and quality metrics.

Conclusions

Web scraping is a powerful tool for surgeon-scientists when implemented with technical rigor and ethical responsibility. By anchoring the tutorial to a concrete surgical use case and providing a reusable code template, we equip surgical researchers with the foundational knowledge to design, implement, and adapt web scrapers for their own data collection projects.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Data MiningInternetBiomedical ResearchGeneral SurgeryHumansBibliometrics

Stichwörter der Autor:innen

PythonSeleniumautomationbibliometricsbrowser automationdata extractionhospital price transparencypublication data miningresearch methodologysurgical researchweb scraping

Autor:innen und Institutionen

  • Department of Surgery, University of South Florida, Tampa, FL, USA.

ORCID-Profile: Rachel L Wolansky, Lorenzo Hiraldo, Paul C Kuo

Förderung

  • NIGMS NIH HHS
  • NIH

Zitieren

APA

Kuo, A. C., Wolansky, R. L., Hiraldo, L., Sujka, J., & Kuo, P. C. (2026). Web Scraping Techniques for Surgical Research: A Technical Tutorial With a Worked Example in Publication Data Mining. The American Surgeon™, 92(10), 2508-2514. https://doi.org/10.1177/00031348261441678

Vancouver

Kuo AC, Wolansky RL, Hiraldo L, Sujka J, Kuo PC. Web Scraping Techniques for Surgical Research: A Technical Tutorial With a Worked Example in Publication Data Mining. The American Surgeon™. 2026;92(10):2508-2514. doi:10.1177/00031348261441678

BibTeX
@article{Kuo2026,
  author = {Kuo, Andrew C and Wolansky, Rachel L and Hiraldo, Lorenzo and Sujka, Joseph and Kuo, Paul C},
  title = {Web Scraping Techniques for Surgical Research: A Technical Tutorial With a Worked Example in Publication Data Mining},
  journal = {The American Surgeon™},
  year = {2026},
  volume = {92},
  number = {10},
  pages = {2508--2514},
  doi = {10.1177/00031348261441678}
}
Kostenlos starten →