EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Research on Real-time E-commerce Price Comparison System Using Python Web Scraping Technology

Fan Chen

International Journal of Computer Science and Information Technology · 10.10.2024 · 4 (2) · 127-136

DOI: 10.62051/ijcsit.v4n2.18 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Computer Science and Information Technology, online erschienen am 10.10.2024. Verfasst von Fan Chen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 10 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper presents a study on the development of a real-time price comparison system for e-commerce platforms using Python-based web scraping technologies. The objective is to analyze and compare product prices across major e-commerce platforms, including Taobao, JD.com, and Amazon, by leveraging different web scraping libraries such as BeautifulSoup, Scrapy, and Selenium. The study outlines the technical challenges associated with dynamic content extraction, anti-scraping mechanisms, and the effectiveness of various scraping tools. Through experimental evaluation, we compare the scraping efficiency, success rate, and data accuracy across the three platforms. The results indicate that JD.com, with its mostly static content, offers the highest scraping efficiency when using BeautifulSoup, while Amazon, despite slower page loading, achieves a high success rate using Scrapy. Taobao, on the other hand, presents significant challenges due to its dynamic loading and strict anti-scraping measures, making Selenium the most appropriate tool, albeit with slower processing times. This research provides valuable insights into the selection of optimal web scraping techniques for real-time price comparison systems and highlights the impact of platform-specific challenges on the accuracy and efficiency of data extraction.

Zitieren

APA

Chen, F. (2024). Research on Real-time E-commerce Price Comparison System Using Python Web Scraping Technology. International Journal of Computer Science and Information Technology, 4(2), 127-136. https://doi.org/10.62051/ijcsit.v4n2.18

Vancouver

Chen F. Research on Real-time E-commerce Price Comparison System Using Python Web Scraping Technology. International Journal of Computer Science and Information Technology. 2024;4(2):127-136. doi:10.62051/ijcsit.v4n2.18

BibTeX
@article{Chen2024,
  author = {Chen, Fan},
  title = {Research on Real-time E-commerce Price Comparison System Using Python Web Scraping Technology},
  journal = {International Journal of Computer Science and Information Technology},
  year = {2024},
  volume = {4},
  number = {2},
  pages = {127--136},
  doi = {10.62051/ijcsit.v4n2.18}
}
Kostenlos starten →