An Improved k‐Anonymization Clustering Mechanisms Using Apache Spark for Privacy‐Preserving Big Data Publishing for Real‐Time Dataset
Concurrency and Computation: Practice and Experience · 2026-03 · 38 (5)
DOI: 10.1002/cpe.70632 ↗Kurz gefasst
Fachartikel in der Zeitschrift Concurrency and Computation: Practice and Experience, online erschienen am 25.02.2026. Verfasst von Xiaojun Pan und 2 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 51 Literaturangaben.
Abstract (Originalsprache)
This work presents comprehensive research of a novel privacy‐preserving approach for big data publishing, emphasizing the integration of advanced clustering and anonymization techniques within a distributed computing framework. The hypothesis underpinning this research is that combining improved clustering algorithms with a refined k‐anonymity model can significantly reduce information loss while enhancing data utility, even at large scales. To test this, the methodology employs a hybrid approach that leverages the 2‐means clustering algorithm, enhanced with a mean‐center initialization method, alongside a greedy algorithm for effective data generalization. The core techniques involve constructing a new information loss function based on information quantity theory, which assigns weights to quasi‐identifiers according to their influence on sensitive attributes, thus enabling more precise and less destructive generalization. The implementation utilizes Apache Spark's RDD programming model to facilitate parallel processing, ensuring scalability and efficiency in handling massive datasets. Experimental results demonstrate that the proposed algorithms outperform existing methods such as traditional k‐means, SparkDA, MRA, and SKA in terms of both information loss and processing time. Specifically, the fuzzy c‐means variant achieves a 25.5% information loss on a dataset of 100 million records, with processing times reduced by 31%–55% compared to Hadoop‐based solutions. Additionally, the approach maintains high data utility for statistical analysis and decision‐making, effectively balancing privacy and utility. Overall, the study confirms that the integration of improved clustering, weighted information loss assessment, and distributed processing tools like Apache Spark provides a scalable, efficient, and privacy‐preserving solution for big data anonymization, with promising implications for real‐time data publishing and analysis.
Zitieren
APA
Pan, X., Jain, P., & Aditya, Y. (2026). An Improved k‐Anonymization Clustering Mechanisms Using Apache Spark for Privacy‐Preserving Big Data Publishing for Real‐Time Dataset. Concurrency and Computation: Practice and Experience, 38(5). https://doi.org/10.1002/cpe.70632
Vancouver
Pan X, Jain P, Aditya Y. An Improved k‐Anonymization Clustering Mechanisms Using Apache Spark for Privacy‐Preserving Big Data Publishing for Real‐Time Dataset. Concurrency and Computation: Practice and Experience. 2026;38(5). doi:10.1002/cpe.70632
BibTeX
@article{Pan2026,
author = {Pan, Xiaojun and Jain, Priyank and Aditya, Yashwant},
title = {An Improved k‐Anonymization Clustering Mechanisms Using Apache Spark for Privacy‐Preserving Big Data Publishing for Real‐Time Dataset},
journal = {Concurrency and Computation: Practice and Experience},
year = {2026},
volume = {38},
number = {5},
doi = {10.1002/cpe.70632}
}
EUVIMED