Big data clustering techniques based on Spark: a literature review

Mozamel M. Saeed, Zaher Al Aghbari, Mohammed Alsharidah

Research output: Contribution to journalArticlepeer-review

35 Scopus citations

Abstract

A popular unsupervised learning method, known as clustering, is extensively used in data mining, machine learning and pattern recognition. The procedure involves grouping of single and distinct points in a group in such a way that they are either similar to each other or dissimilar to points of other clusters. Traditional clustering methods are greatly challenged by the recent massive growth of data. Therefore, several research works proposed novel designs for clustering methods that leverage the benefits of Big Data platforms, such as Apache Spark, which is designed for fast and distributed massive data processing. However, Spark-based clustering research is still in its early days. In this systematic survey, we investigate the existing Spark-based clustering methods in terms of their support to the characteristics Big Data. Moreover, we propose a new taxonomy for the Spark-based clustering methods. To the best of our knowledge, no survey has been conducted on Spark-based clustering of Big Data. Therefore, this survey aims to present a comprehensive summary of the previous studies in the field of Big Data clustering using Apache Spark during the span of 2010-2020. This survey also highlights the new research directions in the field of clustering massive data.

Original languageEnglish
Pages (from-to)1-28
Number of pages28
JournalPeerJ Computer Science
Volume6
DOIs
StatePublished - 2020

Keywords

  • Big Data
  • Big Data clustering
  • Spark
  • Spark-based clustering

Fingerprint

Dive into the research topics of 'Big data clustering techniques based on Spark: a literature review'. Together they form a unique fingerprint.

Cite this