Big Data Generator and Evaluation of a Similarity Grouping Operator
Description
As Big Data becomes more relevant, existing grouping and clustering algorithms will need to be evaluated for their effectiveness with large amounts of data. Previous work in Similarity Grouping proposes a possible alternative to existing data analytics tools, which acts as a hybrid between fast grouping and insightful clustering. We, the SimCloud Team, proposed Distributed Similarity Group-by (DSG), a distributed implementation of Similarity Group By. Experimental results show that DSG is effective at generating meaningful clusters and has a lower runtime than K-Means, a commonly used clustering algorithm. This document presents my personal contributions to this team effort. The contributions include the multi-dimensional synthetic data generator, execution of the Increasing Scale Factor experiment, and presentations at the NCURIE Symposium and the SISAP 2019 Conference.
Date Created
The date the item was original created (prior to any relationship with the ASU Digital Repositories.)
2019-12
Agent
- Author (aut): Wallace, Xavier Guillermo
- Thesis director: Silva, Yasin
- Committee member: Kuai, Xu
- Contributor (ctb): School for the Future of Innovation in Society
- Contributor (ctb): School of Mathematical and Natural Sciences
- Contributor (ctb): Barrett, The Honors College