Designing Parallel Algorithms for Community Detection using Arachne

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The rise of graph data in various fields calls for efficient and scalable community detection algorithms. In this paper, we present parallel implementations of two widely used algorithms: Label Propagation and Louvain, specifically designed to leverage the capabilities of Arachne, which is a Python-accessible open-source framework for large-scale graph analysis. Our implementations achieve substantial speedups over existing Python-based tools like NetworkX and igraph, which lack efficient parallelization, and are competitive with parallel frameworks such as NetworKit. Experimental results show that Arachne-based methods outperform these baselines, achieving speedups of up to 710x over NetworkX, 75x over igraph, and 12x over NetworKit. Additionally, we analyze the scalability of our implementation under varying thread counts, demonstrating how different phases contribute to overall performance gains of the parallel Louvain algorithm. Arachne, including our community detection implementation, is open-source and available at https://github.com/Bears-R-Us/arkouda-njit.

Original languageEnglish (US)
Title of host publication2025 IEEE High Performance Extreme Computing Conference, HPEC 2025
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798331578442
DOIs
StatePublished - 2025
Externally publishedYes
Event2025 IEEE High Performance Extreme Computing Conference, HPEC 2025 - Virtual, Online
Duration: Sep 15 2025Sep 19 2025

Publication series

Name2025 IEEE High Performance Extreme Computing Conference, HPEC 2025

Conference

Conference2025 IEEE High Performance Extreme Computing Conference, HPEC 2025
CityVirtual, Online
Period9/15/259/19/25

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Computational Theory and Mathematics
  • Computer Science Applications
  • Hardware and Architecture
  • Computational Mathematics
  • Control and Optimization

Keywords

  • Data Science
  • Graph Algorithms
  • High-Performance Computing

Fingerprint

Dive into the research topics of 'Designing Parallel Algorithms for Community Detection using Arachne'. Together they form a unique fingerprint.

Cite this