TY - GEN
T1 - Designing Parallel Algorithms for Community Detection using Arachne
AU - Li, Fuhuan
AU - Du, Zhihui
AU - Bader, David A.
N1 - Publisher Copyright:
© 2025 IEEE.
PY - 2025
Y1 - 2025
N2 - The rise of graph data in various fields calls for efficient and scalable community detection algorithms. In this paper, we present parallel implementations of two widely used algorithms: Label Propagation and Louvain, specifically designed to leverage the capabilities of Arachne, which is a Python-accessible open-source framework for large-scale graph analysis. Our implementations achieve substantial speedups over existing Python-based tools like NetworkX and igraph, which lack efficient parallelization, and are competitive with parallel frameworks such as NetworKit. Experimental results show that Arachne-based methods outperform these baselines, achieving speedups of up to 710x over NetworkX, 75x over igraph, and 12x over NetworKit. Additionally, we analyze the scalability of our implementation under varying thread counts, demonstrating how different phases contribute to overall performance gains of the parallel Louvain algorithm. Arachne, including our community detection implementation, is open-source and available at https://github.com/Bears-R-Us/arkouda-njit.
AB - The rise of graph data in various fields calls for efficient and scalable community detection algorithms. In this paper, we present parallel implementations of two widely used algorithms: Label Propagation and Louvain, specifically designed to leverage the capabilities of Arachne, which is a Python-accessible open-source framework for large-scale graph analysis. Our implementations achieve substantial speedups over existing Python-based tools like NetworkX and igraph, which lack efficient parallelization, and are competitive with parallel frameworks such as NetworKit. Experimental results show that Arachne-based methods outperform these baselines, achieving speedups of up to 710x over NetworkX, 75x over igraph, and 12x over NetworKit. Additionally, we analyze the scalability of our implementation under varying thread counts, demonstrating how different phases contribute to overall performance gains of the parallel Louvain algorithm. Arachne, including our community detection implementation, is open-source and available at https://github.com/Bears-R-Us/arkouda-njit.
KW - Data Science
KW - Graph Algorithms
KW - High-Performance Computing
UR - https://www.scopus.com/pages/publications/105021483772
UR - https://www.scopus.com/pages/publications/105021483772#tab=citedBy
U2 - 10.1109/HPEC67600.2025.11196647
DO - 10.1109/HPEC67600.2025.11196647
M3 - Conference contribution
AN - SCOPUS:105021483772
T3 - 2025 IEEE High Performance Extreme Computing Conference, HPEC 2025
BT - 2025 IEEE High Performance Extreme Computing Conference, HPEC 2025
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2025 IEEE High Performance Extreme Computing Conference, HPEC 2025
Y2 - 15 September 2025 through 19 September 2025
ER -