Parallel array-Based single- and multi-Source breadth first searches on large dense graphs

Moritz Kaufmann, Manuel Then, Alfons Kemper, Thomas Neumann

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

7 Scopus citations

Abstract

One of the fundamental algorithms in analytical graph databases is breadth-first search (BFS). It is the basis of reach-ability queries, centrality computations, neighborhood enumeration, and many other commonly-used algorithms. We take the idea of purely array-based BFSs introduced in the sequential multi-source MS-BFS algorithm and extend this approach to multi-threaded single- and multi-source BFSs. Replacing the typically used queues with fixed-sized arrays, we eliminate major points of contention which other BFS algorithms experience. To ensure equal work distribution between threads, we co-optimize work stealing parallelization with a novel vertex labeling. Our BFS algorithms have excellent scaling behavior and take advantage of multi-core NUMA architectures. We evaluate our proposed algorithms using real-world and synthetic graphs with up to 68 billion edges. Our evaluation shows that the proposed multi-threaded single- and multi-source algorithms scale well and provide significantly better performance than other state-of-the-art BFS algorithms.

Original languageEnglish
Title of host publicationAdvances in Database Technology - EDBT 2017
Subtitle of host publication20th International Conference on Extending Database Technology, Proceedings
EditorsBernhard Mitschang, Volker Markl, Sebastian Bress, Periklis Andritsos, Kai-Uwe Sattler, Salvatore Orlando
PublisherOpenProceedings.org
Pages1-12
Number of pages12
ISBN (Electronic)9783893180738
DOIs
StatePublished - 2017
Event20th International Conference on Extending Database Technology, EDBT 2017 - Venice, Italy
Duration: 21 Mar 201724 Mar 2017

Publication series

NameAdvances in Database Technology - EDBT
Volume2017-March
ISSN (Electronic)2367-2005

Conference

Conference20th International Conference on Extending Database Technology, EDBT 2017
Country/TerritoryItaly
CityVenice
Period21/03/1724/03/17

Fingerprint

Dive into the research topics of 'Parallel array-Based single- and multi-Source breadth first searches on large dense graphs'. Together they form a unique fingerprint.

Cite this