On the impact of memory allocation on high-performance query processing

Dominik Durner, Viktor Leis, Thomas Neumann

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

11 Scopus citations

Abstract

Somewhat surprisingly, the behavior of analytical query engines is crucially affected by the dynamic memory allocator used. Memory allocators highly influence performance, scalability, memory efficiency and memory fairness to other processes. In this work, we provide the first comprehensive experimental analysis on the impact of memory allocation for high-performance query engines. We test five state-of-the-art dynamic memory allocators and discuss their strengths and weaknesses within our DBMS. The right allocator can increase the performance of TPC-DS (SF 100) by 2.7x on a 4-socket Intel Xeon server.

Original languageEnglish
Title of host publication15th International Workshop on Data Management on New Hardware, DaMoN 2019
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450368018
DOIs
StatePublished - 1 Jul 2019
Event15th International Workshop on Data Management on New Hardware, DaMoN 2019, Held with ACM SIGMOD/PODS 2019 - Amsterdam, Netherlands
Duration: 1 Jul 2019 → …

Publication series

NameProceedings of the ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems

Conference

Conference15th International Workshop on Data Management on New Hardware, DaMoN 2019, Held with ACM SIGMOD/PODS 2019
Country/TerritoryNetherlands
CityAmsterdam
Period1/07/19 → …

Fingerprint

Dive into the research topics of 'On the impact of memory allocation on high-performance query processing'. Together they form a unique fingerprint.

Cite this