Adaptive Compression For Databases

Leon Windheuser, Christoph Anneser, Huanchen Zhang, Thomas Neumann, Alfons Kemper

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Efficient utilization of dynamic random access memory (DRAM) is crucial for achieving high-performance query processing in database systems, especially as data volumes continue to grow. Unfortunately, the cost of DRAM is unlikely to decrease in the coming years, and it is already the dominating cost factor in modern data centers. Consequently, lightweight in-memory compression techniques can reduce the memory footprint and maximize the data stored in memory. However, compressing all data, regardless of the compression algorithm’s efficiency, causes additional CPU overhead during query execution. To address this challenge, we introduce AdaCom, a novel framework that selectively applies lightweight succinct encodings only to infrequently accessed data. By doing so, we mitigate the performance overhead associated with compression. In our experimental evaluation, we demonstrate that AdaCom reduces the memory footprint by up to 40% while retaining most of the performance (≈ 95%).

Original languageEnglish
Title of host publicationAdvances in Database Technology - EDBT
PublisherOpenProceedings.org
Pages143-149
Number of pages7
Edition2
ISBN (Electronic)9783893180912, 9783893180943, 9783893180950
DOIs
StatePublished - 22 Nov 2023
Event27th International Conference on Extending Database Technology, EDBT 2024 - Paestum, Italy
Duration: 25 Mar 202428 Mar 2024

Publication series

NameAdvances in Database Technology - EDBT
Number2
Volume27
ISSN (Electronic)2367-2005

Conference

Conference27th International Conference on Extending Database Technology, EDBT 2024
Country/TerritoryItaly
CityPaestum
Period25/03/2428/03/24

Fingerprint

Dive into the research topics of 'Adaptive Compression For Databases'. Together they form a unique fingerprint.

Cite this