TY - GEN
T1 - Consistent Resource Utilization for Cross-Platform and Replicable Load-Testing
T2 - 24th International Conference on Model-Driven Engineering Languages and Systems, MODELS-C 2021
AU - McCarthy, Harry
AU - Podolskiy, Vladimir
AU - Gerndt, Michael
AU - Patros, Panos
N1 - Publisher Copyright:
© 2021 IEEE.
PY - 2021
Y1 - 2021
N2 - This position paper discusses assuring the comparability of benchmarking results across hardware platforms by introducing resource utilization as a universal equivalent. By sustaining resource utilization at a constant level while conducting a benchmark, comparing results becomes fair. This idea is prototyped in Procrustes, a library aiming to assure the desired level of resource utilization by autonomically adjusting the configuration of a benchmark at runtime. Procrustes implements PID- and LQR-based feedback control to ensure the target resource utilization. We showcase Procrustes to regulate the GUI GC benchmark deployed on a bare metal platform and a VM.
AB - This position paper discusses assuring the comparability of benchmarking results across hardware platforms by introducing resource utilization as a universal equivalent. By sustaining resource utilization at a constant level while conducting a benchmark, comparing results becomes fair. This idea is prototyped in Procrustes, a library aiming to assure the desired level of resource utilization by autonomically adjusting the configuration of a benchmark at runtime. Procrustes implements PID- and LQR-based feedback control to ensure the target resource utilization. We showcase Procrustes to regulate the GUI GC benchmark deployed on a bare metal platform and a VM.
KW - resource control
KW - resource management
KW - self-adaptive benchmarking
KW - software performance engineering
UR - http://www.scopus.com/inward/record.url?scp=85124033984&partnerID=8YFLogxK
U2 - 10.1109/MODELS-C53483.2021.00035
DO - 10.1109/MODELS-C53483.2021.00035
M3 - Conference contribution
AN - SCOPUS:85124033984
T3 - Companion Proceedings - 24th International Conference on Model-Driven Engineering Languages and Systems, MODELS-C 2021
SP - 203
EP - 209
BT - Companion Proceedings - 24th International Conference on Model-Driven Engineering Languages and Systems, MODELS-C 2021
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 10 October 2021 through 15 October 2021
ER -