TY - GEN
T1 - Automatic extraction of probabilistic workload specifications for load testing session-based application systems
AU - Van Hoorn, André
AU - Vögele, Christian
AU - Schulz, Eike
AU - Hasselbring, Wilhelm
AU - Krcmar, Helmut
N1 - Publisher Copyright:
© Copyright 2015 ICST.
PY - 2014
Y1 - 2014
N2 - Workload generation is essential to systematically evaluate performance properties of application systems under controlled conditions, e.g., in load tests or benchmarks. The definition of workload specifications that represent the real workload as accurately as possible is one of the biggest challenges in this area. This paper presents our approach for the modeling and automatic extraction of probabilistic workload specifications for load testing session-based application systems. The approach, called Wessbas, comprises (i.) a domain-specific language (DSL) enabling layered modeling of workload specifications as well as support for (ii.) automatically extracting instances of the DSL from recorded sessions logs and (iii.) transforming instances of the DSL to workload specifications of existing load testing tools. During the extraction process, different groups of customers with similar navigational patterns are identified using clustering techniques. We developed corresponding tool support including a transformation to probabilistic test scripts for the Apache JMeter load testing tool. The evaluation of the proposed approach using the industry standard benchmark SPECjEnterprise2010 demonstrates its applicability and the representativeness of the extracted workloads.
AB - Workload generation is essential to systematically evaluate performance properties of application systems under controlled conditions, e.g., in load tests or benchmarks. The definition of workload specifications that represent the real workload as accurately as possible is one of the biggest challenges in this area. This paper presents our approach for the modeling and automatic extraction of probabilistic workload specifications for load testing session-based application systems. The approach, called Wessbas, comprises (i.) a domain-specific language (DSL) enabling layered modeling of workload specifications as well as support for (ii.) automatically extracting instances of the DSL from recorded sessions logs and (iii.) transforming instances of the DSL to workload specifications of existing load testing tools. During the extraction process, different groups of customers with similar navigational patterns are identified using clustering techniques. We developed corresponding tool support including a transformation to probabilistic test scripts for the Apache JMeter load testing tool. The evaluation of the proposed approach using the industry standard benchmark SPECjEnterprise2010 demonstrates its applicability and the representativeness of the extracted workloads.
KW - Clustering
KW - Load test extraction
KW - Load testing
KW - Session-based application systems
KW - Workload specifications
UR - http://www.scopus.com/inward/record.url?scp=84962273190&partnerID=8YFLogxK
U2 - 10.4108/icst.valuetools.2014.258171
DO - 10.4108/icst.valuetools.2014.258171
M3 - Conference contribution
AN - SCOPUS:84962273190
T3 - Proceedings of the 8th International Conference on Performance Evaluation Methodologies and Tools, VALUETOOLS 2014
SP - 139
EP - 146
BT - Proceedings of the 8th International Conference on Performance Evaluation Methodologies and Tools, VALUETOOLS 2014
PB - ICST
T2 - 8th International Conference on Performance Evaluation Methodologies and Tools, VALUETOOLS 2014
Y2 - 9 December 2014 through 11 December 2014
ER -