TY - GEN
T1 - The Pos Experiment Controller
T2 - 19th Wireless On-Demand Network Systems and Services Conference, WONS 2024
AU - Stubbe, Henning
AU - Gallenmuller, Sebastian
AU - Carle, Georg
N1 - Publisher Copyright:
© 2024 IFIP.
PY - 2024
Y1 - 2024
N2 - Network experiments are an essential tool to derive knowledge about network behavior. Yet, the experiment landscape is fractured, consisting of many specialized experiment enclaves, i.e., testbeds, with their own toolchain, limiting portability between different testbeds. Such fracturing hinders research, increasing the costs of replicating research across enclaves. This increase in cost also holds for the possible reuse of experiment parts across testbeds. Previous work introduced the pos framework and methodology, reducing the required effort for reproducible experiments. However, currently, this framework is available solely in a limited set of testbeds. In this work, we extend the proposed framework and, thus, build bridges between existing testbed islands. To showcase our approach and its feasibility, we recreate a well-known experiment on multiple testbeds and compare the results. These results indicate repeatability across testbeds. Concurrently, they highlight the flexibility gained through our approach and the need for reproducibility-aware experiment design.
AB - Network experiments are an essential tool to derive knowledge about network behavior. Yet, the experiment landscape is fractured, consisting of many specialized experiment enclaves, i.e., testbeds, with their own toolchain, limiting portability between different testbeds. Such fracturing hinders research, increasing the costs of replicating research across enclaves. This increase in cost also holds for the possible reuse of experiment parts across testbeds. Previous work introduced the pos framework and methodology, reducing the required effort for reproducible experiments. However, currently, this framework is available solely in a limited set of testbeds. In this work, we extend the proposed framework and, thus, build bridges between existing testbed islands. To showcase our approach and its feasibility, we recreate a well-known experiment on multiple testbeds and compare the results. These results indicate repeatability across testbeds. Concurrently, they highlight the flexibility gained through our approach and the need for reproducibility-aware experiment design.
KW - Network Experiment
KW - Portability
KW - Repeatability
KW - Replicability
KW - Reproducibility
KW - plain orchestrating service (pos)
UR - http://www.scopus.com/inward/record.url?scp=85187550858&partnerID=8YFLogxK
U2 - 10.23919/WONS60642.2024.10449532
DO - 10.23919/WONS60642.2024.10449532
M3 - Conference contribution
AN - SCOPUS:85187550858
T3 - 2024 19th Wireless On-Demand Network Systems and Services Conference, WONS 2024
SP - 85
EP - 92
BT - 2024 19th Wireless On-Demand Network Systems and Services Conference, WONS 2024
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 29 January 2024 through 31 January 2024
ER -