TY - GEN
T1 - A Comprehensive Study on Benchmarking Permissioned Blockchains
AU - Chacko, Jeeta Ann
AU - Mayer, Ruben
AU - Fekete, Alan
AU - Gramoli, Vincent
AU - Jacobsen, Hans Arno
N1 - Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.
PY - 2024
Y1 - 2024
N2 - Blockchain benchmarking systems are actively discussed in the literature, focusing on increasing the number of blockchains that can be supported. However, the constant inception of new blockchains into the market and their vast implementation differences make it a massive engineering challenge. We provide a general discussion on the main aspects of benchmarking blockchains, highlighting the necessary contributions from the developers and users of blockchains and benchmarking systems. We identify problem statements across four benchmarking factors by investigating five popular permissioned blockchains. Further, we define a broad methodology to tackle these problems. We conduct a case study of five existing blockchain benchmarking systems for our evaluation and identify their limitations, clarifying the need for our methodology.
AB - Blockchain benchmarking systems are actively discussed in the literature, focusing on increasing the number of blockchains that can be supported. However, the constant inception of new blockchains into the market and their vast implementation differences make it a massive engineering challenge. We provide a general discussion on the main aspects of benchmarking blockchains, highlighting the necessary contributions from the developers and users of blockchains and benchmarking systems. We identify problem statements across four benchmarking factors by investigating five popular permissioned blockchains. Further, we define a broad methodology to tackle these problems. We conduct a case study of five existing blockchain benchmarking systems for our evaluation and identify their limitations, clarifying the need for our methodology.
KW - benchmarking systems
KW - permissioned blockchains
UR - http://www.scopus.com/inward/record.url?scp=85205374706&partnerID=8YFLogxK
U2 - 10.1007/978-3-031-68031-1_2
DO - 10.1007/978-3-031-68031-1_2
M3 - Conference contribution
AN - SCOPUS:85205374706
SN - 9783031680304
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 18
EP - 33
BT - Performance Evaluation and Benchmarking - 15th TPC Technology Conference, TPCTC 2023, Revised Selected Papers
A2 - Nambiar, Raghunath
A2 - Poess, Meikel
PB - Springer Science and Business Media Deutschland GmbH
T2 - 15th TPC Technology Conference on Performance Evaluation and Benchmarking, TPCTC 2023, held concurrently with the 49th International Conference on Very Large Data Bases, VLDB 2023
Y2 - 28 August 2023 through 1 September 2023
ER -