On Scenario-Based Testing of Cyber-Physical Systems

Alexander Pretschner; Florian Hauer; Tabea Schmidt

doi:10.1007/978-3-031-40132-9_5

On Scenario-Based Testing of Cyber-Physical Systems

Alexander Pretschner, Florian Hauer, Tabea Schmidt

Informatics 4 - Chair of Software und Systems Engineering

Technical University of Munich

Research output: Chapter in Book/Report/Conference proceeding › Chapter › peer-review

Abstract

We present several results on scenario-based testing, an equivalence class testing method typically applied to cyber-physical systems. We show that randomly sampling as well as re-using tests in general is problematic and that instead, new tests need to be generated for each new version of the systems. We discuss empirical results on the power of heuristic search and show that different algorithms lead to largely different results—with some generated test suites finding safety-critical behavior and some failing to do so. Finally, we present different dimensions of and criteria for completeness of scenario-based test suites.

Original language	English
Title of host publication	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Publisher	Springer Science and Business Media Deutschland GmbH
Pages	68-82
Number of pages	15
DOIs	https://doi.org/10.1007/978-3-031-40132-9_5
State	Published - 2023

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	14165 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Access to Document

10.1007/978-3-031-40132-9_5

Cite this

Pretschner, A., Hauer, F., & Schmidt, T. (2023). On Scenario-Based Testing of Cyber-Physical Systems. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (pp. 68-82). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 14165 LNCS). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-031-40132-9_5

Pretschner, Alexander ; Hauer, Florian ; Schmidt, Tabea. / On Scenario-Based Testing of Cyber-Physical Systems. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Springer Science and Business Media Deutschland GmbH, 2023. pp. 68-82 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inbook{f588713f791c46d58d697382429af356,

title = "On Scenario-Based Testing of Cyber-Physical Systems",

abstract = "We present several results on scenario-based testing, an equivalence class testing method typically applied to cyber-physical systems. We show that randomly sampling as well as re-using tests in general is problematic and that instead, new tests need to be generated for each new version of the systems. We discuss empirical results on the power of heuristic search and show that different algorithms lead to largely different results—with some generated test suites finding safety-critical behavior and some failing to do so. Finally, we present different dimensions of and criteria for completeness of scenario-based test suites.",

author = "Alexander Pretschner and Florian Hauer and Tabea Schmidt",

note = "Publisher Copyright: {\textcopyright} 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.",

year = "2023",

doi = "10.1007/978-3-031-40132-9_5",

language = "English",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "68--82",

booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

}

Pretschner, A, Hauer, F & Schmidt, T 2023, On Scenario-Based Testing of Cyber-Physical Systems. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 14165 LNCS, Springer Science and Business Media Deutschland GmbH, pp. 68-82. https://doi.org/10.1007/978-3-031-40132-9_5

On Scenario-Based Testing of Cyber-Physical Systems. / Pretschner, Alexander; Hauer, Florian; Schmidt, Tabea.
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Springer Science and Business Media Deutschland GmbH, 2023. p. 68-82 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 14165 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Chapter › peer-review

TY - CHAP

T1 - On Scenario-Based Testing of Cyber-Physical Systems

AU - Pretschner, Alexander

AU - Hauer, Florian

AU - Schmidt, Tabea

PY - 2023

Y1 - 2023

N2 - We present several results on scenario-based testing, an equivalence class testing method typically applied to cyber-physical systems. We show that randomly sampling as well as re-using tests in general is problematic and that instead, new tests need to be generated for each new version of the systems. We discuss empirical results on the power of heuristic search and show that different algorithms lead to largely different results—with some generated test suites finding safety-critical behavior and some failing to do so. Finally, we present different dimensions of and criteria for completeness of scenario-based test suites.

AB - We present several results on scenario-based testing, an equivalence class testing method typically applied to cyber-physical systems. We show that randomly sampling as well as re-using tests in general is problematic and that instead, new tests need to be generated for each new version of the systems. We discuss empirical results on the power of heuristic search and show that different algorithms lead to largely different results—with some generated test suites finding safety-critical behavior and some failing to do so. Finally, we present different dimensions of and criteria for completeness of scenario-based test suites.

UR - http://www.scopus.com/inward/record.url?scp=85169073798&partnerID=8YFLogxK

U2 - 10.1007/978-3-031-40132-9_5

DO - 10.1007/978-3-031-40132-9_5

M3 - Chapter

AN - SCOPUS:85169073798

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 68

EP - 82

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

PB - Springer Science and Business Media Deutschland GmbH

ER -

Pretschner A, Hauer F, Schmidt T. On Scenario-Based Testing of Cyber-Physical Systems. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Springer Science and Business Media Deutschland GmbH. 2023. p. 68-82. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-031-40132-9_5

On Scenario-Based Testing of Cyber-Physical Systems

Abstract

Publication series

Access to Document

Other files and links

Fingerprint

Cite this