On Scenario-Based Testing of Cyber-Physical Systems

Alexander Pretschner; Florian Hauer; Tabea Schmidt

doi:10.1007/978-3-031-40132-9_5

On Scenario-Based Testing of Cyber-Physical Systems

Alexander Pretschner, Florian Hauer, Tabea Schmidt

Informatik 4 - Lehrstuhl für Software und Systems Engineering

Technische Universität München

Publikation: Beitrag in Buch/Bericht/Konferenzband › Kapitel › Begutachtung

Abstract

We present several results on scenario-based testing, an equivalence class testing method typically applied to cyber-physical systems. We show that randomly sampling as well as re-using tests in general is problematic and that instead, new tests need to be generated for each new version of the systems. We discuss empirical results on the power of heuristic search and show that different algorithms lead to largely different results—with some generated test suites finding safety-critical behavior and some failing to do so. Finally, we present different dimensions of and criteria for completeness of scenario-based test suites.

Originalsprache	Englisch
Titel	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Herausgeber (Verlag)	Springer Science and Business Media Deutschland GmbH
Seiten	68-82
Seitenumfang	15
DOIs	https://doi.org/10.1007/978-3-031-40132-9_5
Publikationsstatus	Veröffentlicht - 2023

Publikationsreihe

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Band	14165 LNCS
ISSN (Print)	0302-9743
ISSN (elektronisch)	1611-3349

Zugriff auf Dokument

10.1007/978-3-031-40132-9_5

Andere Dateien und Links

Verknüpfung zur Publikation in Scopus

Dieses zitieren

Pretschner, A., Hauer, F., & Schmidt, T. (2023). On Scenario-Based Testing of Cyber-Physical Systems. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (S. 68-82). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Band 14165 LNCS). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-031-40132-9_5

Pretschner, Alexander ; Hauer, Florian ; Schmidt, Tabea. / On Scenario-Based Testing of Cyber-Physical Systems. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Springer Science and Business Media Deutschland GmbH, 2023. S. 68-82 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inbook{f588713f791c46d58d697382429af356,

title = "On Scenario-Based Testing of Cyber-Physical Systems",

abstract = "We present several results on scenario-based testing, an equivalence class testing method typically applied to cyber-physical systems. We show that randomly sampling as well as re-using tests in general is problematic and that instead, new tests need to be generated for each new version of the systems. We discuss empirical results on the power of heuristic search and show that different algorithms lead to largely different results—with some generated test suites finding safety-critical behavior and some failing to do so. Finally, we present different dimensions of and criteria for completeness of scenario-based test suites.",

author = "Alexander Pretschner and Florian Hauer and Tabea Schmidt",

note = "Publisher Copyright: {\textcopyright} 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.",

year = "2023",

doi = "10.1007/978-3-031-40132-9_5",

language = "English",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "68--82",

booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

}

Pretschner, A, Hauer, F & Schmidt, T 2023, On Scenario-Based Testing of Cyber-Physical Systems. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Bd. 14165 LNCS, Springer Science and Business Media Deutschland GmbH, S. 68-82. https://doi.org/10.1007/978-3-031-40132-9_5

On Scenario-Based Testing of Cyber-Physical Systems. / Pretschner, Alexander; Hauer, Florian; Schmidt, Tabea.
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Springer Science and Business Media Deutschland GmbH, 2023. S. 68-82 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Band 14165 LNCS).

Publikation: Beitrag in Buch/Bericht/Konferenzband › Kapitel › Begutachtung

TY - CHAP

T1 - On Scenario-Based Testing of Cyber-Physical Systems

AU - Pretschner, Alexander

AU - Hauer, Florian

AU - Schmidt, Tabea

PY - 2023

Y1 - 2023

N2 - We present several results on scenario-based testing, an equivalence class testing method typically applied to cyber-physical systems. We show that randomly sampling as well as re-using tests in general is problematic and that instead, new tests need to be generated for each new version of the systems. We discuss empirical results on the power of heuristic search and show that different algorithms lead to largely different results—with some generated test suites finding safety-critical behavior and some failing to do so. Finally, we present different dimensions of and criteria for completeness of scenario-based test suites.

AB - We present several results on scenario-based testing, an equivalence class testing method typically applied to cyber-physical systems. We show that randomly sampling as well as re-using tests in general is problematic and that instead, new tests need to be generated for each new version of the systems. We discuss empirical results on the power of heuristic search and show that different algorithms lead to largely different results—with some generated test suites finding safety-critical behavior and some failing to do so. Finally, we present different dimensions of and criteria for completeness of scenario-based test suites.

UR - http://www.scopus.com/inward/record.url?scp=85169073798&partnerID=8YFLogxK

U2 - 10.1007/978-3-031-40132-9_5

DO - 10.1007/978-3-031-40132-9_5

M3 - Chapter

AN - SCOPUS:85169073798

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 68

EP - 82

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

PB - Springer Science and Business Media Deutschland GmbH

ER -