Utilizing Process Models in the Requirements Engineering Process Through Model2Text Transformation

Nataliia Klievtsova, Juergen Mangler, Timotheus Kampik, Stefanie Rinderle-Ma

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

With the advent of large language models (LLMs), requirements engineers have gained a powerful natural language processing tool to analyze, query, and validate a wide variety of textual artifacts, thus potentially supporting the whole re-quirements engineering process from requirements elicitation to management. However, the input for the requirements engineering process often encompasses a variety of potential information sources in various formats, especially graphical models such as process models. Hence, this work aims to contribute to the state of the art by assessing the feasibility of utilizing graphical process models and their textual representations in the requirements engineering process. In particular, we focus on the extraction of textual process descriptions from process models as i) input for the requirements engineering process and ii) documentation as the result of process-oriented requirements engineering. To this end, we explore, quantify, and compare traditional deterministic and LLM-based extraction methods where the latter includes GPT3, GPT3.5, GPT4, and LLAMA. The evaluation assesses output quality and information loss based on one data set. The results indicate that LLMs produce human-like process descriptions based on the predefined patterns, but apparently lack true comprehension of the process models.

Original languageEnglish
Title of host publicationProceedings - 32nd IEEE International Requirements Engineering Conference, RE 2024
EditorsGrischa Liebel, Irit Hadar, Paola Spoletini
PublisherIEEE Computer Society
Pages205-217
Number of pages13
ISBN (Electronic)9798350395112
DOIs
StatePublished - 2024
Event32nd IEEE International Requirements Engineering Conference, RE 2024 - Reykjavik, Iceland
Duration: 24 Jun 202428 Jun 2024

Publication series

NameProceedings of the IEEE International Conference on Requirements Engineering
ISSN (Print)1090-705X
ISSN (Electronic)2332-6441

Conference

Conference32nd IEEE International Requirements Engineering Conference, RE 2024
Country/TerritoryIceland
CityReykjavik
Period24/06/2428/06/24

Keywords

  • AI4RE
  • Large Language Models
  • Process Descriptions
  • Process Models

Fingerprint

Dive into the research topics of 'Utilizing Process Models in the Requirements Engineering Process Through Model2Text Transformation'. Together they form a unique fingerprint.

Cite this