Bringing Systems Engineering Models to Large Language Models: An Integration of OPM with an LLM for Design Assistants

Ramón María García Alarcia, Pietro Russo, Alfredo Renga, Alessandro Golkar

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations

Abstract

Although showing remarkable zero-shot and few-shot capabilities across a wide variety of tasks, Large Language Models (LLMs) are still not mature enough for off-the-shelf use in engineering design tasks. Organizations implementing model-based systems engineering practices into their product development processes can leverage on ontologies, models, and procedures to enhance LLMs applied to engineering design tasks. We present a methodology to integrate an Object-Process Methodology model of a space system into an LLMbased spacecraft design assistant and show a performance improvement, as compared to a conventional LLM. The benchmark is evaluated through subjective expert-assessed and an objective cosine-similarity-based criteria. The results motivate additional efforts in integrating Model-Based Systems Engineering practice into LLMs as means to improve their performance and reduce shortcomings such as hallucinations and black-box, untraceable behavior.

Original languageEnglish
Title of host publicationProceedings of the 12th International Conference on Model-Based Software and Systems Engineering
EditorsFrancisco José Domínguez Mayo, Luís Ferreira Pires, Edwin Seidewitz
PublisherScience and Technology Publications, Lda
Pages334-345
Number of pages12
ISBN (Print)9789897586828
DOIs
StatePublished - 2024
Event12th International Conference on Model-Based Software and Systems Engineering, MODELSWARD 2024 - Rome, Italy
Duration: 21 Feb 202423 Feb 2024

Publication series

NameInternational Conference on Model-Driven Engineering and Software Development
Volume1
ISSN (Electronic)2184-4348

Conference

Conference12th International Conference on Model-Based Software and Systems Engineering, MODELSWARD 2024
Country/TerritoryItaly
CityRome
Period21/02/2423/02/24

Keywords

  • Design Assistant
  • Engineering Design
  • Large Language Models
  • Model-Based Systems Engineering
  • Object-Process Methodology
  • Systems Engineering

Fingerprint

Dive into the research topics of 'Bringing Systems Engineering Models to Large Language Models: An Integration of OPM with an LLM for Design Assistants'. Together they form a unique fingerprint.

Cite this