TY - GEN
T1 - Comparison of Different Natural Language Processing Models to Achieve Semantic Interoperability of Heterogeneous Asset Administration Shells
AU - Beermann, Jo
AU - Benfer, Rebekka
AU - Both, Maximilian
AU - Muller, Jochen
AU - Diedrich, Christian
N1 - Publisher Copyright:
© 2023 IEEE.
PY - 2023
Y1 - 2023
N2 - Self-organizing systems represent the next level of building automation and make it possible to reduce the manual engineering effort of automation systems. For self-organizing systems to be able to interact interoperable, the system components must be mapped by uniform digital twins and described in a semantically interoperable manner. Semantic interoperability is implemented in the current research approach of Industrie 4.0 through homogeneous semantics. However, given the large number of different manufacturers of technical components, agreement on uniform semantics seems unlikely. This paper presents a method that extends the Industrie 4.0 approach to heterogeneous semantics. Semantic interoperability is realized through the automated mapping of heterogeneous vocabularies to target semantics. Models from the artificial intelligence sub-field natural language processing are used for automated mapping. In this paper, existing models of natural language processing are compared with each other in terms of their mapping accuracy. A dataset based on the ECLASS standard is being developed as a basis for the comparison. This dataset is also being used to create new models that are fine-tuned to the target vocabulary. The results show that the mapping accuracy of existing approaches improves through fine-tuning by an average of 7.5% up to 93%. In addition to the improvement through fine-tuning, this work analyses the influence of the model size on the mapping accuracy by using large language models. Moreover, it examines the integration of structured knowledge in the form of knowledge graphs.
AB - Self-organizing systems represent the next level of building automation and make it possible to reduce the manual engineering effort of automation systems. For self-organizing systems to be able to interact interoperable, the system components must be mapped by uniform digital twins and described in a semantically interoperable manner. Semantic interoperability is implemented in the current research approach of Industrie 4.0 through homogeneous semantics. However, given the large number of different manufacturers of technical components, agreement on uniform semantics seems unlikely. This paper presents a method that extends the Industrie 4.0 approach to heterogeneous semantics. Semantic interoperability is realized through the automated mapping of heterogeneous vocabularies to target semantics. Models from the artificial intelligence sub-field natural language processing are used for automated mapping. In this paper, existing models of natural language processing are compared with each other in terms of their mapping accuracy. A dataset based on the ECLASS standard is being developed as a basis for the comparison. This dataset is also being used to create new models that are fine-tuned to the target vocabulary. The results show that the mapping accuracy of existing approaches improves through fine-tuning by an average of 7.5% up to 93%. In addition to the improvement through fine-tuning, this work analyses the influence of the model size on the mapping accuracy by using large language models. Moreover, it examines the integration of structured knowledge in the form of knowledge graphs.
KW - Industrie 4.0
KW - natural language processing
KW - semantic interoperability
UR - http://www.scopus.com/inward/record.url?scp=85171186651&partnerID=8YFLogxK
U2 - 10.1109/INDIN51400.2023.10218154
DO - 10.1109/INDIN51400.2023.10218154
M3 - Conference contribution
AN - SCOPUS:85171186651
T3 - IEEE International Conference on Industrial Informatics (INDIN)
BT - 2023 IEEE 21st International Conference on Industrial Informatics, INDIN 2023
A2 - Dorksen, Helene
A2 - Scanzio, Stefano
A2 - Jasperneite, Jurgen
A2 - Wisniewski, Lukasz
A2 - Man, Kim Fung
A2 - Sauter, Thilo
A2 - Seno, Lucia
A2 - Trsek, Henning
A2 - Vyatkin, Valeriy
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 21st IEEE International Conference on Industrial Informatics, INDIN 2023
Y2 - 17 July 2023 through 20 July 2023
ER -