Refining NLP Semantic Matches Through Dialogue with Large Language Models

2025

Full text Open access: Green Metadata (CSL-JSON)
DOI 10.1109/icps65515.2025.11087870
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

Advancements in digitization are fostering innovation within Industrie 4.0 (I4.0) ecosystems. The 2030 vision for I4.0 prioritizes sovereignty, sustainability, and interoperability to transform value chains into dynamic networks. While many physical and syntactical interoperability challenges have been addressed, there are still open questions regarding semantic interoperability. Natural Language Processing (NLP)-based ranking by semantic similarity offers a straightforward approach for matching semantically heterogeneous data but often lacks informative rationale and usability, especially when relevant matches are buried deep in the rankings. In this paper, we explore how we can further improve the ranking to obtain more precise semantical matches by leveraging Large Language Model (LLM), in particular Retrieval-Augmented Generation (RAG). Since comprehensibility is crucial for the end user when selecting the matches, we employ the LLM to additionally explain the rankings and enable follow-up queries. In a series of experiments, we show that this not only improves the usability, but also ensures that users can navigate complex semantic matches effectively.