Revisiting Semantic NMF with Large-Scale Multilingual Embeddings for Domain Terminology Extraction

2025

Closed access Metadata (CSL-JSON)
DOI 10.1109/mosicom67153.2025.11398294
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

Semantic non-negative matrix factorization (Semantic NMF) is an unsupervised method for automatic term extraction that jointly factorizes a document-candidate matrix and a candidate-seed similarity matrix, thereby incorporating semantic relations between candidate terms and representative domain “seed” terms. This guidance steers the factorization toward terminology-relevant dimensions. The first application of this approach to term extraction relied on static word2vec embeddings, which limited effectiveness because such representations assign a single, context-independent vector to each word, cannot represent new terminology, and exhibit geometric deficiencies that reduce discriminative power. In this study, we evaluate Semantic NMF on the ACTER benchmark using five modern, large-scale multilingual embedding models. Results show that higher-quality embeddings enable Semantic NMF to consistently outperform a standard NMF baseline across all ACTER languages and domains, with a best-case$\mathbf{F 1}$score rising from 30.3% to 53.6%. Thus, these results establish Semantic NMF with modern multilingual embeddings as a robust, interpretable, cross-lingual solution for automatic term extraction.