Unsupervised Term Extraction in Highly Technical Domains: Models and Datasets for Low-Resource Kazakh and English Languages

2025

Closed access Metadata (CSL-JSON)
DOI 10.1145/3773274.3774668
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

The paper presents a framework for bilingual terminology extraction targeting highly technical domains and the low-resource Kazakh language. We develop two unsupervised term annotators and introduce a hybrid Semantic NMF model that combines non-negative matrix factorization with multilingual embeddings (LaBSE, E5-base, BGE-M3). We further release Matcha, a BIO-annotated English and Kazakh corpus (~3k terms) to fine-tune supervised extractors (BERT-BiLSTM-CRF, XLM-RoBERTa). Across ACTER and ACL RD-TEC 2.0 benchmarks and the new Matcha corpus, UA2 attains up to 51.8% F1, approaching supervised performance; supervised models reach about 70% F1 in Materials Science. The results highlight strong cross-lingual/cross-domain transfer for Semantic-NMF-based unsupervised methods and demonstrate a scalable path to terminology mining and downstream knowledge graph construction in under-represented languages.