SciMDIX: A dataset for aspect extraction from multi-domain scientific documents in Kazakh and Russian

2026

Full text Open access: Gold Metadata (CSL-JSON)
DOI 10.1016/j.procs.2026.01.056
Data confidence 85 high
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

The objective of aspect extraction is to identify the key informational elements in a text. Although aspect-based sentiment analysis (ABSA) has extensively explored this field, aspect extraction in scientific texts remains an area that has been underexplored. The present paper introduces a new multi-domain corpus of Russian and Kazakh scientific texts, annotated for aspect-based information extraction. This dataset is an expansion of existing resources for named entity recognition and relation extraction. It facilitates research in cross-lingual transfer and establishes initial benchmarks for aspect extraction in low-resource linguistic contexts. The presented corpus includes 412 abstracts in Russian and Kazakh, annotated with 2,129 and 2,027 aspects respectively across seven categories: The following elements are to be considered: AIM, METHOD, MATERIAL, TASK, TOOL, RESULT, and USAGE. The present study analyses the distribution of aspects across four scientific domains (IT, linguistics, medicine, and psychology) and conducts experiments using multiple methodological classes, including classical deep learning, contextual Transformer encoder (mBERT), and a new multilingual XLM-RoBERTa + CRF architecture. The experimental results demonstrate the efficacy of multilingual models in performing zero-shot aspect extraction between Russian and Kazakh, even in low-resource conditions. Future research will focus on the optimisation of tokenisation and the exploration of semi-supervised approaches to further enhance model performance. The resulting models and dataset are available at https://github.com/nikitashvarts/scimdix_aspect_extraction and can support downstream applications such as automatic metadata generation, construction of scientific knowledge graphs, and domain-specific information retrieval.