Improving Kazakh Text Complexity Detection with Pre-Trained Language Models

2025

Closed access Metadata (CSL-JSON)
DOI 10.1109/opcs67346.2025.11219383
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

Sentence complexity detection plays a crucial role in applications such as readability assessment and text simplification, yet remains under-explored for Kazakh. This paper addresses this task for the Kazakh by systematically comparing three approaches: 1) classical machine learning with hand-crafted linguistic features, 2) embedding-based classifiers, and 3) finetuning of a multilingual large language model (LLM). On a balanced parallel dataset of complex-simple literary sentence pairs, feature-based methods using five features achieved up to$69.69 \% ~\mathrm{F} 1$(SVM), while incorporating all features raised F1 to$\mathbf{7 7. 7 4 \%}$(Logistic Regression). Without any hand-crafted feature, the embedding-based classifier reached$\mathbf{7 3. 8 5 \%} \mathbf{F 1}$. By contrast, updating the full LLM produced 87.38 % accuracy and an 87.02 % macro F1-score, markedly outperforming both classical and embedding-based baselines; freezing its backbone yielded only$\mathbf{5 4. 3 5 \%}$accuracy. To analyze the complexity of authentic Kazakh texts, we applied each model to large, unlabelled corpora of children's stories, news articles and books. The fine-tuned LLM predicted 89.1 % simple sentences in children's stories, 83.7 % in news and 75.5 % in books, and correspondingly higher complexsentence rates in books (24.5 %).