Morpheme-Aware Interpolated N-gram Language Modeling for Low-Resource Speech Recognition

Yerlan Karabaliyev, Kateryna V. Kolesnikova, Y. Khlevnaya

2026

Full text Open access: Gold Metadata (CSL-JSON)
DOI 10.28991/esj-2026-010-04-029
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

This paper presents KazMorphLM, a morpheme-aware language model for Kazakh automatic speech recognition (ASR). Kazakh, a highly agglutinative Turkic language, poses a fundamental challenge for conventional word-level language models, since a single root can generate hundreds of inflected forms through productive suffixation, causing extreme data sparsity. Our objective is to overcome this sparsity by modelling language at the morpheme level. The method combines three components: (1) a rule-based morpheme segmenter built on a fully categorized inventory of 118 suffix entries (175 surface forms) across 12 morphological categories, with vowel-harmony validation and consonant-assimilation rules; (2) a two-level interpolated n-gram architecture coupling a 7-gram morpheme model with a 5-gram word model under Witten-Bell smoothing; and (3) a four-channel rescoring mechanism integrating acoustic, word-level, morpheme-level and vowel-harmony scores. Integrated into a hybrid FastConformer–MMS-1B pipeline, KazMorphLM attains 6.86% word error rate (WER) on the FLEURS test set under N-best rescoring, a 15.2% relative reduction over word-level KenLM rescoring (8.09%). On a live evaluation with 44 native speakers (421 recordings), KazMorphLM significantly outperforms word-level KenLM rescoring (6.01% vs. 7.45% WER; Wilcoxon p<0.001). To our knowledge this is the first morpheme-aware, vowel-harmony-informed language model for Kazakh ASR rescoring, with a methodology transferable to other Turkic languages.