KAZAKH SPEECH AND RECOGNITION METHODS: ERROR ANALYSIS AND IMPROVEMENT PROSPECTS

2024

Полный текст Открытый доступ: Gold Метаданные (CSL-JSON)
DOI 10.37943/20dzgh8448
Достоверность данных 70 средняя
Как считается эта оценка

Складывается из проверяемых признаков самой записи: есть ли у статьи DOI, сколько независимых источников подтвердили её данные, заполнены ли обязательные поля и насколько свежо последнее подтверждение. Снижают оценку расхождения между источниками и отсутствие идентификатора. Значение от 80 означает, что запись опубликована без дополнительной проверки; от 60 до 79 — что она опубликована с пониженной достоверностью и ручная проверка желательна. Запись, выверенную редактором вручную, пересчёт не опускает ниже 90. Это оценка наших данных о статье, а не оценка самой статьи.

Аннотация

This study offers a detailed evaluation of automatic speech recognition (ASR) systems for the Kazakh, examining their performance in recognizing the phonetic and linguistic features unique to the language. The Kazakh language presents specific challenges for ASR due to its complex phonology, vowel harmony, and the presence of multiple regional dialects. To address these challenges, a comparative analysis of three leading ASR systems were conducted—Kaldi, Mozilla DeepSpeech, and Google Speech-to-Text API—using a dataset of 101 recordings of spoken the Kazakh text. This study focuses on the systems' word error rates (WER), identifying common misrecognitions, especially with the Kazakh-specific phonemes like "қ," "ң," and "ү." Kaldi and Mozilla DeepSpeech exhibited high WERs, particularly struggling with Kazakh’s vowel harmony and consonant distinctions, while Google Speech-to-Text achieved of the lowest WER among the three. However, none of the systems demonstrated accuracy levels sufficient for practical applications, as errors in recognizing Kazakh’s agglutinative morphology and case endings remained pervasive. To improve these outcomes, a series of enhancements are proposed, including adapting acoustic models to better reflect Kazakh’s phonetic and morphological traits, integrating dialect-specific data, and employing machine learning methods such as transfer learning and hybrid models. Additional steps include refining data preprocessing and increasing dataset diversity to capture Kazakh’s linguistic nuances more accurately. By addressing these limitations, the ASR systems can better handle complex sentence structures and regional speech variations. This research thus provides a foundation for advancing Kazakh ASR technologies and contributes insights that are vital for developing inclusive, effective ASR systems capable of supporting linguistically diverse users.