Development of a Translator for Kazakh Sign Language to Speech Using Gesture Recognition

2025

Closed access Metadata (CSL-JSON)
DOI 10.1109/sist61657.2025.11139238
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

This paper presents the development of "DauysYm," an AI-powered translator that converts Kazakh Sign Language (KSL) into spoken language using dynamic gesture recognition. The project addresses communication barriers faced by people with hearing impairments in Kazakhstan. The main objective of this research is to develop an inclusive technological solution that enables real-time translation of KSL into speech to support the social integration of hearing-impaired individuals. The system integrates convolutional neural networks (CNNs), recurrent neural networks (RNNs), and attention mechanisms to analyze gesture sequences with high accuracy. Data was collected using OpenCV and MediaPipe, resulting in a structured dataset of dynamic gestures. A survey with 140 respondents confirmed the high societal need and user readiness for such a system. The results show promising training and validation performance, demonstrating the effectiveness of the proposed approach. "DauysYm" offers a scalable, inclusive solution that enhances communication and supports social integration, showcasing the potential of AI technologies in assistive applications tailored for the Kazakh context.