Development of A Model of Kazakh Sign Language Recognition Based on Deep Learning Method

2024

Closed access Metadata (CSL-JSON)
DOI 10.1109/ubmk63289.2024.10773578
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

The purpose of this study is to analyse the effectiveness of deep neural networks for the task of recognition of Kazakh sign language. The study aims to use convolutional neural networks (CNNs) to process and classify images with gestures representing 42 letters of the Kazakh sign language. The developed model can recognise hand gestures in real time using a camera. Since the full-featured hand gesture recognition system in the field of artificial intelligence is still in the active development and research stage, the developed model is a key step in this direction. The results showed poor performance of the model in the current configuration, with low accuracy and completeness values for most classes, which may indicate that the dataset is unbalanced and the chosen model architecture is suboptimal. The study highlights the importance of further investigating methods for balancing classes and adapting the model architecture to improve its accuracy and reliability. In this study, a significant step was taken in the field of data collection and training for the recognition of gesture-based Kazakh language. Data augmentation using augmentation was performed.