Possibilities of using artificial intelligence technology in deaf education

2024

Полный текст Открытый доступ: Gold Метаданные (CSL-JSON)
DOI 10.26577/jes2024v81.i4.11
Достоверность данных 70 средняя
Как считается эта оценка

Складывается из проверяемых признаков самой записи: есть ли у статьи DOI, сколько независимых источников подтвердили её данные, заполнены ли обязательные поля и насколько свежо последнее подтверждение. Снижают оценку расхождения между источниками и отсутствие идентификатора. Значение от 80 означает, что запись опубликована без дополнительной проверки; от 60 до 79 — что она опубликована с пониженной достоверностью и ручная проверка желательна. Запись, выверенную редактором вручную, пересчёт не опускает ниже 90. Это оценка наших данных о статье, а не оценка самой статьи.

Аннотация

The fast progress of artificial intelligence (AI) technologies is changing fields like education and healthcare greatly. One promising area for AI is deaf education. A sector that supports education for people with hearing impairments. Traditionally, deaf education has used methods and tools to aid learning and communication, for those who are deaf or hard of hearing. Nevertheless the inclusion of AI in this area presents possibilities to boost educational results and enhance the well being of individuals, with hearing challenges. Programming of such projects such as sign language recognition improves communication accessibility. However, in addition to the technical aspects, it is important to consider the cultural and social contexts in which sign language is used. The concept of research work for sign language translation is learning and using Python: for Gesture Character Recognition analysis of computer vision and machine learning methods, as well as the development of Python software for image processing for recognition purposes. The development of algorithms based on approaches to deep learning and machine learning of gestures helped to create a system capable of recognizing and translating a language. The main four steps that the project includes: 1) using computer vision, the silhouette of the hand is determined; 2) a letter is indicated with a hand gesture in front of the camera; 3) the definition of the sign using machine learning; 4) the result is displayed on the screen. The developed system allows you to determine the letters to a high degree and display the result on the screen. These results show that machine learning and computer vision have advantages and relevance in society. Key words: sign language, python (programming language), computer vision, machine learning.