Multilingual Speech Command Recognition for Voice Controlled Robots and Smart Systems

2025

Full text Open access: Gold Metadata (CSL-JSON)
DOI 10.1109/iccar64901.2025.11073019
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

Speech Command Recognition (SCR) has many applications in smart home systems, voice-controlled robots, and voice assistants. The modern SCR systems employ deep learning models trained on speech command datasets. Nowadays, the Google Speech Commands (GSC) dataset serves as a benchmark for training and evaluating SCR models, but it only includes English commands. In this work, we introduce an equivalent of the GSC for the Kazakh, Tatar, and Russian languages. We collected the dataset via a Telegram bot in real-world settings. The dataset includes the same 35 commands as GSC and contains 3,623 utterances for Kazakh, 3,547 for Tatar, and 1,625 for Russian. We trained and evaluated both monolingual and multilingual SCR models. The experimental results show that the multilingual model outperforms the monolingual models with an accuracy of 98.57%, 99.33%, 96.86%, and 97.33% on the test sets of the Kazakh, Tatar, Russian datasets and GSC, respectively. Furthermore, we deployed the model on an NVIDIA Jetson Orin NX 16GB, achieving an average inference time of 0.008 seconds. This performance makes it suitable for real-time applications. We have made the dataset, source code, and pretrained models publicly available to encourage further research in this area.