Preliminary Tasks of Word Embeddings Comparison of Unaligned Audio and Text Data for the Kazakh Language

2023

Closed access Metadata (CSL-JSON)
DOI 10.1109/wi-iat59888.2023.00072
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

In this paper, we present our preliminary work on the topological analysis of audio and text data for unsupervised speech processing for the Kazakh language. Our research is motivated by the advancements in generative models and their potential impact in this domain. We make the assumption that phoneme frequencies and contextual relationships exhibit similarity in both the acoustic and text domains for a given language. In order to delve into this hypothesis, we carried out experiments utilizing the variational autoencoder (VAE) framework at the word level. This was undertaken as an initial step for comparing word embeddings in unaligned audio and text data specific to the Kazakh language.. We trained VAE models on both acoustic and text data, with the aim of extracting the encoding part from the acoustic VAE and the decoding part from the text VAE. In the next stage of our planned research, we intend to apply persistent homology methods to analyze the topological structure of these two latent vector spaces. This analysis will provide insights into the underlying patterns and relationships between the audio and text data.