Evaluating the impact of AI-generated synthetic noisy data on human emotion recognition models

2025

Full text Open access: Gold Metadata (CSL-JSON)
DOI 10.55214/25768484.v9i3.5713
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

Human emotion recognition remains a challenging task due to the complexity and variability of human emotions in real-world scenarios. This study investigates the impact of AI-generated synthetic data on enhancing Facial Expression Recognition (FER) model performance. Using the Juggernaut XL model, we generated 300 synthetic images per emotion category from the FER2013 dataset and incorporated them into the training process of a VGG-19-based FER model. Experimental results revealed that the synthetic data did not improve key performance metrics, with the originally trained model achieving an accuracy of 65%, compared to 63% for the augmented dataset. Precision, recall, and F1-score also exhibited fluctuations across different emotion categories, as illustrated by confusion matrices. The findings suggest that the quality of synthetic images plays a crucial role in model effectiveness, as insufficient diversity may introduce noise rather than beneficial augmentation. Factors such as limited training epochs and potential dataset biases may have also influenced the outcomes. This study highlights the importance of optimizing synthetic image realism to improve FER models and offers practical insights for future AI-driven applications using data augmentation.