Comparative Analysis of the Efficiency of Synthetic Data Generation Methods in Classification and Regression Problems

2025

Closed access Metadata (CSL-JSON)
DOI 10.1109/acdsa65407.2025.11165813
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

The use of synthetic data has become an increasingly relevant approach in machine learning, especially in situations involving limited, imbalanced, or sensitive datasets. This study presents a comparative analysis of two popular data generation methods—CTGAN and TVAE—in the context of both regression and classification tasks. Building on previous work focused on regression, this research expands to include classification by evaluating the impact of synthetic data on models such as Logistic Regression, Random Forest, and XGBoost, using the PIMA Indians Diabetes dataset as a case study. The primary focus is on how the number of training epochs affects the quality of the generated data and, consequently, the performance of downstream models. Results show that synthetic data can significantly improve classification accuracy, particularly in ensemble models, but the benefits are highly dependent on the generation method and training parameters. The study confirms the practical value of synthetic data while also highlighting the need for careful tuning to avoid overfitting and performance degradation.