MULTIMODAL CLASSIFICATION OF SKIN NEOPLASMS BY USING DEEP LEARNING

2025

Full text Open access: Hybrid Metadata (CSL-JSON)
DOI 10.51885/3134-8025_jics_2026_1_7
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

The article discusses modern machine learning methods which are applicable to the task of automated classification of skin diseases based on dermoscopic images. Special attention is paid to convolutional neural network architectures and the use of transferlearning with pre-trained models. The publicly available HAM10000 dataset, which includes images of seven types of skin lesions as well as clinical metadata on patients (gender, age, and location), was used as the experimental basis.Several models were implemented and tested during the study. A basic convolutional neural network (CNN) trained from scratch showed limited results, achieving an accuracy of around 39%. The improved CNN model with class balancing provided higher accuracy (73%), but still had limitations when classifying rare and visually similar categories. The MobileNetV2 model, which uses transfer learning and clinical metadata integration, demonstrated the best performance. A test accuracy of 81% was achieved, while recall for melanoma increased from 0.38 in the baseline CNN to 0.60, significantly reducing the likelihood of missing the most dangerous disease.The Grad-CAM method was used to interpret the decisions, allowing us to visualize the model's areas of attention and identify the causes of errors. The results obtained confirm the promise of deep learning in decision support tasks in dermatology and highlight the need for further clinical validation and expansion of the database.