Cloud-Based Service for Recognizing Pigmented Skin Lesions Using a Multimodal Neural Network System

Skin cancer is the most common cancer in humans today and is usually caused by exposure to ultraviolet radiation. There are many diagnostic methods for visual analysis of pigmented neoplasms. However, most of these methods are subjective and largely dependent on the experience of the clinician. To minimize the influence of the human factor, it is proposed to introduce artificial intelligence technologies that have made it possible to reach new heights in terms of the accuracy of classifying medical data, including in the field of dermatology. Artificial intelligence technologies can equal and even surpass the capabilities of an dermatologists in terms of the accuracy of visual diagnostics. The article proposes a web application based on a multimodal neural network system for recognizing pigmented skin lesions as an additional auxiliary tool for oncologist. The system combines and analyzes heterogeneous dermatological data, which are images of pigmented neoplasms and such statistical information about the patient as age, gender, and localization of pigmented skin lesions. The recognition accuracy of the proposed web application was 85.65%. The use of the proposed web application as an auxiliary diagnostic method will expand the possibilities of early detection of skin cancer and minimize the impact of the human factor.