Monte Carlo-driven reinforcement learning for smart manufacturing systems

2026

Full text Open access: Gold Metadata (CSL-JSON)
DOI 10.1007/s44163-026-02302-z
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

Developing a smart control system capable of accounting for the dynamics of industrial equipment state changes and promptly detecting features of developing failures is currently a pressing issue. The goal of this study is to develop an intelligent technology for industrial equipment state diagnostics based on a modified MonteCarloDQN algorithm, with parameter tuning using the Monte Carlo Tree Search (MCTS) method and integration with the GEMMA (Guide d’étude des modes de marche et d’arrêt) model. The result of the algorithm's operation is sent to the GEMMA model “zone D”, which is responsible for fault detection and the control system’s response after a failure. This approach enables GEMMA to initiate timely transitions to a safe state while preserving the existing industrial control logic. The simulation and experiments are presented on the data obtained from the Modicon M340 programmable logic controller and the Altivar 630 frequency converter. The performance of the MonteCarloDQN algorithm is higher on 5 independent runs by the metrics Accuracy = 0.9609 ± 0.0129, Balanced Accuracy = 0.9368 ± 0.0242, Precision = 0.9617 ± 0.0117, Recall = 0.9609 ± 0.0129, F1-score = 0.9596 ± 0.0145 and G-mean = 0.9571 ± 0.0153 compared to the basic algorithms DQN, SVM, KNN and Informer Transformer.