Reinforcement Learning-Based PID for Nonlinear Temperature Control with Delayed Feedback and Measurement Noise

2025

Full text Open access: Gold Metadata (CSL-JSON)
DOI 10.22541/au.176586691.15346466/v1
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

Temperature control systems in practice are often affected by nonlinear dynamics, delayed feedback, and measurement noise, which makes reliable controller tuning challenging. This study examines how different PID tuning strategies perform under such realistic conditions, considering both classical PID and nonlinear PID controller structures. Traditional tuning approaches are compared with optimization-based and reinforcement learning--based methods within a unified simulation framework, allowing a fair assessment of their robustness and efficiency. In addition to standard tracking and transient performance measures, control effort is included as an energy-related indicator to reflect practical operating concerns. The results show that classical and evolutionary tuning methods remain effective when disturbances are moderate, while reinforcement learning--based tuning provides superior robustness in highly nonlinear and noisy scenarios, albeit at the cost of increased control effort. These findings offer practical guidance on selecting appropriate PID tuning strategies for nonlinear temperature control systems operating under uncertainty.