Murdoch University Research Repository

Welcome to the Murdoch University Research Repository

The Murdoch University Research Repository is an open access digital collection of research
created by Murdoch University staff, researchers and postgraduate students.

Learn more

Fault-tolerant tracking control based on reinforcement learning with application to a steer-by-wire system

Chen, H., Tu, Y., Wang, H.ORCID: 0000-0003-2789-9530, Shi, K. and He, S. (2021) Fault-tolerant tracking control based on reinforcement learning with application to a steer-by-wire system. Journal of the Franklin Institute, 359 (3). pp. 1152-1171.

Link to Published Version: https://doi.org/10.1016/j.jfranklin.2021.12.012
*Subscription may be required

Abstract

In this paper, a novel complete model-free integral reinforcement learning (CMFIRL) algorithm based fault tolerant control scheme is proposed to solve the tracking problem of steer-by-wire (SBW) system. We begin with the recognition that the reference errors can eventually converge to zero based on the command generator model. Then an augmented tracking system is constructed with a corresponding performance index which is considered as a type of actuator failure. By using the reinforcement learning (RL) technique, three novel online update strategies are respectively developed to cope with the following three cases, i.e., model-based, partially model-free, and completely model-free. Especially, the RL algorithm for the complete model-free case eliminates the constraints of requiring the known system dynamics in fault-tolerant tracking controlling. The system stability and the convergence of the CMFIRL iteration algorithm are also rigorously proved. Finally, a simulation example is given to illustrate the effectiveness of the proposed approach.

Item Type: Journal Article
Murdoch Affiliation(s): Engineering and Energy
Centre for Water, Energy and Waste
Publisher: Elsevier Ltd
Copyright: © 2021 The Franklin Institute.
URI: http://researchrepository.murdoch.edu.au/id/eprint/63645
Item Control Page Item Control Page