Fitted Q-Function Control Methodology Based on Takagi-Sugeno Systems

Abstract

"© 2020 IEEE. Personal use of this material is permitted. Permissíon from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertisíng or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works."[EN] This paper presents a combined identification/ Q-function fitting methodology that involves identification of a Takagi-Sugeno model, computation of (sub)optimal controllers from linear matrix inequalities (LMIs), and subsequent data-based fitting of the Q-function via monotonic optimization. The LMI-based initialization provides a conservative solution, but it is a sensible starting point to avoid convergence/local-minima issues in raw data-based fitted Q-iteration or Bellman residual minimization. An inverted-pendulum experimental case study illustrates the approach.This work was supported in part by the Spanish Ministry of Economy and European Union (AEI/FEDER, UE) under Grant DPI2016-81002-R and in part by the Government of Ecuador through the Ph.D. Grant SENESCYT.Diaz-Iza, HP.; Armesto, L.; Sala, A. (2020). Fitted Q-Function Control Methodology Based on Takagi-Sugeno Systems. IEEE Transactions on Control Systems Technology. 28(2):477-488. https://doi.org/10.1109/TCST.2018.288568947748828