Adaptive dynamic programming-based hierarchical decision-making of non-affine systems

Lin，Danyu1; Xue，Shan2; Liu，Derong3,4; Liang，Mingming1; Wang，Yonghua1

2023-10-01

10.1016/j.neunet.2023.07.044

Neural Networks   Impact Factor & Quartile

0893-6080

1879-2782

In this paper, the problem of multiplayer hierarchical decision-making problem for non-affine systems is solved by adaptive dynamic programming. Firstly, the control dynamics are obtained according to the theory of dynamic feedback and combined with the original system dynamics to construct the affine augmented system. Thus, the non-affine multiplayer system is transformed into a general affine form. Then, the hierarchical decision problem is modeled as a Stackelberg game. In the Stackelberg game, the leader makes a decision based on the information of all followers, whereas the followers do not know each other's information and only obtain their optimal control strategy based on the leader's decision. Then, the augmented system is reconstructed by a neural network (NN) using input–output data. Moreover, a single critic NN is used to approximate the value function to obtain the optimal control strategy for each player. An extra term added to the weight update law makes the initial admissible control law no longer needed. According to the Lyapunov theory, the state of the system and the error of the weights of the NN are both uniformly ultimately bounded. Finally, the feasibility and validity of the algorithm are confirmed by simulation.

Adaptive dynamic programming Multiplayer Stackelberg game Neural networks Non-affine systems

SCI

English

Corresponding

National Key Research and Development Program of China[2018AAA0100203];Basic and Applied Basic Research Foundation of Guangdong Province[2021A1515110870];National Natural Science Foundation of China[62073085];National Natural Science Foundation of China[62203120];

Computer Science ; Neurosciences & Neurology

Computer Science, Artificial Intelligence ; Neurosciences

WOS:001072672500001

PERGAMON-ELSEVIER SCIENCE LTD

COMPUTER SCIENCE

2-s2.0-85169977833

Scopus

1.School of Automation,Guangdong University of Technology,Guangzhou,510006,China
2.School of Information and Communication Engineering,Hainan University,Haikou,570100,China
3.School of System Design and Intelligent Manufacturing,Southern University of Science and Technology,Shenzhen,518055,China
4.Department of Electrical and Computer Engineering,University of illinois Chicago,Chicago,60607,United States

Lin，Danyu,Xue，Shan,Liu，Derong,et al. Adaptive dynamic programming-based hierarchical decision-making of non-affine systems[J]. Neural Networks,2023,167:331-341.

Lin，Danyu,Xue，Shan,Liu，Derong,Liang，Mingming,&Wang，Yonghua.(2023).Adaptive dynamic programming-based hierarchical decision-making of non-affine systems.Neural Networks,167,331-341.

Lin，Danyu,et al."Adaptive dynamic programming-based hierarchical decision-making of non-affine systems".Neural Networks 167(2023):331-341.