TY - GEN
T1 - Comparing the Effectiveness of PPO and its Variants in Training AI to Play Game
AU - Cui, Luobin
AU - Tang, Ying
N1 - Publisher Copyright:
© 2023 IEEE.
PY - 2023
Y1 - 2023
N2 - Automated game intelligence is a crucial step in rapid game development. A promising research direction for automated game intelligence is reinforcement learning, and specifically, the proximal policy optimization (PPO) algorithm. Two variants of the PPO, Maskable PPO and Recurrent PPO, further extend the capabilities of the PPO. We compare the performance of these three algorithms in the 2D game Mario and a 3D car racing game environment. We also evaluate their performance and applicability by comparing the experimental results of the original algorithm authors. With our results, we provide recommendations on PPO configuration depending on the target game type, providing future developers with a benchmark to help them decide which algorithm is most applicable for their applications.
AB - Automated game intelligence is a crucial step in rapid game development. A promising research direction for automated game intelligence is reinforcement learning, and specifically, the proximal policy optimization (PPO) algorithm. Two variants of the PPO, Maskable PPO and Recurrent PPO, further extend the capabilities of the PPO. We compare the performance of these three algorithms in the 2D game Mario and a 3D car racing game environment. We also evaluate their performance and applicability by comparing the experimental results of the original algorithm authors. With our results, we provide recommendations on PPO configuration depending on the target game type, providing future developers with a benchmark to help them decide which algorithm is most applicable for their applications.
UR - http://www.scopus.com/inward/record.url?scp=85178997053&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85178997053&partnerID=8YFLogxK
U2 - 10.1109/ICCSI58851.2023.10303944
DO - 10.1109/ICCSI58851.2023.10303944
M3 - Conference contribution
AN - SCOPUS:85178997053
T3 - ICCSI 2023 - 2023 International Conference on Cyber-Physical Social Intelligence
SP - 521
EP - 526
BT - ICCSI 2023 - 2023 International Conference on Cyber-Physical Social Intelligence
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2023 International Conference on Cyber-Physical Social Intelligence, ICCSI 2023
Y2 - 20 October 2023 through 23 October 2023
ER -