AN EFFICIENT APPROACH FOR THE IMPLEMENTATION OF THE GOBANG GAME USING ARTIFICIAL INTELLIGENCE METHODS

Authors

DOI:

https://doi.org/10.37943/13XCFG1746

Keywords:

Gobang, artificial intelligence, supervised learning algorithm, image processing, residual neural model, game search algorithm, artificial neural network, reinforcement learning

Abstract

Gobang is one of the most ancient abstract strategy games for two players. The game is traditionally played on a board with black and white stones, where players take turns placing a colored stone on an empty intersection. The winner is the first player to form an unbroken chain of five stones, either horizontally, vertically, or diagonally. Although the rules of Gobang seem pretty straightforward, the game tree complexity is enormous since the board state is more intuitive than in other games. In this paper, we will implement an algorithm that will solve the Gobang game using artificial intelligence (AI) methods. The program will begin learning from scratch, then use self-play to produce training data, and eventually steadily build up its strength. The present work first focuses on the implementation of the supervised learning algorithm in the identification procedure in order to identify the position of the current fallen piece. This will be achieved by utilizing image processing and a convolutional neural network. Then a Gobang game procedure will be implemented using a game search algorithm, in which the state of the game is judged by means of a human-set function. After that, the function of judging the game state in the above game search algorithm will be changed to an artificial neural network (ANN) model, since it is convenient to train a model with a small dataset. Finally, the reinforcement learning algorithm will be applied to learn the artificial neural network model so that the playing level of the Gobang game program can be continuously improved.

Author Biographies

Assem Dospanova, Astana IT University

BSc student of Industrial Automation

Sanzhar Kusdavletov, Astana IT University

Master of Science in Advanced Control and Systems Engineering, Senior Lecturer

Aigerim Kalikova , Astana IT University

MSc, Senior Lecturer, Department of Intelligent Systems and Cybersecurity

References

Li, M., & Fu, M. (2021). Research on the Recommendation System of Gobang Game Based on Machine Learning. The 2nd International Conference on Computing and Data Science. https://doi.org/10.1145/3448734.3450788

Xie, Y., Gao, W., Dai, Z., & Li, Y. (2022). Research and Improvement of Alpha-Beta Search Algorithm in Gobang. Advances in Transdisciplinary Engineering. https://doi.org/10.3233/atde220084

Li, W. (2018). Prediction Distortion in Monte Carlo Tree Search and an Improved Algorithm. Journal of Intelligent Learning Systems and Applications, 10(02), 46–79. https://doi.org/10.4236/jilsa.2018.102004

Jofanda, A.N.W., & Yasin, M. (2021). Design of Checkers Game Using Alpha-Beta Pruning Algorithm. INTENSIF: Jurnal Ilmiah Penelitian Dan Penerapan Teknologi Sistem Informasi, 5(2), 279–295. https://doi.org/10.29407/intensif.v5i2.15863

Sun, L., Biao, G., & Shi, H. (2022). A deep reinforcement learning method based on attentional memories. 2022 International Conference on Computer Engineering and Artificial Intelligence (ICCEAI). https://doi.org/10.1109/icceai55464.2022.00108

Hu, J., Zhao, F., Meng, J., & Wu, S. (2020). Application of deep reinforcement learning in the board game. Proceedings of 2020 IEEE International Conference on Information Technology, Big Data and Artificial Intelligence. https://doi.org/10.1109/ICIBA50161.2020.9277188

Soemers, D., Samothrakis, S., Piette, É., & Stephenson, M. (2023). Extracting tactics learned from self-play in general games. Information Sciences, Volume 624, 277-298. https://doi.org/10.1016/j.ins.2022.12.080

Li, X., Zhang, W., Chen, J., Wu, L., & Cairangdanghzhou. (2022). Gobang Game Algorithm Based on Reinforcement Learning. Communications in Computer and Information Science, 463–475. https://doi.org/10.1007/978-981-16-9247-5_36

Venkateswara Reddy, L., Saravana Kumar, S., Sugumaran, S., & Lavanya, K. (2021). Design and development of artificial intelligence (AI) based board game (Gobang) using android. Materials Today: Proceedings. https://doi.org/10.1016/j.matpr.2020.12.1144

An, Y., Primanita, A., Khalid, M., & Iida, H. (2020). Ascertaining the Play Outcome using the Single Conspiracy Number in GoBang. 2020 IEEE Conference on Games (CoG). https://doi.org/10.1109/cog47356.2020.9231621

Hu, J., Zhao, F., Meng, J., & Wu, S. (2020). Application of Deep Reinforcement Learning in the Board Game. 2020 IEEE International Conference on Information Technology, Big Data and Artificial Intelligence (ICIBA). https://doi.org/10.1109/iciba50161.2020.9277188

Dingying, T., Huiling, L., Hanjie, L., & Pingping, C. (2022). Design and Implementation of Gobang Game Server Based on Distributed Cluster Technology. ACM International Conference Proceeding Series, 217-224. https://doi.org/10.1145/3517077.3517113

Ziang, W., Haowei, W., & Yanlong, Z. (2021). A Replay Method for Gobang Chessboard Based on Machine Vision. Asia-Pacific Conference on Communications. https://doi.org/10.1109/acctcs52002.2021.00060

C. Nunes, M. De Craene, H. Langet, O. Camara & A. Jonsson. A Monte Carlo Tree Search Approach to Learning Decision Trees. 2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA), Orlando, FL, USA, 2018, pp. 429-435. https://doi.org/10.1109/ICMLA.2018.00070

Downloads

Published

2023-03-30

How to Cite

Dospanova, A., Kusdavletov, S., & Kalikova, A. (2023). AN EFFICIENT APPROACH FOR THE IMPLEMENTATION OF THE GOBANG GAME USING ARTIFICIAL INTELLIGENCE METHODS. Scientific Journal of Astana IT University, 13(13), 16–23. https://doi.org/10.37943/13XCFG1746

Issue

Section

Articles
betpas