TRAFFIC SIGN RECOGNITION WITH CONVOLUTIONAL NEURAL NETWORK

Authors

DOI:

https://doi.org/10.37943/12YZFG6952

Keywords:

neural network, traffic sign, deep learning, machine learning, CNN

Abstract

Recognizing road signs is one of the most important steps drivers can take to help prevent accidents. The purpose of the research work is to develop a recognition system, increasing the classification accuracy of the model, using deep learning methods of the road sign recognition system for drivers in real time on the road. Stages of road sign image classification were carried out, and other authors' solutions were analyzed. In addition, in this work, a convolutional neural network (CNN) was used for an autonomous traffic and road sign detection and recognition system. The proposed system works in real-time on the recognition of road signs images. In this paper, a model is trained using deep learning of 43 different road signs using existing datasets and collected local road signs. A traffic sign detection and recognition system is presented using an 8-layer convolutional neural network, which acquires different functions by training different types of traffic signs.

In previous studies, models were trained using simple machine learning algorithms, but the relevance of this study is that a CNN model was trained for a classification task based on convolutional neural networks using deep learning. As a result of the study, classification accuracy of 95% was obtained using deep learning methods. As a novelty of the work, it is possible to note the diversity of the convolutional network methods used to increase the efficiency of the used data set and model training algorithms, the variety of received road signs and algorithms for its recognition, as well as the achievement of a high accuracy rate. This allowed the system to overcome the limited accuracy and performance issues caused by environmental factors, and to be more versatile and accurate than most modern systems.

Author Biographies

Sharipa Temirgaziyeva, Al-Farabi Kazakh National University

Master’s Student of the “Information Systems” Program

Batyrkhan Omarov, Al-Farabi Kazakh National University

Acting Associate Professor of the Department of Information Systems

References

Russian-Kazakh legal Explanatory Dictionary-reference book. (2008). Almaty: Zheti zhargy.

Number of road accidents. (2020). Retrieved from https://stat.gov.kz/api/getFile/?docId=ESTAT419824

State of accounting for the causes of road accidents in 2020. (2020). Retrieved from https://stat.gov.kz/api/getFile/?docId=ESTAT101250

Bouti, A., Mahraz, M. A., Riffi, J., & Tairi, H. (2020). A robust system for road sign detection and classification using LeNet architecture based on convolutional neural network. Soft Computing, 24(9), 6721–6733. https://doi.org/10.1007/s00500-019-04307-6

Sun, Y., Ge, P., & Liu, D. (2019, November). Traffic sign detection and recognition based on convolutional neural network. In 2019 Chinese Automation Congress (CAC) (pp. 2851-2854). IEEE. https://doi.org/10.1109/CAC48633.2019.8997240

Han, C., Gao, G., & Zhang, Y., (2019). Real-time small traffic sign detection with revised faster-RCNN. Multimedia Tools and Applications, 78(10), 13263-13278. https://doi.org/10.1007/s11042-018-6428-0

Devyatkin, A. V., & Filatov, D. M. (2019, May). Neural network traffic signs detection system development. In 2019 XXII International Conference on Soft Computing and Measurements (SCM)) (pp. 125-128). IEEE. https://doi.org/10.1109/SCM.2019.8903787

Shao, F., Wang, X., Meng, F., Zhu, J., Wang, D., & Dai, J. (2019). Improved faster R-CNN traffic sign detection based on a second region of interest and highly possible regions proposal network. Sensors, 19(10). https://doi.org/10.3390/s19102288

Wu, Y., Li, Z., Chen, Y., Nai, K., & Yuan, J. (2020). Real-time traffic sign detection and classification towards real traffic scene. Multimedia Tools and Applications, 79(25-26), 18201-18219. https://doi.org/10.1007/s11042-020-08722-y

Zheng, W., Zhu, X., Wen, G., Zhu, Y., Yu, H., & Gan, J. (2018). Unsupervised feature selection by self-paced learning regularization. Pattern recognition letters, 132(4-11). https://doi.org/10.1016/j.patrec.2018.06.029

Zheng, W., Zhu, X., Zhu, Y., Hu, R., & Lei, C. (2018). Dynamic graph learning for spectral feature selection. Multimedia tools and applications, 77(22), 29739-29755. https://doi.org/10.1007/s11042-017-5272-y

Li, X., Ma, H., Wang, X., & Zhang, X. (2018). Traffic light recognition for complex scene with fusion detections. IEEE Transactions on Intelligent Transportation Systems, 19(1), 199-208. https://doi.org/10.1109/tits.2017.2749971

Hechri, A., & Mtibaa, A. (2020). Two-stage traffic sign detection and recognition based on SVM and convolutional neural networks. IET Image Processing, 14(5), 939-946. https://doi.org/10.1049/iet-ipr.2019.0634

Lin, Z., Yih, M., Ota, J. M., Owens, J., & Muyan-Ozcelik, P. (2019). Benchmarking Deep Learning Frameworks and Investigating FPGA Deployment for Traffic Sign Classification and Detection. IEEE Transactions on Intelligent Vehicles, 4(3), 385-395. https://doi.org/10.1109/tiv.2019.2919458

Tian, Y., Gelernter, J., Wang, X., Li, J., & Yu, Y. (2020). Traffic Sign Detection Using a Multi-Scale Recurrent Attention Network. IEEE Transactions on Intelligent Transportation Systems, 20(12), 4466-4475. https://doi.org/10.1109/tits.2018.2886283

Krizhevsky, A., Sutskever, I., & Hinton, G. (2017). ImageNet classification with deep convolutional neural networks. Communications of the ACM, 60(6), 84–90. https://doi.org/10.1145/3065386

Igel, C. (2013). Detection of traffic signs in real-world images: The German traffic sign detection benchmark. In Proceedings of the International Joint Conference on Neural Networks, Dallas, TX, USA, 4–9.

Cai, Z., & Vasconcelos, N. (2018). Cascade R-CNN: Delving into high quality object detection, in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 6154–6162. https://doi.org/10.1109/CVPR.2018.00644

Sun, P., Zhang, R. Y., Jiang, T., Kong, C., Xu, W., Zhan, M., Tomizuka, L., Li, Z., Yuan, C., Wang & Luo, P. (2020). Sparse R-CNN: End-to-end object detection with learnable proposals. arXiv:2011.12450

Hai, W., Kuan, W., Yingfeng, C., Ze, L. & C. Long. (2020). Traffic sign recognition based on improved cascade convolution neural network. Automot. Eng., 42, 1256–1262.

Zhao, Z., Li, X., Liu, H. & Xu, C. (2020). Improved target detection algorithm based on libra R-CNN. IEEE Access, 8, 114044–114056. https://doi.org/10.1109/ACCESS.2020.3002860

Cao, J., Zhang, J. & Huang, W. (2021). Traffic sign detection and recognition using multi-scale fusion and prime sample attention. IEEE Access, 9, 3579–3591. https://doi.org/10.1109/ACCESS.2020.3047414

Kuang, X., Fu, W., & Yang, L. (2018). Real-time detection and recognition of road traffic signs using MSER and random forests. Int J Online Eng, 14(03),34–51. https://doi.org/10.3991/ijoe.v14i03.7925

Downloads

Published

2022-12-30

How to Cite

Temirgaziyeva, S., & Omarov, B. (2022). TRAFFIC SIGN RECOGNITION WITH CONVOLUTIONAL NEURAL NETWORK. Scientific Journal of Astana IT University, 12(12), 14–23. https://doi.org/10.37943/12YZFG6952

Issue

Section

Articles
betpas