SUBJECT BEHAVIOR DETECTION AND ANALYSIS BASED ON COMPUTER VISION TECHNOLOGY

Authors

DOI:

https://doi.org/10.37943/UIXY4934

Keywords:

distance learning, face detection, proctoring

Abstract

This article discusses the current problem of identifying violations during distance learning during the final certification.

The coronavirus (COVID-19) pandemic has served as a stimulus for innovation in the field of education in all countries, including Kazakhstan. Innovative approaches are being taken to ensure the continuity of education and training. Thanks to the rapid response measures taken by governments and partners around the world to ensure the smooth learning process. The ongoing digital transformation of an educational institution requires appropriate information content, suitable methodological models, effective teaching methods and a supportive learning environment. The solution to one of the urgent tasks is to ensure the quality and reliability of assessing the knowledge of students by introducing an online proctoring system. The primary task of the online proctoring system is to recognize faces and identify abnormal behavior of students.

The basis for obtaining data is the unified information educational environment of the D. Serikbayev East Kazakhstan Technical University is represented by the SPORTAL hardware and software system, which is an integration of two powerful subsystems: a Web application - the Dales of Knowledges educational portal and the SPORTAL information and software complex.

The main theoretical results obtained are aimed at solving practical problems and are being introduced into the educational environment of D. Serikbayev East Kazakhstan Technical University to increase the degree of confidence in the results of students' knowledge in distance learning using an online proctoring system. The article presents the results of studies of one of the Viola-Jones face detection methods, commonly known as Haar cascades. During the study, a technology for identifying faces and detecting violations in real time was developed. Domestic and foreign scientists who have made a significant contribution to the development of methods for processing facial images are noted.

Author Biographies

D. Muratuly, D. Serikbayev East Kazakhstan Technical University, Ust-Kamenogorsk, Kazakhstan

3rd year doctoral student of the educational program "Information Systems"

N. Denissova, D. Serikbayev East Kazakhstan Technical University, Ust-Kamenogorsk, Kazakhstan

Candidate of physical and mathematical sciences, Vice-Rector for Research and Digitalization

I. Krak, Taras Shevchenko National University of Kyiv, Ukraine

Doctor of Physical and Mathematical Sciences, Head of the Department of Theoretical Cybernetics

References

Zhao, S., Liu, W., Liu, S., Ge, J., & Liang, X. (2022). A hybrid-supervision learning algorithm for real-time un-completed face recognition. Computers & Electrical Engineering, 101, 108090. https://doi:10.1016/j.compeleceng.2022.108090

Gao, P., Lu, K., Xue, J., Shao, L., & Lyu, J. (2021). A coarse-to-fine facial landmark detection method based on self-attention mechanism. IEEE Transactions on Multimedia, vol.23, pp. 926–938. https://doi:10.1109/TMM.2020.2991507

Yan, J., Zhang, X., Lei, Z., & Li, S.Z. (2014). Face detection by structural models. Image and Vision Computing, 32, 790–799. https://doi:10.1016/j.imavis.2013.12.004

Kishan Das Menon, & H., Janardhan, V. (2021). Machine learning approaches in education. Materials Today: Proceedings, 43, 3470–3480. https://doi.org/10.1016/j.matpr.2020.09.566

Ren, S., He, K., Girshick, R., & Sun, J. (2015). Faster r-cnn: Towards real-time object detection with region proposal networks. Advances in Neural Information Processing Systems, 91–99. https://doi.org/10.48550/arXiv.1506.01497

Li, J., Wang, Y., Zhang, X., Deng, W., & Shen, H. (2019). Metric Classification Network in Actual Face Recognition Scene. Computer Vision and Pattern Recognition, 1. https://doi.org/10.48550/arXiv.1910.11563

Ranjan, R., Patel, V. M., & Chellappa, R. (2017). Hyperface: A deep multi-task learning framework for face detection, landmark localization, pose estimation, and gender recognition. IEEE transactions on pattern analysis and machine intelligence, vol.41(1), pp.121-135. https://doi:10.1109/TPAMI.2017.2781233

Robertson, D.J., Jenkins, R., & Burton, A.M. (2017). Face detection dissociates from face identification. Visual Cognition, 25 (7–8), 740-748. https://doi:10.1080/13506285.2017.1327465

Ullah, R., Hayat, H., Siddiqui, A.A, Siddiqui, U.A., Khan, J., Ullah, F., Hassan, S., Hasan, L., Albattah, W., Islam, M., & Karami, G.M. (2022). A Real-Time Framework for Human Face Detection and Recognition in CCTV Images. Hybrid Approaches for Image and Video Processing, 2022. https://doi.org/10.1155/2022/3276704

Svirnevskyi, M., Barmak, O., Ivaschenko, S., & Krak, I. (2019). Face Image Transformations for Correct Recognition Problems Solving. 2019 IEEE International Conference on Advanced Trends in Information Theory (ATIT), pp.415–419, https://doi:10.1109/ATIT49449.2019.9030513

Yadav, R., & Kacker, P. (2022). Efficient technique for real-time face detection. Materials Today: Proceedings, 56, 3306–3311. https://doi.org/10.1016/j.matpr.2021.10.118

Ye, C., Li, X., Lai, Sh., Wang, Ya., & Qian, X. (2022). Scale adaption-guided human face detection, Knowledge-Based Systems, 253. https://doi.org/10.1016/j.knosys.2022.109499

Sultanov, Z. (2021). Analysis of methods for detecting faces in an image. Scientific Journal of Astana IT University, 7, 77–88. https://doi.org/10.37943/AITU.2021.48.48.007

Muratuly, D., Denissova, N., Krak, Y., & Apayev, К. (2022). Biometric authentication of students to control the learning process in online education. Scientific Journal of Astana IT University. 10, 22–32. https://doi.org/10.37943/LYFW8581

Dendir, S., & Stockton Maxwell, R. (2020). Cheating in online courses: Evidence from online proctoring. Computers in Human Behavior Reports, 2. https://doi.org/10.1016/j.chbr.2020.100033

Feinman, Y. (2018). Security Mechanisms on Web-Based Exams in Introductory Statistics Community College Courses. Journal of Social, Behavioral, and Health Sciences, 12, 153–170. https://doi:10.5590/JSBHS.2018.12.1.11

Yegemberdiyeva, G., & Amirgaliyev, B. (2021). Study of AI Generated and Real Face Perception. SIST 2021 - 2021 IEEE International Conference on Smart Information Systems and Technologies. https://doi.org/10.1109/SIST50301.2021.9465908

Downloads

Published

2022-09-30

How to Cite

Muratuly, D., Denissova, N., & Krak, I. (2022). SUBJECT BEHAVIOR DETECTION AND ANALYSIS BASED ON COMPUTER VISION TECHNOLOGY. Scientific Journal of Astana IT University, 11(11), 36–47. https://doi.org/10.37943/UIXY4934

Issue

Section

Information Technologies
betpas
pendik escort anadolu yakasi escort bostanci escort kadikoy escort kartal escort kurtkoy escort umraniye escort
maltepe escort ataşehir escort ataşehir escort ümraniye escort pendik escort kurtköy escort anadolu yakası escort üsküdar escort şerifali escort kartal escort gebze escort kadıköy escort bostancı escort göztepe escort kadıköy escort bostancı escort üsküdar escort ataşehir escort maltepe escort kurtköy escort anadolu yakası escort ataşehir escort beylikdüzü escort