DESIGN AND DEVELOPMENT OF AN INTELLIGENT AGENT-BASED EDUCATIONAL PLATFORM FOR DEVELOPING CRITICAL THINKING IN FUTURE COMPUTER SCIENCE TEACHERS
DOI:
https://doi.org/10.37943/XMG%20L9885Keywords:
critical thinking, intelligent multi-agent educational platform , artificial intelligence agent , intelligent tutoring system , artificial intelligence-enhanced educational simulation , retrieval-augmented generationAbstract
The development of generative artificial intelligence expands opportunities for personalised learning support but also increases the risks of cognitive dependence and weakened critical thinking. This issue is particularly relevant to pre-service computer science teachers, whose future professional practice requires logically grounded reasoning, argument evaluation, and informed decision-making. This study aimed to design, develop, and experimentally evaluate an intelligent multi-agent educational platform for fostering critical thinking among pre-service computer science teachers. The methodology included analysis of scientific approaches to critical thinking development and artificial intelligence agents in teacher education, identification of pedagogical and functional requirements, platform architecture and interaction scenario design, prototype development, and a quasi-experimental study with pre- and post-testing. The developed architecture integrates an intelligent tutoring system for argumentation, role-specific artificial intelligence agents for computer science lesson simulation, an expert retrieval-augmented generation module, and an analytics dashboard. Agent operation is organised through profiling, short- and long-term memory, pedagogically constrained planning, and action modules supporting adaptive task generation, dialogue-based guidance, formative assessment, feedback, reflection, and individual progress monitoring. The platform also enables simulation of pedagogical situations aimed at developing future teachers’ professional readiness to foster school students’ critical thinking. Preliminary experimental results indicate positive changes in critical thinking performance and demonstrate the pedagogical potential of the platform. The next stage will evaluate the computer science lesson simulation mode and its contribution to professional readiness for developing school students’ critical thinking. The practical significance lies in integrating the platform into both subject-specific and pedagogical-methodological components of pre-service computer science teacher education.
References
Miao, F., & Holmes, W. (2023). Guidance for generative AI in education and research. UNESCO. https://doi.org/10.54675/EWZM9535
Son, T. (2024). Intelligent tutoring systems in mathematics education: A systematic literature review using the substitution, augmentation, modification, redefinition model. Computers, 13(10), Article 270. https://doi.org/10.3390/computers13100270
Huang, L., Yu, W., Ma, W., Zhong, W., Feng, Z., Wang, H., Chen, Q., Peng, W., Feng, X., Qin, B., & Liu, T. (2025). A survey on hallucination in large language models: Principles, taxonomy, challenges, and open questions. ACM Transactions on Information Systems, 43(2), Article 42. https://doi.org/10.1145/3703155
Shumailov, I., Shumaylov, Z., Zhao, Y., Papernot, N., Anderson, R., & Gal, Y. (2024). AI models collapse when trained on recursively generated data. Nature, 631, 755–759. https://doi.org/10.1038/s41586-024-07566-y
OECD. (2018). The future of education and skills: Education 2030. OECD Publishing. https://doi.org/10.1787/54ac7020-en
OECD. (2024). PISA 2022 results: Creative minds, creative schools (Vol. 3). OECD Publishing. https://doi.org/10.1787/765ee8c2-en
Pravitel’stvo Respubliki Kazakhstan [Government of the Republic of Kazakhstan]. (2023). Kontseptsiya razvitiya vysshego obrazovaniya i nauki Respubliki Kazakhstan na 2023–2029 gody [Concept for the development of higher education and science in the Republic of Kazakhstan for 2023–2029]. https://adilet.zan.kz/rus/docs/P2300000248
Facione, P. A. (2023). Critical thinking: What it is and why it counts (2023 update). Insight Assessment. https://insightassessment.com/wp-content/uploads/2023/12/Critical-Thinking-What-It-Is-and-Why-It-Counts.pdf
Osborne, J. F., Henderson, J. B., MacPherson, A., Szu, E., Wild, A., & Yao, S.-Y. (2016). The development and validation of a learning progression for argumentation in science. Journal of Research in Science Teaching, 53(6), 821–846. https://doi.org/10.1002/tea.21316
Badjeber, R., Supriyatman, S., Afadil, A., & Hadi, W. (2024). A review of Toulmin’s argumentation in mathematics and science learning: Implementation, impact, and the role of the teacher. Jurnal Pendidikan MIPA, 25(3), 1199–1213. https://doi.org/10.23960/jpmipa/v25i3.pp1199-1213
Giri, V., & Paily, M. U. (2020). Effect of scientific argumentation on the development of critical thinking. Science & Education, 29(3), 673–690. https://doi.org/10.1007/s11191-020-00120-y
Alexander, R. (2018). Developing dialogic teaching: Genesis, process, trial. Research Papers in Education, 33(5), 561–598. https://doi.org/10.1080/02671522.2018.1481140
Wegerif, R., & Major, L. (2024). The theory of educational technology: Towards a dialogic foundation for design. Routledge. https://doi.org/10.4324/9781003198499
Henderson, J. B., & Lewis, A. (2022). Utilizing technology to DiALoG classroom speaking and listening. Science Scope, 45(3), 14–18. https://doi.org/10.1080/08872376.2022.12291453
Shi, Y., Yu, K., Dong, Y., & Chen, F. (2026). Large language models in education: A systematic review of empirical applications, benefits, and challenges. Computers and Education: Artificial Intelligence, 10, Article 100529. https://doi.org/10.1016/j.caeai.2025.100529
Xi, L., Zhang, Y., & Wang, Q. (2026). Investigating the effects of an LLM-based Socratic conversational agent on students’ academic performance and reflective thinking in higher education. Computers & Education, 241, Article 105494. https://doi.org/10.1016/j.compedu.2025.105494
Tang, K.-S., & Putra, G. B. S. (2026). Generative AI as a dialogic partner: Enhancing multiple perspectives, reasoning, and argumentation in science education with customized chatbots. Journal of Science Education and Technology. Advance online publication. https://doi.org/10.1007/s10956-025-10240-1
Gao, C., Lan, X., Li, N., Yuan, Y., Ding, J., Zhou, Z., Xu, F., & Li, Y. (2024). Large language models empowered agent-based modeling and simulation: A survey and perspectives. Humanities and Social Sciences Communications, 11, Article 1259. https://doi.org/10.1057/s41599-024-03611-3
Li, X., Wang, S., Zeng, S., Wu, Y., & Yang, Y. (2024). A survey on LLM-based multi-agent systems: Workflow, infrastructure, and challenges. Vicinagearth, 1, Article 9. https://doi.org/10.1007/s44336-024-00009-2
Guo, T., Chen, X., Wang, Y., Chang, R., Pei, S., Chawla, N. V., Wiest, O., & Zhang, X. (2024). Large language model based multi-agents: A survey of progress and challenges. Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence (IJCAI-24), 8048–8057. https://doi.org/10.24963/ijcai.2024/890
Jiang, Y.-H., Li, R., Zhou, Y., Qi, C., Hu, H., Wei, Y., Jiang, B., & Wu, Y. (2024). AI agent for education: Von Neumann multi-agent system framework. In Proceedings of the 28th Global Chinese Conference on Computers in Education (pp. 77–84). Global Chinese Conference on Computers in Education. https://arxiv.org/abs/2501.00083
Luo, W., & Jho, H. (2026). Predictive metacognition: A neuro-computational framework for self-monitoring in large language models. Scientific Reports, 16, Article 23962. https://doi.org/10.1038/s41598-026-54840-2
Favero, L., Pérez-Ortiz, J. A., Käser, T., & Oliver, N. (2025). Enhancing critical thinking in education by means of a Socratic chatbot. In AI in Education and Educational Research (CCIS, Vol. 2519, pp. 17–32). Springer. https://doi.org/10.1007/978-3-031-93409-4_2
Krupp, L., Steinert, S., Kiefer-Emmanouilidis, M., Avila, K. E., Lukowicz, P., Kuhn, J., Küchemann, S., & Karolus, J. (2024). Challenges and opportunities of moderating usage of large language models in education. In Proceedings of the International Conference on Mobile and Ubiquitous Multimedia (pp. 249–254). Association for Computing Machinery. https://doi.org/10.1145/3701571.3701590
Shanto, S. S., Ahmed, Z., & Jony, A. I. (2024). Enriching the learning process with generative AI: A proposed framework to cultivate critical thinking in higher education using ChatGPT. Tuijin Jishu/Journal of Propulsion Technology, 45(1), 3019–3029. https://doi.org/10.52783/tjjpt.v45.i01.4680
Pal Chowdhury, S., Zouhar, V., & Sachan, M. (2024). AutoTutor meets large language models: A language model tutor with rich pedagogy and guardrails. In Proceedings of the Eleventh ACM Conference on Learning @ Scale (pp. 5–15). ACM. https://doi.org/10.1145/3657604.3662041
Kahl, S., Löffler, F., Maciol, M., Ridder, F., Schmitz, M., Spanagel, J., Wienkamp, J., Burgahn, C., & Schilling, M. (2025). Evaluating the impact of advanced LLM techniques on AI lecture tutors for a robotics course. In AI in Education and Educational Research (CCIS, Vol. 2519, pp. 149–160). Springer. https://doi.org/10.1007/978-3-031-93409-4_14
Long, Y., Luo, H., & Zhang, Y. (2024). Evaluating large language models in analysing classroom dialogue. npj Science of Learning, 9, Article 60. https://doi.org/10.1038/s41539-024-00273-3
Lee, G.-G., Latif, E., Wu, X., Liu, N., & Zhai, X. (2024). Applying large language models and chain-of-thought for automatic scoring. Computers and Education: Artificial Intelligence, 6, Article 100213. https://doi.org/10.1016/j.caeai.2024.100213
Tang, T., Sha, J., Zhao, Y., Wang, S., Wang, Z., & Shen, S. (2024). Unveiling the efficacy of ChatGPT in evaluating critical thinking skills through peer feedback analysis: Leveraging existing classification criteria. Thinking Skills and Creativity, 53, Article 101607. https://doi.org/10.1016/j.tsc.2024.101607
Park, B., & Seo, K. (2025). Assessing critical thinking through a multi-agent LLM-based debate chatbot. In Extended Abstracts of the 2025 CHI Conference on Human Factors in Computing Systems (Article 80, pp. 1–13). Association for Computing Machinery. https://doi.org/10.1145/3706599.3721207
Ta, N. B. D., Nguyen, H. G. P., & Gottipati, S. (2026). Automatic generation of introductory programming exercises with large language models. Research and Practice in Technology Enhanced Learning, 21, Article 025. https://doi.org/10.58459/rptel.2026.21025
López-Goyez, J. P., González-Briones, A., & Demazeau, Y. (2026). An adaptive multi-agent architecture with reinforcement learning and generative AI for intelligent tutoring systems: A Moodle-based case study. Applied Sciences, 16(3), 1323. https://doi.org/10.3390/app16031323
Dai, C.-P., Ke, F., Zhang, N., Barrett, A., West, L., Bhowmik, S., Southerland, S. A., & Yuan, X. (2026). Investigating preservice teachers’ emotions and dialogic teaching practices in simulation-based learning with artificial intelligence-powered virtual student agents. Learning and Instruction, 104, 102381. https://doi.org/10.1016/j.learninstruc.2026.102381
Aperstein, Y., Cohen, Y., & Apartsin, A. (2025). Generative AI-based platform for deliberate teaching practice: A review and a suggested framework. Education Sciences, 15(4), Article 405. https://doi.org/10.3390/educsci15040405
Kabzhalelov, K. R., Korganbaeva, Zh. K., Nurakhmetova, A. R., Meirmanova, A. A., & Sagimbayeva, A. E. (2026). The impact of AI tools on critical thinking in science education: A systematic review of theoretical advancements and practical outcomes. Bulletin of the Karaganda University. Pedagogy Series, 31(1), 234–247. https://doi.org/10.31489/2026ped1/234-247
Muratova, K., & Baibekova, M. (2025). Vliyanie iskusstvennogo intellekta na vospriyatie i usvoenie znanii studentami v protsesse samostoyatel’noi raboty [The influence of artificial intelligence on students’ perception and acquisition of knowledge during independent work]. Bulletin of the Karaganda University. Pedagogy Series. https://doi.org/10.31489/2025ped4/106-117
Zhumabekova, G. B., Zhusupova, R. F., Islam, A., & Kemaldan, E. G. (2024). Fostering intercultural competence: Unleashing the power of AI-based tools in shaping student critical thinking skills. Bulletin of Ablai Khan KazUIRandWL. Pedagogical Sciences Series, 73(2), 191–202. https://doi.org/10.48371/PEDS.2024.73.2.012
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Articles are open access under the Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Authors who publish a manuscript in this journal agree to the following terms:
- The authors reserve the right to authorship of their work and transfer to the journal the right of first publication under the terms of the Creative Commons Attribution License, which allows others to freely distribute the published work with a mandatory link to the the original work and the first publication of the work in this journal.
- Authors have the right to conclude independent additional agreements that relate to the non-exclusive distribution of the work in the form in which it was published by this journal (for example, to post the work in the electronic repository of the institution or publish as part of a monograph), providing the link to the first publication of the work in this journal.
- Other terms stated in the Copyright Agreement.