PREDICTING DIABETES PROGRESSION USING AN ENSEMBLE OF CNN, RNN, AND LSTM MODELS

Authors

DOI:

https://doi.org/10.37943/24JNSS7017

Keywords:

Neural network ensembles, Dirichlet distribution, CNN, RNN, LSTM, diabetes prediction, clinical decision support, Deep learning

Abstract

This article presents an integrated approach to predicting diabetes progression based on an ensemble of multiple deep neural network architectures. To enhance diagnostic accuracy and reliability, convolutional neural networks (CNN), recurrent neural networks (RNN), and long short-term memory (LSTM) models are jointly utilized within a clinical decision support framework. The optimal combination of their predictions is achieved through the Dirichlet ensemble method, which adaptively distributes weights among individual models according to their validation performance. Hyperparameter optimization using the Grid Search algorithm allows systematic selection of training parameters, network depth, activation functions, and regularization techniques, ensuring better convergence and reducing overfitting risks. The study involves a comprehensive data preprocessing pipeline, including normalization, balancing, and One-Hot Encoding of categorical features, to manage heterogeneous medical datasets and minimize the effect of missing or noisy information. Experimental evaluation demonstrates that the proposed ensemble model significantly outperforms individual CNN, RNN, and LSTM architectures in terms of accuracy, sensitivity, and stability, achieving improved generalization ability and robustness to data variability. This research emphasizes the potential of ensemble deep learning approaches to strengthen modern clinical decision support systems (CDSS). The developed framework enables more precise and interpretable diagnostic predictions, contributing to early diabetes detection and prevention strategies. Furthermore, the proposed methodology can be extended to other medical classification problems, providing a flexible and adaptive analytical tool for healthcare applications. The findings confirm that adaptive ensemble methods based on the Dirichlet distribution can serve as a foundation for reliable, transparent, and intelligent clinical decision-making in future healthcare systems.

Author Biographies

Indira Uvaliyeva, D. Serikbayev East Kazakhstan Technical University, Ust-Kamenogorsk, Kazakhstan

PhD, Professor of the School of Digital Technology and Intelligent Systems

Bayan Assanova, LLC «А-Medical», Almaty, Kazakhstan

Candidate of Medical Sciences, Founder and Director of the company

Zarina Khassenova, D. Serikbayev East Kazakhstan Technical University, Ust-Kamenogorsk, Kazakhstan

PhD, Dean of the School of Digital Technology and Intelligent Systems

Roza Mukasheva, D. Serikbayev East Kazakhstan Technical University, Ust-Kamenogorsk, Kazakhstan

Candidate of Technical Sciences, Associate Professor in the Department of Higher Mathematics

Bekzat Karimkyzy, LLC «А-Medical», Almaty, Kazakhstan

Master of Management, Project manager

Kristina Karassenko, LLC «А-Medical», Almaty, Kazakhstan

Bachelor of Science in Chemistry, Production Manager

References

Mangoulia, P., Milionis, C., Vlachou, E., & Ilias, I. (2024). The Interrelationship between Diabetes Mellitus and Emotional Well-Being: Current Concepts and Future Prospects. Healthcare, 12(14), 1457. https://doi.org/10.3390/healthcare12141457

Hossain, M. J., Al‐Mamun, M., & Islam, M. R. (2024). Diabetes mellitus, the fastest growing global public health concern: Early detection should be focused. Health Science Reports, 7(3), e2004. https://doi.org/10.1002/hsr2.2004

Ouanes, K., & Farhah, N. (2024). Effectiveness of artificial intelligence (AI) in clinical decision support systems and care delivery. Journal of medical systems, 48(1), 74. https://doi.org/10.1007/s10916-024-02098-4

Asif, S., Wenhui, Y., ur-Rehman, S. et al. (2025). Advancements and Prospects of Machine Learning in Medical Diagnostics: Unveiling the Future of Diagnostic Precision. Arch Computat Methods Eng 32, 853–883. https://doi.org/10.1007/s11831-024-10148-w

Shanthi, K., Manimekalai, S. (2024). Cervical Cancer Detection Using Ensemble Neural Network Algorithm with Stochastic Gradient Descent (SGD) Optimizer. SN COMPUT. SCI. 5, 1151. https://doi.org/10.1007/s42979-024-03365-4

Verma R. and Muhuri S. (2025). Predicting Gestational Diabetes and PCOS Susceptibility: A Machine Learning-Based Cross-Framework Analysis," 2025 3rd International Conference on Data Science and Information System (ICDSIS), Hassan, India, pp. 1-6, doi: 10.1109/ICDSIS65355.2025.11071152

Ismukhamedova, A., Uvaliyeva, I., & Belginova, S. (2024). Integrating machine learning in electronic health passport based on WHO study and healthcare resources. Informatics in Medicine Unlocked, 44, 101428. https://doi.org/10.1016/j.imu.2023.101428

Rane, C., Tyagi, K., Kline, A., Chugh, T., & Manry, M. (2024). Optimizing performance of feedforward and convolutional neural networks through dynamic activation functions. Evolutionary Intelligence, 17(5), 4083-4093. https://doi.org/10.1007/s12065-024-00973-0

Wassan, S., Dongyan, H., Suhail, B., Jhanjhi, N. Z., Xiao, G., Ahmed, S., & Murugesan, R. K. (2024). Deep convolutional neural network and IoT technology for healthcare. Digital health, 10, 20552076231220123.

Cantemir, E., & Kandemir, O. (2024). Use of artificial neural networks in architecture: determining the architectural style of a building with a convolutional neural networks. Neural Computing and Applications, 36(11), 6195-6207. https://doi.org/10.1007/s00521-023-09395-y

Ayad, J. (2024). Survey on neural networks in networking: Applications and advancements. Babylonian Journal of Networking, 2024, 135-147. https://doi.org/10.58496/BJN/2024/014

Rezvan, M. R., Sorkhi, A. G., Pirgazi, J., & Kallehbasti, M. M. P. (2024). AdvanceSplice: Integrating N-gram one-hot encoding and ensemble modeling for enhanced accuracy. Biomedical Signal Processing and Control, 92, 106017. https://doi.org/10.1016/j.bspc.2024.106017

Al-Shehari, T., & Alsowail, R. A. (2021). An insider data leakage detection using one-hot encoding, synthetic minority oversampling and machine learning techniques. Entropy, 23(10), 1258. https://doi.org/10.3390/e23101258

Gu, B., & Sung, Y. (2021). Enhanced Reinforcement Learning Method Combining One-Hot Encoding-Based Vectors for CNN-Based Alternative High-Level Decisions. Applied Sciences, 11(3), 1291. https://doi.org/10.3390/app11031291

Nguyen-Ngoc, L., Nguyen-Huu, Q., De Roeck, G., Bui-Tien, T., & Abdel-Wahab, M. (2024). Deep neural network and evolved optimization algorithm for damage assessment in a truss bridge. Mathematics, 12(15), 2300. https://doi.org/10.3390/math12152300

Li, G., Qian, G., Delgadillo, I. C., Muller, M., Thabet, A., & Ghanem, B. (2020). Sgas: Sequential greedy architecture search. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (pp. 1620-1630). https://openaccess.thecvf.com/content_CVPR_2020/papers/Li_SGAS_Sequential_Greedy_Architecture_Search_CVPR_2020_paper.pdf

Garbin, C., Zhu, X., & Marques, O. (2020). Dropout vs. batch normalization: an empirical study of their impact to deep learning. Multimedia tools and applications, 79(19), 12777-12815. (2020). https://doi.org/10.1007/s11042-019-08453-9

Rimal, Y., Sharma, N., & Alsadoon, A. (2024). The accuracy of machine learning models relies on hyperparameter tuning: student result classification using random forest, randomized search, grid search, bayesian, genetic, and optuna algorithms. Multimedia Tools and Applications, 83(30), 74349-74364. 74349–74364 (2024). https://doi.org/10.1007/s11042-024-18426-2

Coulibaly, S., Kamsu-Foguem, B., Kamissoko, D., & Traore, D. (2022). Explainable deep convolutional neural networks for insect pest recognition. Journal of Cleaner Production, 371, 133638. https://doi.org/10.1016/j.jclepro.2022.133638

Narkhede, M. V., Bartakke, P. P., & Sutaone, M. S. (2022). A review on weight initialization strategies for neural networks. Artificial intelligence review, 55(1), 291-322. https://doi.org/10.1007/s10462-021-10033-z

Downloads

Published

2025-10-30

How to Cite

Uvaliyeva, I., Assanova, B., Khassenova, Z., Mukasheva, R., Karimkyzy, B., & Karassenko, K. (2025). PREDICTING DIABETES PROGRESSION USING AN ENSEMBLE OF CNN, RNN, AND LSTM MODELS . Scientific Journal of Astana IT University, 24. https://doi.org/10.37943/24JNSS7017

Issue

Section

Information Technologies