PREDICTING DIABETES PROGRESSION USING AN ENSEMBLE OF CNN, RNN, AND LSTM MODELS
DOI:
https://doi.org/10.37943/24JNSS7017Keywords:
Neural network ensembles, Dirichlet distribution, CNN, RNN, LSTM, diabetes prediction, clinical decision support, Deep learningAbstract
This article presents an integrated approach to predicting diabetes progression based on an ensemble of multiple deep neural network architectures. To enhance diagnostic accuracy and reliability, convolutional neural networks (CNN), recurrent neural networks (RNN), and long short-term memory (LSTM) models are jointly utilized within a clinical decision support framework. The optimal combination of their predictions is achieved through the Dirichlet ensemble method, which adaptively distributes weights among individual models according to their validation performance. Hyperparameter optimization using the Grid Search algorithm allows systematic selection of training parameters, network depth, activation functions, and regularization techniques, ensuring better convergence and reducing overfitting risks. The study involves a comprehensive data preprocessing pipeline, including normalization, balancing, and One-Hot Encoding of categorical features, to manage heterogeneous medical datasets and minimize the effect of missing or noisy information. Experimental evaluation demonstrates that the proposed ensemble model significantly outperforms individual CNN, RNN, and LSTM architectures in terms of accuracy, sensitivity, and stability, achieving improved generalization ability and robustness to data variability. This research emphasizes the potential of ensemble deep learning approaches to strengthen modern clinical decision support systems (CDSS). The developed framework enables more precise and interpretable diagnostic predictions, contributing to early diabetes detection and prevention strategies. Furthermore, the proposed methodology can be extended to other medical classification problems, providing a flexible and adaptive analytical tool for healthcare applications. The findings confirm that adaptive ensemble methods based on the Dirichlet distribution can serve as a foundation for reliable, transparent, and intelligent clinical decision-making in future healthcare systems.
References
Mangoulia, P., Milionis, C., Vlachou, E., & Ilias, I. (2024). The Interrelationship between Diabetes Mellitus and Emotional Well-Being: Current Concepts and Future Prospects. Healthcare, 12(14), 1457. https://doi.org/10.3390/healthcare12141457
Hossain, M. J., Al‐Mamun, M., & Islam, M. R. (2024). Diabetes mellitus, the fastest growing global public health concern: Early detection should be focused. Health Science Reports, 7(3), e2004. https://doi.org/10.1002/hsr2.2004
Ouanes, K., & Farhah, N. (2024). Effectiveness of artificial intelligence (AI) in clinical decision support systems and care delivery. Journal of medical systems, 48(1), 74. https://doi.org/10.1007/s10916-024-02098-4
Asif, S., Wenhui, Y., ur-Rehman, S. et al. (2025). Advancements and Prospects of Machine Learning in Medical Diagnostics: Unveiling the Future of Diagnostic Precision. Arch Computat Methods Eng 32, 853–883. https://doi.org/10.1007/s11831-024-10148-w
Shanthi, K., Manimekalai, S. (2024). Cervical Cancer Detection Using Ensemble Neural Network Algorithm with Stochastic Gradient Descent (SGD) Optimizer. SN COMPUT. SCI. 5, 1151. https://doi.org/10.1007/s42979-024-03365-4
Verma R. and Muhuri S. (2025). Predicting Gestational Diabetes and PCOS Susceptibility: A Machine Learning-Based Cross-Framework Analysis," 2025 3rd International Conference on Data Science and Information System (ICDSIS), Hassan, India, pp. 1-6, doi: 10.1109/ICDSIS65355.2025.11071152
Ismukhamedova, A., Uvaliyeva, I., & Belginova, S. (2024). Integrating machine learning in electronic health passport based on WHO study and healthcare resources. Informatics in Medicine Unlocked, 44, 101428. https://doi.org/10.1016/j.imu.2023.101428
Rane, C., Tyagi, K., Kline, A., Chugh, T., & Manry, M. (2024). Optimizing performance of feedforward and convolutional neural networks through dynamic activation functions. Evolutionary Intelligence, 17(5), 4083-4093. https://doi.org/10.1007/s12065-024-00973-0
Wassan, S., Dongyan, H., Suhail, B., Jhanjhi, N. Z., Xiao, G., Ahmed, S., & Murugesan, R. K. (2024). Deep convolutional neural network and IoT technology for healthcare. Digital health, 10, 20552076231220123.
Cantemir, E., & Kandemir, O. (2024). Use of artificial neural networks in architecture: determining the architectural style of a building with a convolutional neural networks. Neural Computing and Applications, 36(11), 6195-6207. https://doi.org/10.1007/s00521-023-09395-y
Ayad, J. (2024). Survey on neural networks in networking: Applications and advancements. Babylonian Journal of Networking, 2024, 135-147. https://doi.org/10.58496/BJN/2024/014
Rezvan, M. R., Sorkhi, A. G., Pirgazi, J., & Kallehbasti, M. M. P. (2024). AdvanceSplice: Integrating N-gram one-hot encoding and ensemble modeling for enhanced accuracy. Biomedical Signal Processing and Control, 92, 106017. https://doi.org/10.1016/j.bspc.2024.106017
Al-Shehari, T., & Alsowail, R. A. (2021). An insider data leakage detection using one-hot encoding, synthetic minority oversampling and machine learning techniques. Entropy, 23(10), 1258. https://doi.org/10.3390/e23101258
Gu, B., & Sung, Y. (2021). Enhanced Reinforcement Learning Method Combining One-Hot Encoding-Based Vectors for CNN-Based Alternative High-Level Decisions. Applied Sciences, 11(3), 1291. https://doi.org/10.3390/app11031291
Nguyen-Ngoc, L., Nguyen-Huu, Q., De Roeck, G., Bui-Tien, T., & Abdel-Wahab, M. (2024). Deep neural network and evolved optimization algorithm for damage assessment in a truss bridge. Mathematics, 12(15), 2300. https://doi.org/10.3390/math12152300
Li, G., Qian, G., Delgadillo, I. C., Muller, M., Thabet, A., & Ghanem, B. (2020). Sgas: Sequential greedy architecture search. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (pp. 1620-1630). https://openaccess.thecvf.com/content_CVPR_2020/papers/Li_SGAS_Sequential_Greedy_Architecture_Search_CVPR_2020_paper.pdf
Garbin, C., Zhu, X., & Marques, O. (2020). Dropout vs. batch normalization: an empirical study of their impact to deep learning. Multimedia tools and applications, 79(19), 12777-12815. (2020). https://doi.org/10.1007/s11042-019-08453-9
Rimal, Y., Sharma, N., & Alsadoon, A. (2024). The accuracy of machine learning models relies on hyperparameter tuning: student result classification using random forest, randomized search, grid search, bayesian, genetic, and optuna algorithms. Multimedia Tools and Applications, 83(30), 74349-74364. 74349–74364 (2024). https://doi.org/10.1007/s11042-024-18426-2
Coulibaly, S., Kamsu-Foguem, B., Kamissoko, D., & Traore, D. (2022). Explainable deep convolutional neural networks for insect pest recognition. Journal of Cleaner Production, 371, 133638. https://doi.org/10.1016/j.jclepro.2022.133638
Narkhede, M. V., Bartakke, P. P., & Sutaone, M. S. (2022). A review on weight initialization strategies for neural networks. Artificial intelligence review, 55(1), 291-322. https://doi.org/10.1007/s10462-021-10033-z
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Articles are open access under the Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Authors who publish a manuscript in this journal agree to the following terms:
- The authors reserve the right to authorship of their work and transfer to the journal the right of first publication under the terms of the Creative Commons Attribution License, which allows others to freely distribute the published work with a mandatory link to the the original work and the first publication of the work in this journal.
- Authors have the right to conclude independent additional agreements that relate to the non-exclusive distribution of the work in the form in which it was published by this journal (for example, to post the work in the electronic repository of the institution or publish as part of a monograph), providing the link to the first publication of the work in this journal.
- Other terms stated in the Copyright Agreement.