EXPLAINABLE MULTISPECTRAL ATTENTION NETWORK FOR SENTINEL-2 AGRICULTURAL LAND CLASSIFICATION

Authors

DOI:

https://doi.org/10.37943/DUJJ6958%20

Abstract

Accurate and transparent classification of agricultural land cover from satellite imagery is essential for operational crop monitoring. This study presents MS-AttNet, a compact convolutional network with squeeze-and-excitation channel attention for Sentinel-2 imagery using all thirteen spectral bands. On the EuroSAT benchmark, evaluated with a stratified 70/15/15 split across five random seeds, the model achieves 98.72 ± 0.21% accuracy, a macro F1-score of 0.9868 ± 0.0021, and a mean one-vs-rest AUC of 0.9999 with 1.32 million parameters. A ResNet-50 baseline re-implemented on the identical split achieves 97.90% accuracy with 23.56 million parameters, making the proposed model approximately eighteen times smaller and nearly three times faster at inference. A controlled ablation using five seeds per configuration shows that squeeze-and-excitation modules, convolutional stage depth, and vegetation indices as additional input channels each change accuracy by less than run-to-run variability. This indicates that the benchmark is saturated with respect to architectural choices in this model family; therefore, performance is not attributed specifically to the attention mechanism. Interpretability is assessed using Grad-CAM and SHAP band attributions with quantitative validation. Against a spatially smooth random control, Grad-CAM reduces deletion AUC from 0.857 to 0.738 and increases insertion AUC from 0.864 to 0.916 across 300 test patches. SHAP identifies blue, near-infrared, green, red, and short-wave-infrared bands as dominant contributors, with stable ordering across independently trained models. NDVI and NDWI were used only for spectral-signature analysis and interpretation, not as classifier inputs. The combination of compact size, competitive accuracy, and quantitatively verified explanations supports large-area operational monitoring applications

Author Biographies

Azamat Serek, Astana IT University, Kazakhstan

PhD, Associate Professor

Farida Abdoldina, Institute of Automation and Information Technologies, Satbayev University

 

PhD, Professor, Department of Program Engineering

 

Yelizaveta Vitulyova, Institute of Automation and Information Technologies, Satbayev University

PhD, Associate Professor, Department of Program Engineering

 

Gleb Tokin, Institute of Automation and Information Technologies, Satbayev University (KazNRTU)

 

 

Nurshapagat Shapay, Institute of Automation and Information Technologies, Satbayev University

 

 

Yan Kuchin, Institute of Automation and Information Technologies, Satbayev University

 

 

References

Serek, A., Abdoldina, F., Asylbek, M., Smurygin, V., & Nabiyeva, G. (2026). CTA-Net: A cross-temporal attention network for change detection in remote sensing imagery. Big Data and Cognitive Computing, 10(7), Article 225. https://doi.org/10.3390/bdcc10070225

Sharifi, A., & Safari, M. M. (2025). Enhancing the spatial resolution of Sentinel-2 images through super-resolution using transformer-based deep-learning models. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 18, 4805–4820. https://doi.org/10.1109/JSTARS.2025.3526260

Serek, A., Amirgaliyev, B., Li, R. Y. M., Zhumadillayeva, A., & Yedilkhan, D. (2025). Crowd density estimation using enhanced multi-column convolutional neural network and adaptive collation. IEEE Access, 13. https://doi.org/10.1109/ACCESS.2025.3597393

Paheding, S., Saleem, A., Siddiqui, M. F. H., Rawashdeh, N., Essa, A., & Reyes, A. A. (2024). Advancing horizons in remote sensing: A comprehensive survey of deep learning models and applications in image classification and beyond. Neural Computing and Applications, 36(27), 16727–16767. https://doi.org/10.1007/s00521-024-10165-7

Kou, W., Shen, Z., Liu, D., Liu, Z., Li, J., & Chang, W. (2023). Crop classification methods and influencing factors of reusing historical samples based on 2D-CNN. International Journal of Remote Sensing, 44(10), 3278–3305. https://doi.org/10.1080/01431161.2023.2218972

Thanjaivadivel, M., Gobinath, C., Vellingiri, J., Kaliraj, S., & Femilda Josephin, J. S. (2025). EnConv: Enhanced CNN for leaf disease classification. Journal of Plant Diseases and Protection, 132(1), Article 32. https://doi.org/10.1007/s41348-024-01033-6

Maurya, R., Rajput, L., & Mahapatra, S. (2025). RAI-Net: Tomato plant disease classification using Residual-Attention-Inception Network. IEEE Access, 13, 64832–64840. https://doi.org/10.1109/ACCESS.2025.3559804

Helber, P., Bischke, B., Dengel, A., & Borth, D. (2019). EuroSAT: A novel dataset and deep learning benchmark for land use and land cover classification. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 12(7), 2217–2226. https://doi.org/10.1109/JSTARS.2019.2918242

Li, N., Hao, S., & Zhao, K. (2024). A hybrid CNN–vision transformer structure for remote sensing scene classification. Remote Sensing Letters, 15(1), 88–98. https://doi.org/10.1080/2150704X.2024.2302348

Yang, R., Qi, Y., Zhang, H., Wang, H., Zhang, J., Ma, X., Zhang, J., & Ma, C. (2024). A study on the object-based high-resolution remote sensing image classification of crop planting structures in the Loess Plateau of Eastern Gansu Province. Remote Sensing, 16(13), Article 2479. https://doi.org/10.3390/rs16132479

Pelletier, C., Webb, G. I., & Petitjean, F. (2019). Temporal convolutional neural network for the classification of satellite image time series. Remote Sensing, 11(5), Article 523. https://doi.org/10.3390/rs11050523

Rußwurm, M., & Körner, M. (2020). Self-attention for raw optical satellite time series classification. ISPRS Journal of Photogrammetry and Remote Sensing, 169, 421–435. https://doi.org/10.1016/j.isprsjprs.2020.06.006

Reichstein, M., Camps-Valls, G., Stevens, B., Jung, M., Denzler, J., Carvalhais, N., & Prabhat. (2019). Deep learning and process understanding for data-driven Earth system science. Nature, 566(7743), 195–204. https://doi.org/10.1038/s41586-019-0912-1

Ribeiro, M. T., Singh, S., & Guestrin, C. (2016). “Why should I trust you?”: Explaining the predictions of any classifier. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 1135–1144). Association for Computing Machinery. https://doi.org/10.1145/2939672.2939778

Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2020). Grad-CAM: Visual explanations from deep networks via gradient-based localization. International Journal of Computer Vision, 128(2), 336–359. https://doi.org/10.1007/s11263-019-01228-7

Lundberg, S. M., & Lee, S.-I. (2017). A unified approach to interpreting model predictions. In Advances in Neural Information Processing Systems (Vol. 30, pp. 4765–4774). https://papers.nips.cc/paper_files/paper/2017/hash/8a20a8621978632d76c43dfd28b67767-Abstract.html

Kakogeorgiou, I., & Karantzalos, K. (2021). Evaluating explainable artificial intelligence methods for multi-label deep learning classification tasks in remote sensing. International Journal of Applied Earth Observation and Geoinformation, 103, Article 102520. https://doi.org/10.1016/j.jag.2021.102520

Campos-Taberner, M., García-Haro, F. J., Martínez, B., Izquierdo-Verdiguier, E., Atzberger, C., Camps-Valls, G., & Gilabert, M. A. (2020). Understanding deep learning in land use classification based on Sentinel-2 time series. Scientific Reports, 10, Article 17188. https://doi.org/10.1038/s41598-020-74215-5

Yassine, H., Tout, K., & Jaber, M. (2021). Improving LULC classification from satellite imagery using deep learning—EuroSAT dataset. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLIII-B3-2021, 369–376. https://doi.org/10.5194/isprs-archives-XLIII-B3-2021-369-2021

Cong, Y., Khanna, S., Meng, C., Liu, P., Rozi, E., He, Y., Burke, M., Lobell, D. B., & Ermon, S. (2022). SatMAE: Pre-training transformers for temporal and multi-spectral satellite imagery. In Advances in Neural Information Processing Systems (Vol. 35, pp. 197–211). https://dl.acm.org/doi/10.5555/3600270.3600285

Aleissaee, A. A., Kumar, A., Anwer, R. M., Khan, S., Cholakkal, H., Xia, G.-S., & Khan, F. S. (2023). Transformers in remote sensing: A survey. Remote Sensing, 15(7), Article 1860. https://doi.org/10.3390/rs15071860

Vali, A., Comai, S., & Matteucci, M. (2020). Deep learning for land use and land cover classification based on hyperspectral and multispectral Earth observation data: A review. Remote Sensing, 12(15), Article 2495. https://doi.org/10.3390/rs12152495

Temenos, A., Temenos, N., Kaselimi, M., Doulamis, A., & Doulamis, N. (2023). Interpretable deep learning framework for land use and land cover classification in remote sensing using SHAP. IEEE Geoscience and Remote Sensing Letters, 20, 1–5. https://doi.org/10.1109/LGRS.2023.3251652

Khan, M., Hanan, A., Kenzhebay, M., Gazzea, M., & Arghandeh, R. (2024). Transformer-based land use and land cover classification with explainability using satellite imagery. Scientific Reports, 14, Article 16744. https://doi.org/10.1038/s41598-024-67186-4

Hu, J., Shen, L., & Sun, G. (2018). Squeeze-and-excitation networks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 7132–7141). https://doi.org/10.1109/CVPR.2018.00745

Lundberg, S. M., Erion, G., Chen, H., DeGrave, A., Prutkin, J. M., Nair, B., Katz, R., Himmelfarb, J., Bansal, N., & Lee, S.-I. (2020). From local explanations to global understanding with explainable AI for trees. Nature Machine Intelligence, 2(1), 56–67. https://doi.org/10.1038/s42256-019-0138-9

Wolanin, A., Mateo-García, G., Camps-Valls, G., Gómez-Chova, L., Meroni, M., Duveiller, G., Liangzhi, Y., & Guanter, L. (2020). Estimating and understanding crop yields with explainable deep learning in the Indian Wheat Belt. Environmental Research Letters, 15(2), Article 024019. https://doi.org/10.1088/1748-9326/ab68ac

Gevaert, C. M. (2022). Explainable AI for Earth observation: A review including societal and regulatory perspectives. International Journal of Applied Earth Observation and Geoinformation, 112, Article 102869. https://doi.org/10.1016/j.jag.2022.102869

Downloads

Published

2026-09-30

How to Cite

Serek, A., Abdoldina, F., Vitulyova, Y., Tokin, G., Shapay, N. ., & Kuchin, Y. (2026). EXPLAINABLE MULTISPECTRAL ATTENTION NETWORK FOR SENTINEL-2 AGRICULTURAL LAND CLASSIFICATION. Scientific Journal of Astana IT University, 27(3), 168–186. https://doi.org/10.37943/DUJJ6958

Issue

Section

Information Technologies