COMBINED APPROACH BASED ON HARALICK AND GABOR FEATURES TO CLASSIFY BUILDINGS PARTIALLY HIDDEN BY VEGETATION
DOI:
https://doi.org/10.37943/22YNTU3695Keywords:
texture analysis, Haralick features, Gabor filter, image classification, Random ForestAbstract
Classification of urban area is important for urban planning, infrastructure management and detection of illegal constructions. However, automatic object recognition in urban environments is difficult due to textural similarity of materials, varying lighting conditions and partial overlap of buildings with vegetation. The identification of buildings partially hidden by green spaces is particularly challenging because their boundaries merge with the surrounding environment, which reduces the accuracy of traditional classification methods. In this study, a stepwise approach to object classification in aerial images is proposed to improve the recognition of buildings partially hidden by vegetation. The analysis was performed in two stages using three-channel high-resolution aerial images acquired from an unmanned aerial vehicle. In the first stage, classification was performed based on Haralick features computed from a co-occurrence matrix of gradations, which allowed the extraction of statistical texture features. However, this was insufficient for accuracy, so in the second stage, a Gabor filter was additionally applied to provide analysis of local texture features, taking into account the frequency and orientation of image elements. The final classification was performed using Random Forest algorithm, which allowed to divide objects into three categories: "buildings", "vegetation" and "buildings partially hidden by vegetation". The classes "buildings" and "vegetation" were considered as auxiliary, providing quality control of the classification and allowing us to focus on improving the recognition of objects partially occluded by vegetation. Experimental results confirmed that the proposed method is effective for recognizing buildings partially hidden by vegetation. The inclusion of the Gabor filter improved the classification accuracy of this class from 0.84 to 0.90, the completeness from 0.74 to 0.86, and the F1-estimation from 0.79 to 0.88. The 11% improvement in completeness is particularly important because it indicates a reduction in the number of missed buildings. In comparison, the classification accuracy of fully visible buildings increased from 0.84 to 0.91 and that of vegetation from 0.88 to 0.95. Thus, the proposed method, which combines global and local texture features, demonstrated high performance to improve the identification accuracy of complex objects whose boundaries merge with the surrounding vegetation.
References
Kupidura, P. (2019). The comparison of different methods of texture analysis for their efficacy for land use classification in satellite imagery. Remote Sensing, 11(10), 1233. https://doi.org/10.3390/rs11101233
Jennifer, J. J., Vanmathy, S., Jobi Sahana, C. M., & Devi, G. (2016). Evaluation of image texture parameters for urban land cover classification. Int J Res Sci Technol, 6(III), 183-190. https://www.researchgate.net/publication/319204736
He, L., Liu, C., Li, J., Li, Y., Li, S., & Yu, Z. (2020). Hyperspectral Image Spectral–Spatial-Range Gabor Filtering. IEEE Transactions on Geoscience and Remote Sensing, 58(7), 4818–4836. https://doi.org/10.1109/tgrs.2020.2967778
Tussupov, J., Yessenova, M., Abdikerimova, G., Aimbetov, A., Baktybekov, K., Murzabekova, G., & Aitimova, U. (2024). Analysis of formal concepts for verification of pests and diseases of crops using machine learning methods. IEEE Access, 12, 19902–19910. https://doi.org/10.1109/access.2024.3361046
Kuffer, M., Pfeffer, K., Sliuzas, R., & Baud, I. (2016). Extraction of slum areas from VHR imagery using GLCM variance. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 9(5), 1830–1840. https://doi.org/10.1109/jstars.2016.2538563
Girija, G., & Nikhila, R. I. (2018). Slum extraction approaches from high resolution satellite data—a case study of Madurai City. Int. J. Pure. Appl. Math, 119, 14509-14514. https://acadpubl.eu/hub/2018-119-12/articles/6/1355.pdf
Kohli, D., Sliuzas, R., & Stein, A. (2016). Urban slum detection using texture and spatial metrics derived from satellite imagery. Journal of Spatial Science, 61(2), 405–426. https://doi.org/10.1080/14498596.2016.1138247
Canayaz, E., Altikardes, Z. A., & Unsal, A. (2024). Haralick Feature-Based Deep Learning model for ankylosing spondylitis classification using magnetic resonance images. 2021 International Conference on INnovations in Intelligent SysTems and Applications (INISTA), 1–6. https://doi.org/10.1109/inista62901.2024.10683853
Kuffer, M., Pfeffer, K., & Sliuzas, R. (2016). Slums from Space—15 Years of Slum Mapping Using Remote Sensing. Remote Sensing, 8(6), 455. https://doi.org/10.3390/rs8060455
Ansari, R. A., & Buddhiraju, K. M. (2019). Textural segmentation of remotely sensed images using multiresolution analysis for slum area identification. European Journal of Remote Sensing, 52(sup2), 74–88. https://doi.org/10.1080/22797254.2019.1565419
Shen, X., Wang, M., Peng, K., & Xiong, S. (2021, January). A building extraction method via Gabor filter and multi-orientation π local binary pattern operator. In Twelfth International Conference on Graphics and Image Processing (ICGIP 2020) (Vol. 11720, pp. 561-566). SPIE. https://doi.org/10.1117/12.2589349
Munawar, H. S., Aggarwal, R., Qadir, Z., Khan, S. I., Kouzani, A. Z., & Mahmud, M. a. P. (2021). A GABOR Filter-Based protocol for Automated Image-Based building Detection. Buildings, 11(7), 302. https://doi.org/10.3390/buildings11070302
Zhang, D., Dai, G., & Xiang, S. (2023, February). Segmentation of urban high resolution remote sensing images based on mean shift with texture feature extraction by Gabor filtering. In Fourth International Conference on Geoscience and Remote Sensing Mapping (GRSM 2022) (Vol. 12551, pp. 620-627). SPIE. https://doi.org/10.1117/12.2668137
Cruz-Ramos, C., Garcia-Salgado, B. P., Reyes-Reyes, R., Ponomaryov, V., & Sadovnychiy, S. (2021). GaBor features extraction and Land-Cover classification of urban hyperspectral images for remote sensing applications. Remote Sensing, 13(15), 2914. https://doi.org/10.3390/rs13152914
Man, Q., Dong, P., & Guo, H. (2015). Pixel- and feature-level fusion of hyperspectral and lidar data for urban land-use classification. International Journal of Remote Sensing, 36(6), 1618–1644. https://doi.org/10.1080/01431161.2015.1015657
Lai, X., Yang, J., Li, Y., & Wang, M. (2019). A building extraction approach based on the fusion of LIDAR point cloud and elevation map texture features. Remote Sensing, 11(14), 1636. https://doi.org/10.3390/rs11141636
Yogeshwari, M., & Thailambal, G. (2021). Automatic feature extraction and detection of plant leaf disease using GLCM features and convolutional neural networks. Materials Today Proceedings, 81, 530–536. https://doi.org/10.1016/j.matpr.2021.03.700
P, P. D., & Sumathi, P. (2022). Deep Learning Techniques to Classify the Aerial Images with Gabor Filter. International Journal for Research in Applied Science and Engineering Technology, 10(5), 1484–1489. https://doi.org/10.22214/ijraset.2022.42572
Biau, G., & Scornet, E. (2016). A random forest guided tour. Test, 25(2), 197–227. https://doi.org/10.1007/s11749-016-0481-7
Malbhage, P., & Khoje, S. (2017, December). Building and Tree Detection by Fusing LiDar and Aerial Images for Urban Development Planning. In 2017 Ninth International Conference on Advanced Computing (ICoAC) (pp. 1-8). IEEE. https://doi.org/10.1109/icoac.2017.8441323
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Articles are open access under the Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Authors who publish a manuscript in this journal agree to the following terms:
- The authors reserve the right to authorship of their work and transfer to the journal the right of first publication under the terms of the Creative Commons Attribution License, which allows others to freely distribute the published work with a mandatory link to the the original work and the first publication of the work in this journal.
- Authors have the right to conclude independent additional agreements that relate to the non-exclusive distribution of the work in the form in which it was published by this journal (for example, to post the work in the electronic repository of the institution or publish as part of a monograph), providing the link to the first publication of the work in this journal.
- Other terms stated in the Copyright Agreement.