Res. Agr. Eng., 2023, 69(3):132-142 | DOI: 10.17221/77/2022-RAE

A novel hybrid feature method for weeds identification in the agriculture sectorOriginal Paper

Sheeraz Arif Arif*,1, Rashid Hussain2, Nadia Mustaqim Ansari3, Waseem Rauf4
1 Department of Computer Science, Faculty of Information Technology, Salim Habib University, Karachi, Pakistan
2 Department of Information and Communication Engineering, Beijing Institute of Technology, Beijing, China
3 Department of Electronic Engineering, Faculty of Engineering Science and Technology, Hamdard University, Karachi, Pakistan
4 Department of Electronic Engineering, Dawood University of Engineering and Technology, Karachi, Pakistan

Weed identification and controlling systems are gaining great attention and are very effective for large productivity in the agriculture sector. Currently, farmers are facing a weed control and management problem, and to tackle this challenge precision agriculture in the form of selective spraying is much-needed practice. In this article, we introduce a novel framework for a weed identification system that leverages (hybrid) the robust and relevant features of deep learning models, such as convolutional neural network (CNN) and handcrafted features. First, we apply the image pre-processing and augmentation techniques for image quality and dataset size enhancement. Then, we apply handcrafted feature extraction techniques, such as local binary pattern (LBP) and histogram of oriented gradients (HOG) to extract texture and shape features from the input. We also apply the deep learning model, such as CNN, to capture the relevant semantic features. Lastly, we concatenate the features extracted from a different domain and explore the performance using different classifiers. We achieved better performance and classification accuracy in the presence of the extreme gradient boosting (XGBoost) classifier. The achieved results witnessed the effectiveness and applicability of the given method and the importance of concatenated features.

Keywords: convolutional neural network; deep learning; handcrafted features; weed detection; XGBoost classifier

Accepted: February 21, 2023; Prepublished online: July 2, 2023; Published: September 3, 2023  Show citation

ACS AIP APA ASA Harvard Chicago Chicago Notes IEEE ISO690 MLA NLM Turabian Vancouver
Arif SA, Hussain R, Ansari NM, Rauf W. A novel hybrid feature method for weeds identification in the agriculture sector. Res. Agr. Eng. 2023;69(3):132-142. doi: 10.17221/77/2022-RAE.
Download citation

References

  1. Arif S., Wang J., Hussain F., Fei Z. (2019): Trajectory-based 3D convolutional descriptors for human action recognition. Journal of Information Science and Engineering, 35: 851-870.
  2. Aversano L., Bernardi M.L., Cimitile M., Iammarino M., Rondinella S. (2020): Tomato diseases classification based on VGG and transfer learning. In: Proceedings of the 2020 IEEE International Workshop on Metrology for Agriculture and Forestry (MetroAgriFor), Trento, Nov 4-6, 2020: 129-133. Go to original source...
  3. Bakhshipour A., Jafari A. (2018): Evaluation of support vector machine and artificial neural networks in weed detection using shape features. Computers and Electronics in Agriculture, 145: 153-160. Go to original source...
  4. Chen T., Guestrin C. (2016): XGBoost: A scalable tree boosting system. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, Aug 13-17, 2016: 785-794. Go to original source...
  5. Chen Y., Wu Z., Zhao B., Fan C., Shi S. (2021): Weed and corn seedling detection in field based on multi feature fusion and support vector machine. Sensors, 21: 212-230. Go to original source... Go to PubMed...
  6. Cover T., Hart P. (1967): Nearest neighbor pattern classification. IEEE Transactions on Information Theory, 13: 21-27. Go to original source...
  7. Dalal N., Triggs B. (2005): Histograms of oriented gradients for human detection. In: Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), San Diego, June 20-25, 2005: 886-893. Go to original source...
  8. European Commission (2021): Farm to Fork targets - Progress. Available at https://food.ec.europa.eu/plants/pesticides/sustainable-use-pesticides/farm-fork-targets-progress_en (accessed Sept 6, 2021).
  9. Fu L., Gao F., Wu J., Li R., Karkee M., Zhang Q. (2020): Application of consumer RGB-D cameras for fruit detection and localization in the field: A critical review. Computers and Electronics in Agriculture, 177: 105687. Go to original source...
  10. Hamuda E., Mc Ginley B., Glavin M., Jones E. (2017): Automatic crop detection under field conditions using the HSV colour space and morphological operations. Computer and Electronics in Agriculture, 133: 97-107. Go to original source...
  11. He D., Qiao Y., Li P., Gao Z., Li H., Tang J. (2013): Weed recognition based on SVM-DS multi-feature fusion. Transactions of the Chinese Society of Agricultural Machinery, 44: 182-187.
  12. He K., Zhang X., Ren S., Sun J. (2016): Deep Residual Learning for Image Recognition. In: Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, June 27-30, 2016: 770-778. Go to original source...
  13. Janiesch C., Zschech P., Heinrich K. (2021): Machine learning and deep learning. Electronic Markets, 31: 685-695. Go to original source...
  14. Kiefer J., Wolfowitz J. (1952): Stochastic estimation of the maximum of a regression function. The Annals of Mathematical Statistics, 23: 462-466. Go to original source...
  15. Krizhevsky A., Sutskever I., Hinton G.E. (2012): ImageNet classification with deep convolutional neural networks. In: Proceedings of the 26th Conference on Neural Information Processing Systems (NIPS 2012), Lake Tahoe, Dec 3-8, 2012: 1097-1105.
  16. Le V.N.T., Apopei B., Alameh K. (2019): Effective plant discrimination based on the combination of local binary pattern operators and multiclass support vector machine methods. Information Processing in Agriculture, 6: 116-131. Go to original source...
  17. Le V.N.T., Ahderom S., Alameh K. (2020): Performances of the LBP-based algorithm over CNN models for detecting crops and weeds with similar morphologies. Sensors, 20: 2193. Go to original source... Go to PubMed...
  18. Lowry C.J., Smith R.G. (2018): Weed control through crop plant manipulations. In: Jabran K., Chauhan B.S. (eds): Non-Chemical Weed Control. London, Academic Press: 73-96. Go to original source...
  19. Ma Y., Feng Q., Yang M., Li M. (2016): Detection of wine grape leaves based on HOG. Computer Engineering and Applications, 52: 158-161.
  20. Ojala T., Pietikäinen M., Harwood D. (1996): A comparative study of texture measures with classification based on featured distributions. Pattern Recognition, 29: 51-59. Go to original source...
  21. Olsen A., Konovalov D.A., Philippa B., Ridd P., Wood J.C., Johns J., Banks W., Girgenti B., Kenny O., Whinney J., Calvert B., Azghadi M.R., White R.D. (2019): DeepWeeds: A multiclass weed species image dataset for deep learning. Scientific reports, 9: 2058. Go to original source... Go to PubMed...
  22. Pan S.J., Yang Q. (2010): A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering, 22: 1345-1359. Go to original source...
  23. Pizer S.M., Johnston R.E., Ericksen J.P., Yankaskas B.C., Muller K.E. (1990): Contrast-limited adaptive histogram equalization: Speed and effectiveness. In: Proceedings of the 1st Conference on Visualization in Biomedical Computing, Atlanta, May 22-25, 1990: 337-345.
  24. Razfar N., True J., Bassiouny R., Venkatesh V., Kashef R. (2022): Weed detection in soybean crops using custom lightweight deep learning models. Journal of Agriculture and Food Research, 8: 100308. Go to original source...
  25. Sabzi S., Abbaspour-Gilandeh Y., García-Mateos G. (2018): A fast and accurate expert system for weed identification in potato crops using metaheuristic algorithms. Computers in Industry, 98: 80-89. Go to original source...
  26. Simonyan K., Zisserman A. (2015): Very deep convolutional networks for large-scale image recognition. In: Proceedings of the 3rd International Conference on Learning Representations (ICLR), San Diego, May 7-9, 2015: 1-14.
  27. Szegedy C., Liu W., Jia Y., Sermanet P., Reed S., Anguelov D., Erhan D., Vanhoucke V., Rabinovich A. (2015): Going deeper with convolutions. In: Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, June 7-12, 2015: 1-9. Go to original source...
  28. Szegedy C., Vanhoucke V., Ioffe S., Shlens J., Wojna Z. (2016): Rethinking the inception architecture for computer vision. In: Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, June 27-30, 2016: 2818-2826. Go to original source...
  29. Tang J., Wang D., Zhang Z., He L., Xin J., Xu Y. (2017): Weed identification based on K-means feature learning combined with convolutional neural network. Computers and Electronics in Agriculture,135: 63-70. Go to original source...
  30. Vapnik V. (1999): The Nature of Statistical Learning Theory, Statistics for Engineering and Information Science. 2nd Ed. Berlin, Springer Science & Business Media.
  31. Wang P., Tang Y., Luo F., Wang L., Li C., Niu Q., Li H. (2022): Weed25: A deep learning dataset for weed identification. Frontiers in Plant Science, 13: 1053329. Go to original source... Go to PubMed...
  32. Wu Z., Chen Y., Zhao B., Kang X., Ding Y. (2021): Review of weed detection methods based on computer vision. Sensors, 21: 3647-3670. Go to original source... Go to PubMed...
  33. Yang J., Wang Y., Chen Y., Yu J. (2022): Detection of weeds growing in alfalfa using convolutional neural networks. Agronomy (MDPI), 12: 1459. Go to original source...
  34. You J., Liu W., Lee, J. (2020): A DNN-based semantic segmentation for detecting weed and crop. Computers and Electronics in Agriculture, 178: 105750. Go to original source...
  35. Zimdahl R. (2018a): Weed Classification, in Fundamentals of Weed Science, 5th Ed. In: Zimdahl (ed.). Cambridge, Academic Press: 47-60. Go to original source...
  36. Zimdahl R. (2018b): Weed Classification, in Fundamentals of Weed Science, 5th Ed. In: Zimdahl (ed.). Cambridge, Academic Press: 17-46. Go to original source...
  37. Zou K., Chen X., Wang Y., Zhang C., Zhang F. (2021): A modified U-Net with a specific data argumentation method for semantic segmentation of weed images in the field. Computers and Electronics in Agriculture, 187: 106242. Go to original source...

This is an open access article distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International (CC BY NC 4.0), which permits non-comercial use, distribution, and reproduction in any medium, provided the original publication is properly cited. No use, distribution or reproduction is permitted which does not comply with these terms.