https://doi.org/10.4081/jae.2023.1545 Comparative analysis of 2D and 3D vineyard yield prediction system using artificial intelligence
Published:30 October 2023
Abstract Views: 755
PDF: 176
HTML: 1
HTML: 1
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.
Authors
Traditional techniques for estimating the weight of clusters in a winery, generally consist of manually counting the variety of clusters per vine, and scaling by means of the entire variety of vines. This method can be arduous, and costly, and its accuracy depends on the scale of the sample. To overcome these problems, hybrid approaches of computer vision, deep learning (DL), and machine learning (ML) based vineyard yield prediction systems are proposed. Self-prepared datasets are used for comparative analysis of 2D and 3D yield prediction systems for vineyards. DL-based approach for segmentation operation on an RGB-D image dataset created with the D435I camera is used along with the ML-based weight prediction technique of grape clusters present in the single image using these datasets. A comparative analysis of the DL-based Keras regression model and various ML-based regression models for the weight prediction task is taken into account, and finally, a prediction model is proposed to estimate the yield of the entire vineyard. The analysis shows improved performance with the 3D vineyard yield prediction system compared to the 2D vineyard yield prediction system with grape cluster segmentation pixel accuracy up to 94.81% and yield prediction accuracy up to 99.58%.
Abdul Hakkim V.M., Abhilash Joseph E., Ajay Gokul A.J., Mufeedha K. 2016. Precision farming: The future of Indian agriculture. J. Appl. Biol. Biotechnol. 4:68-72. DOI: https://doi.org/10.7324/JABB.2016.40609
Altaheri H., Alsulaiman M., Muhammad G. 2019. Date fruit classification for robotic harvesting in a natural environment using deep learning. IEEE Access. 7:117115-33. DOI: https://doi.org/10.1109/ACCESS.2019.2936536
Arad B., Kurtser P., Barnea E., Ha B., Edan Y., Ben-Shahar O. 2019. Controlled Lighting and Illumination-Independent Target Detection for Real-Time Cost-Efficient Applications. The Case Study of Sweet Pepper Robotic Harvesting. Sensors. 19:1390. DOI: https://doi.org/10.3390/s19061390
Badeka E., Kalabokas T., Tziridis K., Nicolaou A., Vrochidou E., Mavridou E., Papakostas G.A., Pachidis T. 2019. Grapes Visual Segmentation for Harvesting Robots Using Local Texture Descriptors. Springer Link Computer Vision Systems. 98-109. DOI: https://doi.org/10.1007/978-3-030-34995-0_9
Baeten J., Donn K., Boedrij S., Beckers W. 2008. Autonomous fruit picking machine: A robotic apple harvester. Field and Service Robotics. 42:531-9. DOI: https://doi.org/10.1007/978-3-540-75404-6_51
Barbole D.K., Jadhav P.M. 2021. Comparative Analysis of Deep Learning Architectures for Grape Cluster Instance Segmentation. Inf. Technol. Industry. 9. DOI: https://doi.org/10.17762/itii.v9i1.138
Barbole D.K., Jadhav P.M. 2022. Grape Yield Prediction using Deep Learning Regression Model. 2022 International Conference for Advancement in Technology (ICONAT), Goa, India, 1-6. DOI: https://doi.org/10.1109/ICONAT53423.2022.9726026
Barbole D.K., Jadhav P.M. 2023a. GrapesNet: Indian Grape Clusters RGB & RGB-D Image Datasets. Mendeley Data.
Barbole D.K., Jadhav P.M. 2023b. GrapesNet: Indian RGB & RGB-D vineyard image datasets for deep learning applications. Data Brief. 48:109100. DOI: https://doi.org/10.1016/j.dib.2023.109100
Barbole D., Jadhav P., Patil S. 2021. A Review on Fruit Detection and Segmentation Techniques in Agricultural Field. International Conference on Image Processing and Capsule Networks. 300:269-88. DOI: https://doi.org/10.1007/978-3-030-84760-9_24
California Historical Society Collection. 2012. Close-up of a grape cluster on a vine. University of Southern California (USC) Digital Library.
Cecotti H., Rivera A., Farhadloo M., Pedroza M.A. 2020. Grape detection with convolutional neural networks. Expert Syst. Appl. 159. DOI: https://doi.org/10.1016/j.eswa.2020.113588
Ceres R., Pons J.L., Jiménez A.R., Martín J.M. 1998. Agribot: A robot for aided fruit harvesting. Industrial Robot. 5.
Chen S., Shivakumar S., Dcunha S., Das J., Okon E., Qu C., Kumar V. 2017. Counting apples and oranges with deep learning: A data-driven approach. IEEE Robot. Autom. Lett. 2:781-8. DOI: https://doi.org/10.1109/LRA.2017.2651944
Fernandez-Maloigne C., Laugier D., Boscolo C. 1993. Detection of apples with texture analyses for an apple picker robot. Proceedings of the Intelligent Vehicles ‘93 Symposium, IEEE Xplore. pp. 323-8.
FAO. 2009. Global agriculture towards 2050. High-level Expert Forum. Available at the link: https://www.fao.org/wsfs/forum2050/wsfs-forum/en/
Grasso G., Recce M. 1996. Scene analysis for an orange picking robot. Proceeding in International Conference of Computer Technology in Agriculture (ICCTA ‘96).
Habaragamuwa H., Ogawa Y., Suzuki T., Shiigi T., Ono M., Kondo N. 2018. Detecting greenhouse strawberries (mature and immature), using deep convolutional neural network. Eng. Agric. Environ. Food. 11:127-38. DOI: https://doi.org/10.1016/j.eaef.2018.03.001
Kang H., Chen C. 2019a. Fruit Detection, Segmentation and 3D Visualization of Environment in Apple Orchards. Comput. Electron. Agric. 171:105302. DOI: https://doi.org/10.1016/j.compag.2020.105302
Kang H., Chen C. 2019b. Fruit Detection and Segmentation for Apple Harvesting Using Visual Sensor in Orchards. Sensors. 19:4599. DOI: https://doi.org/10.3390/s19204599
Khan N., Fahad S., Naushad M., Faisal S. 2020. Grape Production Critical Review in the World. SSRN Electron. J. DOI: https://doi.org/10.2139/ssrn.3595842
Lee J., Nazki H., Baek J., Hong Y., Lee, M. 2020. Artificial Intelligence Approach for Tomato Detection and Mass estimation in Precision Agriculture. Sustainability 12:9138. DOI: https://doi.org/10.3390/su12219138
Liu S., Whitty M. 2015. Automatic grape bunch detection in vineyards with an SVM classifier. J. Appl. Log. 13:643-53. DOI: https://doi.org/10.1016/j.jal.2015.06.001
Liu X., Chen S.W., Aditya S., Sivakumar N., Dcunha S., Qu C., Taylor C.J., Das J., Kumar V. 2018. Robust Fruit Counting: Combining Deep Learning, Tracking, and Structure from Motion. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). DOI: https://doi.org/10.1109/IROS.2018.8594239
Liu Z., Wu J., Fu L., Maje Y., Feng Y., Li R., Cui Y. 2020. Improved Kiwifruit Detection Using Pre-Trained VGG16 With RGB and NIR Information Fusion. IEEE Access. 8. DOI: https://doi.org/10.1109/ACCESS.2019.2962513
Luo L., Tang Y., Lu Q., Chen X., Zhang P., Zou X. 2018. A vision methodology for harvesting robot to detect cutting points on peduncles of double overlapping grape clusters in a vineyard. Comput. Ind. 99:130-9. DOI: https://doi.org/10.1016/j.compind.2018.03.017
Luo L., Tang Y., Zou X., Wang C., Zhang P., Feng W. 2016. Robust Grape Cluster Detection in a Vineyard by Combining the Ada- Boost Framework and Multiple Color Components. Sensors. 16. DOI: https://doi.org/10.3390/s16122098
Marani R., Milella A., Petitti A., Reina G. 2020. Deep neural networks for grape bunch segmentation in natural images from a consumer-grade camera. J. Prec. Agric. 22:387-413. DOI: https://doi.org/10.1007/s11119-020-09736-0
Ni X., Li C., Jiang H., Takeda F. 2020. Deep learning image segmentation and extraction of blueberry fruit traits associated with harvest ability and yield. Horticul. Res. 7. DOI: https://doi.org/10.1038/s41438-020-0323-3
Nuske S., Achar S., Bates T., Narasimhan S. 2011. Yield estimation in vineyards by visual grape detection. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems. DOI: https://doi.org/10.1109/IROS.2011.6048830
Ranganathan J., Waite R., Searchinger T., Hanson C. 2018. How to Sustainably Feed 10 Billion People by 2050. World Resources Institute. Available from: https://www.wri.org/insights/howsustainably-feed-10-billion-people-2050-21-charts
Santos T.T., De-Souza L.L., Dos-Santos A., Avila S. 2020. Grape detection, segmentation and tracking using deep neural networks and three-dimensional association. Comput. Electron. Agric. 170. DOI: https://doi.org/10.1016/j.compag.2020.105247
Stein M., Bargoti S., Underwood J. 2019. Image Based Mango Fruit Detection, Localization and Yield Estimation using Multiple View Geometry. Sensors. 16:1915 DOI: https://doi.org/10.3390/s16111915
Tang Y., Chen M., Wang C., Luo L., Li J., Lian G., Zou X. 2020. Recognition and Localization Methods for Vision-Based Fruit Picking Robots: A Review. Frontiers Plant Sci. 11. DOI: https://doi.org/10.3389/fpls.2020.00510
Tang Y., Zhou H., Wang H., Zhang Y. 2023. Fruit detection and positioning technology for a Camellia oleifera C. Abel orchard based on improved YOLOv4-tiny model and binocular stereo vision. Exp. Syst. Appl. 211. DOI: https://doi.org/10.1016/j.eswa.2022.118573
Wang C., Tang Y., Zou X., SiTu W., Feng W. 2017. A Robust Fruit Image Segmentation Algorithm against Varying Illumination for Vision System of Fruit Harvesting Robot. Optik - Int. J. Light Electron. Opt. 131:626-31. DOI: https://doi.org/10.1016/j.ijleo.2016.11.177
Zhang C., Ding H., Shi Q., Wang Y. 2022. Grape Cluster Real-Time Detection in Complex Natural Scenes Based on YOLOv5s Deep Learning Network. Agriculture. 12. DOI: https://doi.org/10.3390/agriculture12081242
Zhou Y., Tang Y., Zou X., Wu M., Tang W., Meng F., Zhang Y., Kang H. 2022. Adaptive Active Positioning of Camellia oleifera Fruit Picking Points: Classical Image Processing and YOLOv7 Fusion Algorithm. Appl. Sci. 12:12959. DOI: https://doi.org/10.3390/app122412959
How to Cite
Barbole, D. and Jadhav, P. M. (2023) “Comparative analysis of 2D and 3D vineyard yield prediction system using artificial intelligence”, Journal of Agricultural Engineering, 55(1). doi: 10.4081/jae.2023.1545.
Copyright (c) 2023 the Author(s) 
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
PAGEPress has chosen to apply the Creative Commons Attribution NonCommercial 4.0 International License (CC BY-NC 4.0) to all manuscripts to be published.
Similar Articles
- Yun Zhu, Shuwen Liu, Xiaojun Wu, Lianfeng Gao, Youyun Xu, Multi-class segmentation of navel orange surface defects based on improved DeepLabv3+ , Journal of Agricultural Engineering: Vol. 55 No. 2 (2024)
- Bing Li, Jiyun Li, Key technology of crop precision sowing based on the vision principle , Journal of Agricultural Engineering: Vol. 54 No. 1 (2023)
- Michela Zanetti, Benoît Brandelet, Diletta Marini, Andrea Sgarbossa, Chiara Giorio, Denis Badocco, Andrea Tapparo, Stefano Grigolato, Caroline Rogaume, Yann Rogaume, Raffaele Cavalli, Vineyard pruning residues pellets for use in domestic appliances: a quality assessment according to the EN ISO 17225 , Journal of Agricultural Engineering: Vol. 48 No. 2 (2017)
- Thanaporn Singhpoo, Khwantri Saengprachatanarug, Seree Wongpichet, Jetsada Posom, Kanda Runapongsa Saikaew, Cassava stalk detection for a cassava harvesting robot based on YOLO v4 and Mask R-CNN , Journal of Agricultural Engineering: Vol. 54 No. 2 (2023)
- Alessandro D'Emilio, Simona M.C. Porto, Giovanni Cascone, Marco Bella, Marco Gulino, Mitigating heat stress of dairy cows bred in a free-stall barn by sprinkler systems coupled with forced ventilation , Journal of Agricultural Engineering: Vol. 48 No. 4 (2017)
- Andrea Peruzzi, Luisa Martelloni, Christian Frasconi, Marco Fontanelli, Michel Pirchio, Michele Raffaelli, Machines for non-chemical intra-row weed control in narrow and wide-row crops: a review , Journal of Agricultural Engineering: Vol. 48 No. 2 (2017)
- Diwei Wu, Shaohua Zeng, Shuai Wang, Yanan Chen, Yidan Xu, Zanthoxylum infructescence detection based on adaptive density clustering , Journal of Agricultural Engineering: Vol. 55 No. 2 (2024)
- Fernando Ferreira Abreu, Luiz Henrique Antunes Rodrigues, Monitoring mini-tomatoes growth: A non-destructive machine vision-based alternative , Journal of Agricultural Engineering: Vol. 53 No. 3 (2022)
- Yusuf Uzun, Mehmet Resit Tolun, Halil Tanyer Eyyuboglu, Filiz Sarı, An intelligent system for detecting Mediterranean fruit fly [Medfly; Ceratitis capitata (Wiedemann)] , Journal of Agricultural Engineering: Vol. 53 No. 3 (2022)
- Xiong Bi, Hongchun Wang, Double-branch deep convolutional neural network-based rice leaf diseases recognition and classification , Journal of Agricultural Engineering: Vol. 55 No. 1 (2024)
You may also start an advanced similarity search for this article.
