Development and Experimental Analysis of a Robotic System for Automated Vegetable Planting Utilizing Precision Agriculture and Computer Vision

Willian Virgilio S. Silva

Federal University of Ceara, Eletrical Engineering Department, Fortaleza, CE, Brazil

*Corresponding Author

This work presents the development of a precision agriculture robot capable of managing vegetable, berry, and legume patches within a vegetable crop. It utilizes computer vision, Internet of Things (Iot) cloud-based processing, which, through an online webapp a digital twin coordinates planting activities such as sowing, weed control, and watering in a real vegetable crop raised bed where the physical robot is installed. An analysis of the computer vision methods for automatic weed detection under different conditions and foreign bodies is presented. According to experimental results, by the experiment scenarios, some computational theoretical improvements are proposed in order to reduce false detection of weeds such foreign bodies in the raised crop bed.

Precision agriculture, computer vision, IoT, cloud computing, digital twin, Farmbot, efficient consumption

Willian Virgilio S. Silva, Juliana Barreira de Almeida, Fabricio Gonzalez Nogueira, Geova A. Machado de Carvalho, Bismark Claure Torrico, Raoni Alves Lima, Wellington da S. Sales Junior (2025). Development and Experimental Analysis of a Robotic System for Automated Vegetable Planting Utilizing Precision Agriculture and Computer Vision. Journal of Artificial Intelligence and Systems, 7, 35–60. https://doi.org/10.33969/AIS.2025070103.

[1] FAO Food and Agriculture Organization of the united nations. Water for sustainable food and agriculture a report produced for the g20 presidency of germany. FAO - Food and Agriculture Organization of the united nations, 2017.

[2] Luiz F. P. Oliveira, Antnio P. Moreira, and Manuel F. Silva. Advances in agriculture robotics: A state-of-the-art review and challenges ahead. Robotics, 10(2), 2021.

[3] Qinghua Yang, Xiaoqiang Du, Zhiheng Wang, Zhichao Meng, Zenghong Ma, and Qin Zhang. A review of core agricultural robot technologies for crop productions. Computers and Electronics in Agriculture, 206:107701, 2023.

[4] Abhishek Thakur, Sangeeth Venu, and Muralimohan Gurusamy. An extensive review on agricultural robots with a focus on their perception systems. Computers and Electronics in Agriculture, 212:108146, 2023.

[5] Shantam Shorewala, Armaan Ashfaque, R. Sidharth, and Ujjwal Verma. Weed density and distribution estimation for precision agriculture using semi-supervised learning. IEEE Access, 9:27971–27986, 2021.

[6] D.C. Slaughter, D.K. Giles, and D. Downey. Autonomous robotic weed control systems: A review. Computers and Electronics in Agriculture, 61(1):63–78, 2008. Emerging Technologies For Real-time and Integrated Agriculture Decisions.

[7] Martin Sagayam Shibin David, R.S. Anand. Enhancing ai based evaluation for smart cultivation and crop testing using agro-datasets. Journal of Artificial Intelligence and Systems, 2020.

[8] Sandeep Pirbhulal, Wanqing Wu, Khan Muhammad, Irfan Mehmood, Guanglin Li, and Victor Hugo C. de Albuquerque. Mobility enabled security for optimizing iot based intelligent applications. IEEE Network, 34(2):72–77, 2020.

[9] Bright Keswani, Ambarish G. Mohapatra, Amarjeet Mohanty, Ashish Khanna, Joel J. P. C. Rodrigues, Deepak Gupta, and Victor Hugo C. de Albuquerque. Adapting weather conditions based iot enabled smart irrigation technique in precision agriculture mechanisms. Neural Computing and Applications, 31(1):277–292, Jan 2019.

[10] Alosio Vieira Lira Neto; Elias Paulino Medeiros; Filipe Maciel de Moura; Jose Wally Mendona Menezes; Senthil Kumar Jagatheesaperumal; Victor Hugo C. de Albuquerque. Analyzing the carro pipa operation with geointelligence techniques. Journal of Artificial Intelligence and Systems, 2020.

[11] Victor Alexander Murcia, Juan Felipe Palacios, and Giacomo Barbieri. Farmbot simulator: Towards a virtual environment for scaled precision agriculture. Springer International Publishing, pages 234–246, 2021.

[12] FarmBot. Plant designer. https://my.farm.bot/, 2023. Access: April 2024.

[13] Carlos J. Choque Moscoso, Erick M. Fiestas Sorogasta, and Ricardo S. Prado Gardini. Efficient implementation of a cartesian farmbot robot for agricultural applications in the region la libertad-peru. In 2018 IEEE ANDESCON, pages 1–6, 2018.

[14] Tianhai Wang, Bin Chen, Zhenqian Zhang, Han Li, and Man Zhang. Applications of machine vision in agricultural robot navigation: A review. Computers and Electronics in Agriculture, 198:107085, 2022.

[15] Sandro Augusto Magalh˜aes, Ant´onio Paulo Moreira, Filipe Neves dos Santos, and Jorge Dias. Active perception fruit harvesting robots — a systematic review. Journal of Intelligent & Robotic Systems, 105(1):14, May 2022.

[16] Gunasekaran Manogaran, Mamoun Alazab, Khan Muhammad, and Victor Hugo C. de Albuquerque. Smart sensing based functional control for reducing uncertainties in agricultural farm data analysis. IEEE Sensors Journal, 21(16):17469–17478, 2021.

[17] Johannes Kneip, Patrick Fleischmann, and Karsten Berns. Crop edge detection based on stereo vision. Robotics and Autonomous Systems, 123:103323, 2020.