An aerial framework for Multi-View grape bunch detection and route Optimization using ACO

• Published in: Computers and electronics in agriculture Vol. 221; p. 108972
• Main Authors: Ariza-Sentís, Mar, Vélez, Sergio, Baja, Hilmy, Valenti, Roberto G., Valente, João
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01.06.2024
• Subjects: agriculture; algorithms; Ant Colony Optimization; crop management; data collection; decision making; electronics; flight; Fruit detection; fruits; grapes; image analysis; Occlusions; Path Planning; pesticide application; precision agriculture; resource allocation; surveys; system optimization; UAV; Ant Colony Optimization; Fruit detection; UAV; Occlusions; Path Planning
• ISSN: 0168-1699; 1872-7107
• DOI: 10.1016/j.compag.2024.108972

•The framework enables enhanced UAV data acquisition for fruit detection purposes in vineyards considering the biophysical environment.•The optimization algorithm provides paths up to 24% shorter compared to conventional mission planners.•The proposed framework is designed for both single and multiple UAVs flying synchronously over the field.•The algorithm can be applied to woody crops other than vineyards trained in vertical trellis since they share similar biophysical characteristics and crop structures. Typically, commercial orchards and vineyards consist of large fields that encounter similar development phases at once. Thus, it becomes necessary to efficiently fly over all fields to detect fruit and identify their status in a very limited timeframe. For this purpose, Unmanned Aerial Vehicles (UAVs) path planning plays a pivotal role in agriculture as it enables optimal coverage of agricultural fields, leading to enhanced data acquisition and improved precision agriculture practices, for instance, disease assessment and pesticide application. In addition, deep learning techniques offer precise image analysis. On the one hand, object detection has been applied to agricultural fields to carry out a wide range of operations, such as detecting apples and predicting yield in vineyards, with higher detection accuracy when the fruits are fully visible. On the other hand, when crops present leaf-occlusion, the algorithms face difficulties and are unable to adapt to the specific characteristics of the field. Therefore, this study seeks to address this issue by developing a novel framework to enhance UAV path planning for data collection in vineyards, considering the current biophysical environment. To this end, the proposed framework requires two flights: i) a first flight (survey) to acquire insights on the crop structure and environment, and ii) a second flight using the Ant Colony Optimization Max-Min Ant System (ACO-MMAS) algorithm to enhance image acquisition by considering multiple angles to overcome partial leaf-occlusion. Further, the optimisation algorithm can potentially boost the acquisition of datasets for fruit detection by considering single and multiple UAVs flying synchronously while ensuring a safe distance between platforms and efficient coverage. The method was tested in two vineyards with different environmental characteristics, increasing levels of difficulty and acquired during two different growing seasons. It improved the length of the computed paths by up to 24%, compared to a base algorithm that considers only the closest point without any optimisation, improving the decision-making processes and resource allocation in crop management.