Comprehensive Analysis of Model Errors in Blueberry Detection and Maturity Classification: Identifying Limitations and Proposing Future Improvements in Agricultural Monitoring

• Published in: Agriculture (Basel) Vol. 14; no. 1; p. 18
• Main Authors: Aguilera, Cristhian A., Figueroa-Flores, Carola, Aguilera, Cristhian, Navarrete, Cesar
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 01.01.2024
• Subjects: Agricultural industry; Agriculture; Berries; Blueberries; blueberry detection; Classification; computer vision; Computers; Datasets; Deep learning; Detectors; Edge computing; Embedded systems; Error analysis; Error detection; farming systems; farms; Fruit industry; Fruits; Harvesting; Labeling; Machine learning; Maturity; maturity estimation; Model accuracy; model validation; monitoring; Object recognition; Optimization techniques; Photographic industry; robots; smart agriculture; tides; Japan
• ISSN: 2077-0472; 2077-0472
• DOI: 10.3390/agriculture14010018

In blueberry farming, accurately assessing maturity is critical to efficient harvesting. Deep Learning solutions, which are increasingly popular in this area, often undergo evaluation through metrics like mean average precision (mAP). However, these metrics may only partially capture the actual performance of the models, especially in settings with limited resources like those in agricultural drones or robots. To address this, our study evaluates Deep Learning models, such as YOLOv7, RT-DETR, and Mask-RCNN, for detecting and classifying blueberries. We perform these evaluations on both powerful computers and embedded systems. Using Type-Influence Detector Error (TIDE) analysis, we closely examine the accuracy of these models. Our research reveals that partial occlusions commonly cause errors, and optimizing these models for embedded devices can increase their speed without losing precision. This work improves the understanding of object detection models for blueberry detection and maturity estimation.