A novel image measurement algorithm for common mushroom caps based on convolutional neural network

• Published in: Computers and electronics in agriculture Vol. 171; p. 105336
• Main Authors: Lu, Chuan-Pin, Liaw, Jiun-Jian
• Format: Journal Article
• Language: English
• Published: Amsterdam Elsevier B.V 01.04.2020; Elsevier BV
• Subjects: Agaricus bisporus; Algorithms; Apertures; Artificial intelligence; Artificial neural networks; Cameras; Color; Common mushroom; Convolutional neural network; Data analysis; Deviation; Diameters; farmers; fruiting; greenhouses; Hough transformation; Innovative cropping systems; Machine vision; Mathematical analysis; Microclimate; Mushrooms; Neural networks; Robustness; Innovative cropping systems; Common mushroom; Machine vision; Artificial intelligence; Convolutional neural network
• ISSN: 0168-1699; 1872-7107
• DOI: 10.1016/j.compag.2020.105336

•We proposed a novel image detection algorithm for the measurement of common mushroom images.•The algorithm did not require specific parameters.•Several experiments were conducted to validate the practicality of the algorithm.•The proposed method can be applied in monitor system of mushroom growth. In a mushroom greenhouse, for example, there are no sensors that can measure the diameter of clustered mushrooms, and farmers can only empirically estimate the relationship between the mushroom growth and greenhouse microclimate data. Our team developed an image measurement system that can record the circle diameter of Agaricus bisporus (hereinafter referred to as “common mushroom”) caps during the fruiting period. To continuously record the size of the mushroom caps for purpose-specific analysis (such as data analysis for optimized greenhouse microclimate control, calculation of growth rate, or harvest reminder), a new algorithm is proposed for calculating the diameter of the circle of round mushroom caps. This algorithm is used to estimate the mushroom circles using the images continuously captured by a camera and generate a growth record of the mushroom caps. The automatic adjustment of the camera aperture and focus during the growth of the mushroom results in a color deviation between images, which makes it difficult to detect the circles of the mushroom caps. The proposed algorithm is sufficiently robust to overcome the challenges presented by the color deviation in achieving accurate estimation. It is based on the identification results of the convolutional neural network and combines the innovative Score-Punishment (SP) algorithm in this study to calculate the circle diameter of the mushroom caps. The proposed algorithm outperformed the current Circle Hough Transform (OpenCV’s implementation). Besides, the proposed algorithm is more robust without the need to set parameters for the images of each time period, making it more feasible for practical application. In addition to describing the algorithm in detail, in this work, the effectiveness and practicality of the proposed algorithm through experiments were also verified.