Comparison of convolutional neural networks in fruit detection and counting: A comprehensive evaluation

J. P. Vasconez, José Francisco Delpiano, S. Vougioukas, F. Auat Cheein

Research output: Contribution to journalArticlepeer-review

13 Scopus citations

Abstract

Knowing beforehand the amount of fruit to be harvested leads to better logistics and decisions making in the agricultural industry. In the last years, several sensors –mainly artificial vision systems– and sensing techniques have been proposed to address the fruit counting problem with sundry results. Convolutional neural networks (CNN) arise as the current trend in processing imagery information, due to their adaptability and efficiency in object detection. However, there is still missing an insightful analysis of the usability of such technique in fruit counting problems in groves, since the learning process is sensitive to the training input data, the sensor (affected by environmental conditions) and the architecture chosen to process the imagery set. Therefore, in this work we test two of the most common architectures: Faster R-CNN with Inception V2 and Single Shot Multibox Detector (SSD) with MobileNet. These detection architectures were trained and tested on three fruits: Hass avocado and lemon (both from Chile), and apples (from California - USA), under different field conditions. To address the problem of video-based fruit counting, we use multi-object tracking based on Gaussian estimation. Our system achieves fruit counting performances up to 93% (overall for all fruits) using Faster-RCNN with Inception V2, and 90% (overall for all fruits) using SSD with MobileNet. Such results can lead to further improve the decision making process in agricultural practices.

Original languageEnglish
Article number105348
JournalComputers and Electronics in Agriculture
Volume173
DOIs
StatePublished - Jun 2020
Externally publishedYes

Bibliographical note

Funding Information:
The authors acknowledge the support provided by Universidad Técnica Federico Santa María. This work was supported in part by the Advanced Center of Electrical and Electronic Engineering - AC3E (CONICYT/FB0008), DGIIP-PIIC-UTFSM Chile, CONICYT PFCHA/DOCTORADO BECAS CHILE/2018–21180513. This work was also supported in part by FONDECYT 1171431; UANDES - Fondo de Ayuda a la Investigacion (FAI) INV-IN-2017–05.

Funding Information:
The authors acknowledge the support provided by Universidad T?cnica Federico Santa Mar?a. This work was supported in part by the Advanced Center of Electrical and Electronic Engineering - AC3E (CONICYT/FB0008), DGIIP-PIIC-UTFSM Chile, CONICYT PFCHA/DOCTORADO BECAS CHILE/2018?21180513. This work was also supported in part by FONDECYT 1171431; UANDES - Fondo de Ayuda a la Investigacion (FAI) INV-IN-2017?05.

Publisher Copyright:
© 2020 Elsevier B.V.

Keywords

  • Faster R-CNN
  • Fruit counting
  • Multi-object tracking
  • Precision agriculture
  • Single shot multibox detector

Fingerprint

Dive into the research topics of 'Comparison of convolutional neural networks in fruit detection and counting: A comprehensive evaluation'. Together they form a unique fingerprint.

Cite this