A YOLO-based pest detection system for precision agriculture

Abstract

In this work, inspired by the needs of the H2020 European project PANTHEON for the precision farming of hazelnut orchards, we propose a data-driven pest detection system. Indeed, the early detection of pests represents an essential step towards the design of effective crop defense strategies in Precision Agriculture (PA) settings. Among the possible pests, we focus on true bugs as they can heavily compromise hazelnut production. To this aim, we collect a custom dataset in a realistic outdoor environment and train a You Only Look Once (YOLO)-based Convolutional Neural Network (CNN), achieving ≈ 94.5% average precision on a holdout dataset. We extensively evaluate the detector performance by also analyzing the influence of data augmentation techniques and of depth information. We finally deploy it on a NVIDIA Jetson Xavier on which it reaches ≈ 50 fps, enabling online processing on-board of any robotic platform.