HUBEI AGRICULTURAL SCIENCES ›› 2024, Vol. 63 ›› Issue (8): 39-46.doi: 10.14088/j.cnki.issn0439-8114.2024.08.008

• Image and Graphic Recognition • Previous Articles     Next Articles

Identification of branches of fruit trees and determination of coordinates of pruning points

SONG Zhen-shuai1, ZHOU Yan2, ZHONG Ling2, YI Jie1, SONG Long2, HE Lei2   

  1. 1. School of Aeronautical Engineering, Jiangsu Aviation Technical College, Zhenjiang 212134, Jiangsu, China;
    2. Institute of Machinery and Equipment, Xinjiang Academy of Agricultural and Reclamation Science, Shihezi 832000, Xinjiang, China
  • Received:2022-09-13 Online:2024-08-25 Published:2024-09-05

Abstract: In order to realize the pruning recognition of dormant fruit trees, a network model based on semantic segmentation was studied to identify pruned branches and determine the coordinates of pruning points. A binocular camera was used to build a visual system to obtain the data set of fruit trees. VGG16 and RestNet-50, which were respectively integrated with pre-training weights and CBAM (attention mechanism), were used as two deep learning models of U-Net backbone feature extraction network to segment pruned branches. At the same time, their effects were obtained and compared. Based on the obtained segmented image, two methods, skeleton extraction and pruning point clustering, were used to determine the coordinates of pruning points. The results showed that the U-Net model based on VGG16 feature extraction network had better recognition results. The mean intersection over union (MIOU), mean pixel accuracy (MPA) and F scores during the training of the model were 84.80%, 91.83% and 92.679% respectively. By segmenting the model image of artificial simulated fruit trees and using the pruning point clustering method, the two-dimensional coordinates of pruning points could be determined quickly and in real time, which laid the foundation for pruning operations.

Key words: branches identification, coordinates of pruning points, extraction, pre-training weight, CBAM(attention mechanism)

CLC Number: