论文标题
农业领域中联合语义,植物实例和叶子实例分割的分层方法
Hierarchical Approach for Joint Semantic, Plant Instance, and Leaf Instance Segmentation in the Agricultural Domain
论文作者
论文摘要
植物表型是农业的核心任务,因为它描述了植物的生长阶段,发育和其他相关数量。机器人可以通过准确估计植物特征(例如叶子,叶子面积和植物尺寸)来帮助自动化这一过程。在本文中,我们解决了RGB数据中农作物场的联合语义,植物实例和叶片实例分割的问题。我们提出了一个单一的卷积神经网络,该网络同时解决了这三个任务,从而利用了它们的基本层次结构。我们介绍了特定于任务的跳过连接,我们的实验评估被证明比通常的方案更有益。我们还提出了一种新型的自动后处理,该过程明确解决了空间关闭实例的问题,该问题由于叶子重叠而在农业领域中常见。我们的建筑同时在农业背景下共同解决这些问题。以前的作品要么侧重于植物或叶片分割,要么不优化语义分割。结果表明,与最先进的方法相比,我们的系统的性能优越,同时具有减少的参数,并且以相机框架的速度运行。
Plant phenotyping is a central task in agriculture, as it describes plants' growth stage, development, and other relevant quantities. Robots can help automate this process by accurately estimating plant traits such as the number of leaves, leaf area, and the plant size. In this paper, we address the problem of joint semantic, plant instance, and leaf instance segmentation of crop fields from RGB data. We propose a single convolutional neural network that addresses the three tasks simultaneously, exploiting their underlying hierarchical structure. We introduce task-specific skip connections, which our experimental evaluation proves to be more beneficial than the usual schemes. We also propose a novel automatic post-processing, which explicitly addresses the problem of spatially close instances, common in the agricultural domain because of overlapping leaves. Our architecture simultaneously tackles these problems jointly in the agricultural context. Previous works either focus on plant or leaf segmentation, or do not optimise for semantic segmentation. Results show that our system has superior performance compared to state-of-the-art approaches, while having a reduced number of parameters and is operating at camera frame rate.