引用本文:李会宾,史云,刘怀洋,王文昊,刘万福,杨鹏.基于Openpose改进的苹果生长方向检测[J].中国农业信息,2022,34(6):34-48
【打印本页】   【HTML】   【下载PDF全文】   查看/发表评论  【EndNote】   【RefMan】   【BibTex】
←前一篇|后一篇→ 过刊浏览    高级检索
本文已被:浏览 208次   下载 80 本文二维码信息
码上扫一扫!
分享到: 微信 更多
基于Openpose改进的苹果生长方向检测
李会宾1,史云1,刘怀洋2,王文昊1,刘万福2,杨鹏1,3
1.中国农业科学院农业资源与农业区划研究所,北京 100081;2.苏州大学机电工程学院,江苏苏州 215100;3.河海大学地球科学与工程学院,江苏南京 211100
摘要:
【目的】 苹果采摘机器人在果园作业过程中,不仅需要精准地确定果实的位置,还需要对苹果的生长方向进行精准检测,这样才能够实现机械爪规划出仿人式采摘的抓取方式,实现果实的高效采摘。【方法】 文章提出了一种基于改进Openpose的方法,实现了对自然生长状态下果实生长方向的精准检测。改进方案主要从两个方面进行,首选是通过ShuffleNet V2和CA注意力机制相融合的方式替换原VGG19结构,降低主干的参数量,然后是结合单个苹果关键点的特征对该模型进行了去除部分PAF分支的优化改进策略。【结果】 改进后的Openpose在各个指标上,全面超过了原Openpose,其运行速度是改进前的6.56倍,对于mAP、mAP-s、mAP-b、AP50和AP75这些参数,分别增长9.18%、8.50%、11.56%、1.67%和6.35%,并且在各项指标上超越了AlphaPose和CFA算法。【结论】 经过对Openpose模型改进前后的对比和现有算法对比,证明了该文算法在自然场景下对果实生长方向检测的优越性和鲁棒性。
关键词:  苹果  生长方向  Openpose  ShuffleNet V2,CA
DOI:10.12105/j.issn.1672-0423.20220604
分类号:
基金项目:国家成都农业科技中心地方财政专项(NASC2020AR01);2022年黑龙江揭榜挂帅项目:马铃薯绿色智慧服务平台开发及成果应用示范(2021ZXJ05A0504);2019年吉林联合基金:国家自然科学基金——区域创新发展联合基金(U19A2061)
Apple growth direction detection based on improved Openpose
Li Huibin1, Shi Yun1, Liu Huaiyang2, Wang Wenhao1, Liu Wanfu2, Yang Peng1,3
1.Institute of Agricultural Resources and Regional Planning,Chinese Academy of Agricultural Sciences,Beijing 100081,China;2.School of Mechanical and Electrical Engineering Soochow University,Suzhou,Jiangsu 215100,China;3.School of Earth Sciences and Engineering,Hohai University,Nanjing,Jiangsu 211100,China
Abstract:
Purpose The apple picking robot needs to accurately determine not only the position of the fruit but also the growth direction of the apple during the operation in the orchard,so that the mechanical claws can plan a human-like picking grasping method and realize the efficient picking of the fruit.Method The article proposes a method based on an improved Openpose to achieve accurate detection of the fruit growth direction in the natural growth state. The improvement scheme is mainly carried out in two aspects,the first choice is to replace the original VGG19 structure by the fusion of ShuffleNet V2 and CA attention mechanism to reduce the number of parameters of the backbone,and then the optimization improvement strategy of removing some PAF branches is carried out for this model by combining the characteristics of the key points of individual apples.Result The improved Openpose outperforms the original Openpose in all metrics,and its operation speed is 6.56 times faster than before the improvement,and for the parameters of mAP,mAP-s,mAP-b,AP50 and AP75,it increases by 9.18%,8.50%,11.56%,1.67% and 6.35%,respectively,and in all metrics outperformed the AlphaPose and CFA algorithms.Conclusion After comparing the Openpose before and after improvement with the existing algorithms,the superiority and robustness of this paper's algorithm for fruit growth direction detection in natural scenes are proved.
Key words:  apple  growth direction  Openpose  ShuffleNet V2  CA