融合人体关节点的安全帽佩戴检测

doi:10.16265/j.cnki.issn1003-3033.2020.02.028

中国安全科学学报 ›› 2020, Vol. 30 ›› Issue (2): 177-182.doi: 10.16265/j.cnki.issn1003-3033.2020.02.028

融合人体关节点的安全帽佩戴检测

张博¹, 宋元斌¹ 高级工程师, 熊若鑫¹, 张世超²

1.上海交通大学船舶海洋与建筑工程学院,上海 200240;
2.上海外高桥造船有限公司,上海 200137

收稿日期:2019-11-10 修回日期:2020-01-10 出版日期:2020-02-28
作者简介:张博(1996—),男,四川郫县人,硕士研究生,主要研究方向为工程安全。机器视觉。E-mail:405648708@qq.com。
基金资助:
企事业单位委托项目(SGTYHT/16-JS-200)。

Helmet-wearing detection considering human joint

ZHANG Bo¹, SONG Yuanbin¹, XIONG Ruoxin¹, ZHANG Shichao²

1. School of Naval Architecture, Ocean & Civil Engineering, Shanghai Jiao Tong University, Shanghai 200240, China;
2. Shanghai Waigaoqiao Shipbuilding Co.Ltd, Shanghai 200137, China

Received:2019-11-10 Revised:2020-01-10 Published:2020-02-28

摘要/Abstract

摘要： 针对已有安全帽佩戴检测模型需求样本数据量大、易产生误检的问题,提出一种结合人体关节点检测和Faster R-CNN的安全帽佩戴检测模型;通过OpenPose从图像中定位人体头颈部位置并自动截取其周围小范围的子图像,然后利用Faster R-CNN检测子图像中的安全帽,最后分析安全帽中心点和头颈部节点之间的空间关系,进而判别是否正确佩戴安全帽。结果表明:相比传统目标检测方法,提出的增强检测方法有效降低了误检率,提高了环境适应性,同时,该方法在训练样本量较小时,召回率提高超过20%,准确率提高约10%,很大程度上减少了对训练样本的需求。

关键词: 安全帽佩戴检测, 人体关节点, Faster R-CNN, 子图像, 空间关系

Abstract: In order to address flaws of existing helmet-wearing detection model, such as its requirement of large sample data and inclination to false detection, a new detection model was proposed that combined human joint detection and Faster R-CNN. Then, OpenPose was utilized to locate positions of head and neck joints, and sub-image of small areas near helmet was extracted before it was detected with Faster R-CNN. Finally, spatial relationship between helmet and head/neck joints were analyzed to further verify whether it was worn correctly. The results show that this enhanced method can reduce error rate and improve its environmental adaptation effectively. And even with small sample data, its recall rate increases by more than 20% and detection accuracy by approximately 10%, significantly reducing demand on samples.

Key words: helmet-wearing detection, human joint, Faster R-CNN, sub-image, spatial relationship

中图分类号:

X910

张博, 宋元斌, 熊若鑫, 张世超. 融合人体关节点的安全帽佩戴检测[J]. 中国安全科学学报, 2020, 30(2): 177-182.

ZHANG Bo, SONG Yuanbin, XIONG Ruoxin, ZHANG Shichao. Helmet-wearing detection considering human joint[J]. China Safety Science Journal, 2020, 30(2): 177-182.

参考文献 16

[1]	边星, 晋良海, 陈雁高, 等. 施工作业人员佩戴安全帽行为意向研究[J]. 中国安全科学学报, 2016,26(11): 43-48.BIAN Xing, JIN Lianghai, CHEN Yan'gao, et al. Research on workers' behavioral intention of wearing safety helmet [J]. China Safety Science Journal, 2016, 26(11): 43-48.
[2]	RUBAIYAT A H M, TOMA T T, KALANTARI-KHANDANI M, et al. Automatic detection of helmet uses for construction safety [C]. 2016 IEEE/WIC/ACM International Conference on Web Intelligence Workshops (WIW), 2017: 135-142.
[3]	FELZENSZWALB P, MCALLESTER D, RAMANAN D. A discriminatively trained, multiscale, deformable part model [C]. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2008: 1-8.
[4]	REDMON J, DIVVALA S, GIRSHICK R, et al. You only look once: unified, real-time object detection [C]. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016: 779-788.
[5]	LIU Wei, ANGUELOV D, ERHAN D, et al. SSD: single shot multibox detector [C]. European Conference on Computer Visio(ECCV), 2016: 21-37.
[6]	方明,孙腾腾,邵桢.基于改进YOLOv2的快速安全帽佩戴情况检测[J]. 光学精密工程, 2019,27(5): 1 196-1 205.FANG Ming, SUN Tengteng, SHAO Zhen. Fast helmet-wearing-condition detection based on improved YOLOv2 [J]. Optics and Precision Engineering, 2019,27(5): 1 196-1 205.
[7]	施辉,陈先桥,杨英.改进YOLO v3的安全帽佩戴检测方法[J].计算机工程与应用,2019,55(11): 213-220.SHI Hui, CHEN Xianqiao, YANG Ying. Safety helmet wearing detection method of improved YOLOv3 [J]. Computer Engineering and Applications, 2019,55(11): 213-220.
[8]	GIRSHICK R. Fast R-CNN [C]. The IEEE International Conference on Computer Vision (ICCV), 2015: 1 440-1 448.
[9]	REN S, HE K, GIRSHICK R, et al. Faster R-CNN: towards real-time object detection with region proposal networks [J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2017,39(6): 1 137-1 149.
[10]	桑农, 倪子涵. 复杂场景下基于R-FCN的手势识别[J]. 华中科技大学学报:自然科学版, 2017,45(10): 54-58.SANG Nong, NI Zihan. Gesture recognition based on R-FCN in complex scenes [J].Journal of Huazhong University of Science and Technology:Natural Science Edition, 2017,45(10): 54-58.
[11]	徐守坤, 王雅如, 顾玉宛, 等. 基于改进FasterRCNN的安全帽佩戴检测研究[J]. 计算机应用研究, 2019,37(3): 1-6.XU Shoukun,WANG Yaru, GU Yuwan, et al. Safety helmet wearing detection study based on improved faster R-CNN [J]. Application Research of Computers, 2019,37(3): 1-6.
[12]	XIONG Ruoxin, SONG Yuanbin, LI Heng, et al. Onsite video mining for construction hazards identification with visual relationships [J]. Advanced Engineering Informatics, 2019, 42: 100966.
[13]	CAO Zhe, TOMAS S, WEI S E, et al. Realtime multi-person 2dpose estimation using part affinity fields [J]. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017: 7 291-7 299.
[14]	熊若鑫, 宋元斌, 王宇轩. 基于DNN的作业姿势评估方法及应用[J]. 中国安全科学学报, 2018,28(5): 105-110.XIONG Ruoxin, SONG Yuanbin, WANG Yuxuan. Deep neural network based posture assessment method andits application [J]. China Safety Science Journal, 2018,28(5): 105-110.
[15]	HE Kaiming, ZHANG Xiangyu, REN Shaoqing, et al. Deep residual learning for image recognition [J]. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016: 770-778.
[16]	BYEON Y H, KWAK K C. A performance comparison of pedestrian detection using faster R-CNN and ACF[C]. International Congress on Advanced Applied Informatics,2017: 858-863.

融合人体关节点的安全帽佩戴检测

Helmet-wearing detection considering human joint

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献 16

相关文章 9

编辑推荐

Metrics

本文评价

[1]	俞进, 唐建华, 神祥凯, 刘金海. 基于Faster R-CNN的海底管道智能检测方法[J]. 中国安全科学学报, 2023, 33(6): 80-87.
[2]	范冰倩, 董秉聿, 王彪, 李铭, 吴松, 佟瑞鹏. 基于深度学习的地铁施工作业人员不安全行为识别与应用[J]. 中国安全科学学报, 2023, 33(1): 41-47.
[3]	赵江平, 徐恒, 党悦悦. 基于改进Faster R-CNN的铁路客车螺栓检测研究[J]. 中国安全科学学报, 2021, 31(7): 82-89.
[4]	柳承徽, 陈先锋, 张威, 徐乐先, 赵齐, 黄楚原. 基于PIV的气动式细水雾流场研究[J]. 中国安全科学学报, 2020, 30(7): 120-126.
[5]	张威, 张英, 李常委, 苑大超. 基于PIV的不同受限形式下火羽流流场特性研究[J]. 中国安全科学学报, 2020, 30(6): 135-141.
[6]	赵欣然, 张琪, 王卫东, 徐志强. 可燃性粉尘云的图像检测方法[J]. 中国安全科学学报, 2020, 30(4): 8-13.
[7]	林家泉, 孙凤山, 李亚冲. 客舱内呼吸道病原体传播机制与感染风险评估[J]. 中国安全科学学报, 2020, 30(2): 146-151.
[8]	张小良, 叶圣军, 刘晓晨, 李浩, 杨璐颖. 水平管道弱激波扬起沉积粉尘运动特征研究[J]. 中国安全科学学报, 2019, 29(1): 55-61.
[9]	徐晟, 倪清清. 跨省承包对施工安全状况演变的影响研究[J]. 中国安全科学学报, 2018, 28(9): 103-108.