Welcome to Francis Academic Press

Academic Journal of Computing & Information Science, 2023, 6(4); doi: 10.25236/AJCIS.2023.060407.

Research on Miners' Human Posture Detection Algorithm Based on MMPose

Author(s)

Tiantong Zhao

Corresponding Author:
Tiantong Zhao
Affiliation(s)

Department of Electrical and Electronic Engineering, School of Engineering, University of Manchester, Manchester, The UK

Abstract

With the continuous improvement of intelligence in the coal industry, intelligent video analysis and judgment of dangerous behaviors that have occurred can no longer meet the needs of human posture detection in underground mines. In this paper, a human posture detection algorithm based on MMPose is proposed to determine the body posture of personnel under the mine at different times, in order to provide effective information for standardizing miner operations, disaster early warning, and accident rescue. The algorithm is based on MMPose technology, which improves and optimizes the existing shortcomings, facilitating the determination of the body posture of underground personnel at different times, and solving the low accuracy issues of occlusion image detection, multi-person image detection, and dark environment detection. The designed algorithm achieves labeling of 17 key points such as eyes, nose, ears, shoulders, elbows, hands, legs, knees, and feet, and can detect various postures such as standing upright, standing sideways, sitting, squatting, and walking. Experiments have shown that this algorithm has a high accuracy in human posture detection and prediction, and can better mark the key points of the human body for occluded images, multi-person images, and dark environments, meeting the real-time requirements of underground personnel posture detection.

Keywords

Human posture estimation; Machine vision; Key point detection

Cite This Paper

Tiantong Zhao. Research on Miners' Human Posture Detection Algorithm Based on MMPose. Academic Journal of Computing & Information Science (2023), Vol. 6, Issue 4: 57-62. https://doi.org/10.25236/AJCIS.2023.060407.

References

[1] Liu Hao, Liu Haibin, Sun Yu, et al. Intelligent recognition system of unsafe behavior of underground coal miners [J]. Journal of China Coal Society, 2021, (S02): 1159-1169.

[2] Redmon J, Divvala S, Girshick R, et al. You Only Look Once: Unified, Real-Time Object Detection [C]. IEEE Conference on Computer Vision and Pattern Recognition, 2016: 779-788. DOI: 10. 1109/ CVPR. 2016.91.

[3] Zheng L L, Huang X P, Liang R H. Human posture recognition method based on SVM[J]. Jounrnal of Zhejiang University of Technology, 2012, 40(6): 670-675, 691.

[4] He J Y. Teaching Research and Reform of Data Structure Course in Application-oriented Universities [J]. Computer Knowledge and Technology, 2021, 17(21): 108-110.

[5] Ren S, Girshick R, et al. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks [J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2017, 39(6): 1137-1149. 

[6] Kocabas, Muhammed and Karagoz, Salih and Akbas, et al. Multi Pose Net: Fast MultiPerson Pose Estimation using Pose Residual Network [C]. European Conference on Computer vision, 2018: 417-433. 

[7] Chen C Q, Jiang L, Wang H. Gait prediction method of lower extremity exoskeleton based on SAE and LSTM neural network [J]. Computer Engineering and Applications, 2019, 55(12): 110-116.

[8] J. Redmon, A. Farhadi. YOLOv3: An incremental improvemen, 2018. Available from: https: // doi. org/ 10.48550/arXiv.1804.02767.

[9] Wei F F. Action Recognition Algorithm Based on Human Pose Estimation [D]. Graduate School of National University of Defense Technology, 2018.

[10] Cao Z, Hidalgo G, Simon T, Wei S E, Sheikh Y. Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields[C]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2021, 43(1): 172-186. DOI: 10.1109/TPAMI.2019.2929257.

[11] Xu Z Q. Real-Time Human Poseure Estimation System Based On Deep Learning Study [D]. Yanshan University, 2019.

[12] Qian Z H, Gao L Q, Ye S. Method for detection of a student’s pose in a multi-scene classroom based on meta-learning [J]. Jounrnal of Xidian University, 2021, 48(5): 58-67.

[13] Cao Y Z, Cai W C, Cheng Y. Body Posture Detection Technique Based on MEMS Acceleration Sensor [J]. Nanotechnology and Precision Engineering, 2010, 8(01): 37-41.

[14] Cai Z D, Ying N, Guo C S, et al. Research on multiperson pose estimation combined with YOLOv3 pruning model. Journal of Image and Graphics, 2021, 26(04): 0837-0846.

[15] Dixe Sandra et al. Optimized in-vehicle multi person human body pose detection [J]. Procedia Computer Science, 2022, 204: 479-487.

[16] Christoph Heindl et al. Large Area 3D Human Pose Detection Via Stereo Reconstruction in Panoramic Cameras, 2019. Available from: https://doi.org/10.48550/arXiv.1907.00534.

[17] Li X O, et al. Human Posture Detection Method Based on Wearable Devices. [J]. Journal of healthcare engineering, 2021, (4): 1-8.

[18] Lu Y K. Joint Human Parsing and Pose Estimation [D]. Dalian University of Technology, 2020.

[19] Sheng Y, Wang J Q. Research on Human Posture Recognition Based on Computer Vision [J]. Modern Information Technology, 2022, 6(16): 87-91+95.

[20] Bourdevl, Majis, Broxt, et al. Detecting people using mutually consistent poselet activations[C]. European Conference on Computer Vision, 2010: 168-181.