Welcome to Francis Academic Press

Academic Journal of Computing & Information Science, 2019, 2(1); doi: 10.25236/AJCIS.010027.

Design and Implementation of Gesture Recognition Manipulator Control System


Kui Xue1, Xin Liu2 and Jiatong Chen3

Corresponding Author:
Kui Xue

1 Hebei University of Technology, Tianjin, 300401, China
2 Institute of Technology, Tibet University, Tibet, Lhasa, 850000, China
3 College of Aeroengine, Shenyang Aerospace University, Liaoning, Shenyang, 110136, China


With the rapid development of information technology, robot technology has matured and is widely used in military, industrial, agricultural, medical, scientific research and other fields, covering all aspects of people's lives.  Remote control robots can replace humans in the harsh environment, so the development potential is huge. This paper designed a robotic arm control system built on a mobile platform.  Using the Leap Motion infrared gesture sensor for real-time hand motion acquisition, the computer's PC software Processing captures the gestures by calling the relevant library functions, and transmits the data to the Arduino control via WiFi. The board, thereby achieving gesture control of the robot arm.  The robotic arm is built on a mobile cart with a camera remotely controlled by an Android phone, enabling a variety of remote capture tasks.  The experimental results show that the gesture control robot based on mobile platform has flexible movement, convenient control and wide application fields.


Robotic arm, PC software, gesture recognition, mobile platform

Cite This Paper

Kui Xue, Xin Liu and Jiatong Chen, Design and Implementation of Gesture Recognition Manipulator Control System. Academic Journal of Computing & Information Science (2019) Vol. 2: 138-141. https://doi.org/10.25236/AJCIS.010027.


[1] Yuan Jie, Han Bo, Li Ping. Design and Application of Barometer Altimeter System Based on 89C52 [J]. Mechanical & Electrical Engineering, 2005, 22 (10): 30-34.
[2] Lü Youwei, Xu Jianming, Chen Yuming. Electronic clock design based on single chip microcomputer [J]. Electronic World, 2016 (9): 31.
[3] Lu Rong. Liquid crystal display (LCD) display driving principle and its application [J]. Electronics Production, 2005 (5): 51-52.
[4] Huang Xu. Interface implementation of MDLS dot matrix character liquid crystal display module and DSP chip AD⁃SP2106X [J]. Electronic Technology, 2000 (2): 59-61.
[5] WANG Xiaohua, ZHANG Yongmei. Principle and application of single chip microcomputer [M]. Beijing: Beijing Jiaotong University Press, 2007.
[6] PENG Wei. 100 cases of C language programming for SCM based on 8051 + Proteus simulation [M]. Beijing: Publishing House of Electronics Industry, 2012.
[7] LI Xuefen. KEIL and Proteus software SCM simulation teaching [J]. Equipment manufacturing technology, 2012 (3): 49-50.
[8] ZHENG Chunlai, HAN Tuanjun, LI Xin. The application of simulation software Keil in teaching process of MCU course [J]. Higher education forum, 2009 (12): 96-97.
[9] AN Zongquan, WANG Yunxiang. Research of PCB employed in MCU application system [J]. Journal of Anhui Institute of Mechanical & Electrical Engineering, 2002, 17 (3): 34-37.