DEVELOPMENT OF A WIRELESS HUMAN HAND GESTURE CONTROLLED ROBOTIC ARM

M. Chaitanya Reddy 1*; G. Sudharsan Reddy 2

doi:10.5281/zenodo.23039002

Abstract

Human-robot interaction has become increasingly important in modern automation, requiring systems that are
intuitive, flexible, and efficient. This paper presents the design implementation of a Wireless Human Hand Gesture
Controlled Robotic Arm that enables natural and contactless communication between humans and machines. The
proposed system utilizes advancements in computer vision, embedded system, and wireless communication to
overcome the limitations of traditional robotic control methos such as wired interfaces and joysticks. The system
uses a Raspberry pi as the main processing unit, where a USB wed camera captures a real-time video of hand
gestures. Image processing and computer vision algorithms are applied to analyze the captured frames, detect
hand movements, and accurately classify different gestures. These gestures are then mapped to predefined
commands that correspond to specific movements of robotic arm and mobile platform. Once hand gestures are
recognized, the control commands are transmitted wirelessly using Zigbee modules to Arduino-based robotic
system. The Arduino receives the signals and processes them to generate appropriate control outputs. These
outputs are sent to motor drivers, which control the DC motors and servo motors responsible for the movement
of the robotic arm and navigation of the root base. The proposed system eliminates the need for physical
controllers or wearable devices, thereby improving user comfort and reducing system complexity. It provides realtime responsiveness, reliable wireless communication, and efficient gesture recognition, the system demonstrates
effective performance and is suitable for various applications such as industrial automation, assistive technologies,
and operations in hazardous environments where direct human interaction is limited.

Keywords

Robotic Arm, Wireless Human Hand Gesture, Raspberry pi, USB wed camera, Zigbee, Arduino, DC motors, Servo motors.

References

1) [Zhang, G., Su, J., Zhang, S., Qi, J., Hou, Z., & Lin, Q. (2025). Research on deep learning-based
human–robot static/dynamic gesture-driven control framework. Sensors, 25(23), 7203.
https://doi.org/10.3390/s25237203
2) Xie, J., Xu, Z., Zeng, J., Gao, Y., & Hashimoto, K. (2025). Human–robot interaction using dynamic hand
gesture for teleoperation of quadruped robots with a robotic arm. Electronics, 14(5), 860.
https://doi.org/10.3390/electronics14050860
3) Liang, B., Li, N., Li, G., Huang, J., Yu, Z., & Zhao, X. (2026). Sensing technologies for hand gesture
recognition in human–robot interaction: A review. IEEE Sensors Journal, 26(2), 1501–1519.
https://doi.org/10.1109/JSEN.2025.3635622
4) Qi, J., Ma, L., Cui, Z., et al. (2024). Computer vision-based hand gesture recognition for human-robot
interaction: A review. Complex & Intelligent Systems, 10, 1581–1606. https://doi.org/10.1007/s40747-
023-01173-6
5) Reinschmidt, E., Vogt, C., & Magno, M. (2022). Realtime hand-gesture recognition based on novel
charge variation sensor and IMU. In 2022 IEEE Sensors, Dallas, TX, USA, pp. 1–4.
https://doi.org/10.1109/SENSORS52175.2022.9967346
6) Zhu, Y., Yang, Z., & Yuan, B. (2013). Vision based hand gesture recognition. In 2013 International
Conference on Service Sciences (ICSS), Shenzhen, China, pp. 260–265.
https://doi.org/10.1109/ICSS.2013.40
7) Raj, R., & Kos, A. (2024). Study of human–robot interactions for assistive robots using machine learning
and sensor fusion technologies. Electronics, 13(16), 3285. https://doi.org/10.3390/electronics13163285
8) Zhu, W., Liu, L., Yin, S., Hu, S., Tang, E. Y., & Wei, S. (2014). Motion-sensor fusion-based gesture
recognition and its VLSI architecture design for mobile devices. International Journal of Electronics,
101(5), 621–635. https://doi.org/10.1080/00207217.2013.794482
9) Bluetooth Special Interest Group. (2024). Bluetooth Core Specification Version 6.0. Bluetooth SIG.
10) IEEE. (2025). IEEE Standard for Information Technology—Telecommunications and Information
Exchange between Systems Local and Metropolitan Area Networks—Specific Requirements Part 11:
Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) Specifications (IEEE 802.11-
2024).
11) Connectivity Standards Alliance. (2023). Zigbee Specification, Revision 23. Connectivity Standards
Alliance.
12) Ahmed, S., Kallu, K. D., Ahmed, S., & Cho, S. H. (2021). Hand gestures recognition using radar sensors
for human-computer-interaction: A review. Remote Sensing, 13(3), 527.
https://doi.org/10.3390/rs13030527
13) Beeri, E. B., Nissinman, E., & Sintov, A. (2024). Robust dynamic gesture recognition at ultra-long
distances. arXiv. https://doi.org/10.48550/arXiv.2411.18413
14) Montazerin, M., Zabihi, S., Rahimian, E., Mohammadi, A., & Naderkhani, F. (2022). ViT-HGR: Vision
transformer-based hand gesture recognition from high density surface EMG signals. In 2022 44th AnnualInternational Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Glasgow,
Scotland, UK, pp. 5115–5119. https://doi.org/10.1109/EMBC48229.2022.9871489
15) M. K., S., V., V., M., A., Mer, V. H., & M., D. (2022). Wireless gesture controlled robotic arm. In 2022
IEEE North Karnataka Subsection Flagship International Conference (NKCon), Vijaypur, India, pp. 1–
6. https://doi.org/10.1109/NKCon56289.2022.10126678
16) Singh, R. K., Sarkar, A., Chakravarty, D., Goyal, P., Lodhi, V., & Sharma, A. (2015). Bluetooth
communication controlled robot based on gesture recognition. In 2015 IEEE International
Transportation Electrification Conference (ITEC), Chennai, India, pp. 1–5.
https://doi.org/10.1109/ITEC-India.2015.7386937
17) Louzir, A., Haskou, A., & Pesin, A. (2021). A simple RF-based solution for gesture recognition. In 2021
IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, NV, USA, pp. 1–5.
https://doi.org/10.1109/ICCE50685.2021.9427740
18) Miron, C., Pasarica, A., Costin, H., Manta, V., Timofte, R., & Ciucu, R. (2019). Hand gesture recognition
based on SVM classification. In 2019 E-Health and Bioengineering Conference (EHB), Iasi, Romania,
pp. 1–6. https://doi.org/10.1109/EHB47216.2019.8969921
19) Yuan, X., Liang, N., Fu, W., Wang, Q., Zhang, Y., Cao, J., Liu, H., Liu, K., Huang, Y., & Ren, X. (2023).
A wearable gesture recognition system with ultrahigh accuracy and robustness enabled by the synergy
of multiple fabric sensing devices. IEEE Sensors Journal, 23(10), 10950–10958.
https://doi.org/10.1109/JSEN.2023.3265775