Call for Paper - Upcoming Issues

Design and Implementation of a Gesture and Voice Controlled Car

International Journal of Computer Science and Engineering
© 2025 by SSRG - IJCSE Journal
Volume 12 Issue 4
Year of Publication : 2025
Authors : Kaushalya Thopate, Kshitij Bhutada, Ninad Bodade, Abhijeet Rajguru, Sarthak Bhangare, Akshat Yadav
10.14445/23488387/IJCSE-V12I4P102

pdf
How to Cite?

Kaushalya Thopate, Kshitij Bhutada, Ninad Bodade, Abhijeet Rajguru, Sarthak Bhangare, Akshat Yadav, "Design and Implementation of a Gesture and Voice Controlled Car," SSRG International Journal of Computer Science and Engineering , vol. 12,  no. 4, pp. 9-16, 2025. Crossref, https://doi.org/10.14445/23488387/IJCSE-V12I4P102

Abstract:

The study investigates the design of a cutting-edge voice-activated and gesture-controlled driverless vehicle. The system uses an HC-05 Bluetooth module to listen to spoken commands, an ADXL335 accelerometer to detect gesture-based inputs and an Arduino Nano microcontroller as the processing center. The 4WD-chassis robotic car features an L298 motor driver for precise motor control. An ultrasonic sensor is integrated for enhanced functionality and safety, detecting real-time impediments to prevent collisions and enable seamless operation. While speech commands are processed by the HC-05 module and converted into directional commands, gesture-based control uses tilt data from the ADXL335 sensor to regulate the car's movement. An RF receiver and transmitter are also integrated to increase the system's adaptability further and enable remote communication.

Keywords:

Bluetooth module, Gesture-controlled, HC-05 module, RF receiver and transmitter, Voice-activated.

References:

[1] Lisang Liu et al., “Design and Realization of Intelligent Voice-Control Car Based on Raspberry Pi,” Advances in Smart Vehicular Technology, Transportation, Communication and Applications, vol. 128, pp. 87-95, 2018.
[CrossRef] [Google Scholar] [Publisher Link]
[2] Sebastian Loehmann et al., “Culturally Independent Gestures for In-Car Interactions,” Human-Computer Interaction – INTERACT, vol. 8119, pp. 538-545, 2013.
[CrossRef] [Google Scholar] [Publisher Link]
[3] Fabio Manganaro et al., “Hand Gestures for the Human-Car Interaction: The Briareo Dataset,” Image Analysis and Processing, vol. 11752, pp. 560-571, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[4] Pavlo Molchanov et al., “Hand Gesture Recognition with 3D Convolutional Neural Networks,” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1-7, 2015.
[Google Scholar] [Publisher Link]
[5] Guido Borghi et al., “Hands on the Wheel: A Dataset for Driver Hand Detection And Tracking,” 13th IEEE International Conference on Automatic Face & Gesture Recognition, Xi'an, China, pp. 564-570, 2018.
[CrossRef] [Google Scholar] [Publisher Link]
[6] Pavlo Molchanov et al., “Online Detection and Classification of Dynamic Hand Gestures with Recurrent 3D Convolutional Neural Network,” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4207-4215, 2016.
[Google Scholar] [Publisher Link]
[7] “Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) Specification,” IEEE Standard, vol. 12, no. 11, pp. 260 280, 1997.
[Google Scholar]
[8] Giulio Marin, Fabio Dominio, and Pietro Zanuttigh, “Hand Gesture Recognition with Leap Motion and Kinect Devices,” IEEE International Conference on Image Processing, Paris, France, pp. 1565-1569, 2014.
[CrossRef] [Google Scholar] [Publisher Link]
[9] Martin Zobl et al., “Gesture Components for Natural Interaction with In-Car Devices,” Gesture-Based Communication in Human Computer Interaction, vol. 2915, pp. 448-459, 2003.
[CrossRef] [Google Scholar] [Publisher Link]
[10] Frank Althoff et al., “Evaluating Multimodal Interaction Patterns in Various Application Scenarios,” Gesture-Based Communication in Human-Computer Interaction, vol. 2915, pp. 421-435, 2003.
[CrossRef] [Google Scholar] [Publisher Link]
[11] Lawrence Rabiner, and Biing-Hwang Juang, Fundamentals of Speech Recognition, Tsinghua University Press, pp. 1-507, 1993.
[Google Scholar] [Publisher Link]
[12] Guido Borghi et al., “Embedded Recurrent Network for Head Pose Estimation in Car,” IEEE Intelligent Vehicles Symposium, Los Angeles, CA, USA, pp. 1503-1508, 2017.
[CrossRef] [Google Scholar] [Publisher Link]
[13] Guido Borghi, Roberto Vezzani, and Rita Cucchiara, “Fast Gesture Recognition with Multiple Stream Discrete HMMs on 3D Skeletons,” 23rd International Conference on Pattern Recognition, Cancun, Mexico, pp. 997-1002, 2016.
[CrossRef] [Google Scholar] [Publisher Link]
[14] Said Yacine Boulahia et al., “Dynamic Hand Gesture Recognition Based On 3D Pattern Assembled Trajectories,” Seventh International Conference on Image Processing Theory, Tools and Applications, Montreal, QC, Canada, pp. 1-6, 2017.
[CrossRef] [Google Scholar] [Publisher Link]
[15] Yanchao Dong et al., “Driver Inattention Monitoring System for Intelligent Vehicles: A Review,” IEEE Transactions on Intelligent Transportation Systems, vol. 12, no. 2, pp. 596-614, 2011.
[CrossRef] [Google Scholar] [Publisher Link]
[16] Jaspreet Kaur, and Sonia Goyal, “A Comparative Study on Linear Array Antenna Pattern Synthesis using Evolutionary Algorithms,” International Journal of Advanced Research in Computer Science, vol. 8, no. 5, pp. 1582-1587, 2017.
[CrossRef] [Google Scholar] [Publisher Link]
[17] Mai Ngoc Anh, and Duong Xuan Bien, “Voice Recognition and Inverse Kinematics Control for a Redundant Manipulator Based on a Multilayer Artificial Intelligence Network,” Journal of Robatics, vol. 2021, no. 1, pp. 1-10, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[18] Shrikar Desai et al., “Voice-Controlled Robotic Car,” International Journal of Advanced Research in Science, Communication and Technology, vol. 4, no. 3, pp. 93-94, 2021.
[CrossRef] [Publisher Link]
[19] Rajesh Kannan Megalingam et al., “Implementation of Low-Cost Mobile Robot for Rescue Challenge,” Inventive Communication and Computational Technologies, vol. 89, pp. 1345-1355, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[20] Sakshi Bajpai, and D. Radha, “Smart Phone as a Controlling Device for Smart Home Using Speech Recognition,” International Conference on Communication and Signal Processing, Chennai, India, pp. 701-705, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[21] T. Thivagar, and A. Sriram, “Hand Gesture and Voice-Controlled Smart Vehicle,” International Journal of Modern Science and Technology, vol. 5, no. 6, pp. 164-167, 2020.
[Google Scholar] [Publisher Link]
[22] Dyah Ayu Anggreini Tuasikal, Hanif Fakhrurroja, and Carmadi Machbub, “Voice Activation Using Speaker Recognition for Controlling Humanoid Robot,” IEEE 8th International Conference on System Engineering and Technology, Bandung, Indonesia, pp. 79-84, 2018.
[CrossRef] [Google Scholar] [Publisher Link]