Facial Emotion Recognition in Python

International Journal of Computer Science and Engineering
© 2020 by SSRG - IJCSE Journal
Volume 7 Issue 6
Year of Publication : 2020
Authors : Nikhil Kumar Singh, Gokul Rajan V

How to Cite?

Nikhil Kumar Singh, Gokul Rajan V, "Facial Emotion Recognition in Python," SSRG International Journal of Computer Science and Engineering , vol. 7,  no. 6, pp. 20-23, 2020. Crossref, https://doi.org/10.14445/23488387/IJCSE-V7I6P106


It is general fact that humans are highlighted by other species in the world by the emotions which is expressed through facial expressions. As the Artificial intelligence are emerging and growing exponentially in many fields where it is important to recognize the human emotions when the auto reply system. The aim of this paper is to propose a system that can be used to recognize the facial expressions of human. An automated emotion recognition system which examines the expressions through various steps like segmentation, feature extraction and identification of human emotions from image or video. This application inspired by image processing and machine learning algorithms. Steps involved in this process are like Image Pre-processing, face detection, facial components, feature extraction and classification. This application uses the image captured from the webcam and the obtained image is compared with the trained dataset model available and then emotional state of the image will be displayed. Facial Emotion Recognition application is implemented using Convolution Neural Network (CNN). System has been tested with the dataset which contains the various emotions of the humans. The application has achieved 56.77 % accuracy and 0.57 precision on testing dataset. This application is capable of classifying human facial expressions into 6 essential emotions: happy, sad, fear, anger, disgust, and neutral.


Artificial Intelligence, Image Processing, Machine Learning, Face Detection.


[1] Halder, Rituparna , Sengupta, Sushmit, Pal, Arnab, Ghosh, Sudipta, Kundu, Debashish., ”Real-Time Facial Emotion Recognition based on Image Processing and Machine Learning,” International Journal of Computer Applications. 139. 16-19. 10.5120/ijca2016908707. In 2016
[2] Lee HC., Wu CY., & Lin TM. “Facial Expression Recognition Using Image Processing Tools and Neural Networks,”. Published In: Pan JS., Yang CN., Lin CC. (eds) Advances in Intelligent Systems and Applications Smart Innovation, Systems and Technologies, vol 21. Springer, Berlin, Heidelberg in 2013
[3] Baby shalini T , Vanitha L. "Emotion Detection in Human Beings Using ECG Signals ". International Journal of Engineering Trends and Technology (IJETT). 4(5) 2013.
[4] Worring M and Pham T., “ Face detection methods: A critical evaluation,” ISIS Technical Report Series, University of Amsterdam, published in 11, 2000.
[5] Samir K. Bandyopadhyay proposed, "A Method For Face Segmentation, Facial Feature Extraction And Tracking" IJCSET | vol.no:1, issue 3,137-139 published in April 2011
[6] Prof. D. K Shah, Vishal B. Mokashi, "Face Detection and Recognition Using Recorded Videos", International Journal of Emerging Technology and Advanced Engineering website: www.ijetae.com February 2015
[7] Moon Hwan Kim, Young Hoon Joo and Jin BaePark, “Emotion Detection Algorithm Using Frontal Face Image”, IEEE 2013
[8] Leh Luoh, et al., “Image Processing based emotion recognition”, IEEE 6, published in December 2011.