An Adaptive Ensemble Learning-Based Smart Face Recognition and Verification Framework with Improved Heuristic Approach

International Journal of Electrical and Electronics Engineering
© 2023 by SSRG - IJEEE Journal
Volume 10 Issue 7
Year of Publication : 2023
Authors : Santhosh Shivaprakash, Sannangi Viswaradhya Rajashekararadhya
pdf
How to Cite?

Santhosh Shivaprakash, Sannangi Viswaradhya Rajashekararadhya, "An Adaptive Ensemble Learning-Based Smart Face Recognition and Verification Framework with Improved Heuristic Approach," SSRG International Journal of Electrical and Electronics Engineering, vol. 10,  no. 7, pp. 148-169, 2023. Crossref, https://doi.org/10.14445/23488379/IJEEE-V10I7P114

Abstract:

Face recognition is an uncontrollable surveillance system but faces complex issues regarding minimal resolution, expression modification, and motion blur. Nowadays, researchers find more interest in face recognition analysis on pattern recognition and computer vision models. Several advancements in deep learning approaches for face recognition displayed a better efficacy rate in standard datasets. However, real-time face recognition approaches are applied and offer a poor efficacy rate. This modification leads to more changes in the testing and training set. Among these changes, misalignment of the face over testing and training effectively degrades the face recognition rate. Hence, resolving the abovementioned complications in the classical face recognition and verification technique is essential. Thus, a brand new face recognition and verification approach is developed based on optimal features and other approaches. Initially, images associated with face recognition are attained from the standard dataset and offered to pre-processing phase using median filtering. Then, the pre-processed images are fed to the feature extraction phase, the spatial features are acquired by Local Binary Pattern (LBP), and the spectral features are attained by 3 Discrete Wavelet Transform (3-DWT) levels. Later, the attained features are concatenated and utilized to obtain the optimal features by the Adaptive Crossover and Stallions Percentage-based Wild Horse Optimization (ACSP-WHO). Further, the attained optimal features are fed as the input to Ensemble Learning Network (ELNet)-based face recognition and verification phase, where the ensemble technique having Support Vector Machine (SVM), Deep Neural Networks (DNN), and Adaboost are utilized, and also the ACSP-WHO tunes their parameters to attain the practical face recognized and verified outcome in the developed model. Finally, the suggested face recognition and verification framework secured an effective efficacy rate than the traditional approaches in different experimental observations.

Keywords:

Adaboost, Adaptive crossover, Stallions Percentage-based Wild Horse Optimization, Deep Neural Networks, Ensemble Learning Network, Face recognition and verification, Local Binary Pattern, Median filtering, Support Vector Machine, 3-level Discrete Wavelet Transform.

References:

[1] Jiankang Deng, “ArcFace: Additive Angular Margin Loss for Deep Face Recognition,” 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA, pp. 4685-4694, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[2] Stefanos Zafeiriou et al., “Regularized Kernel Discriminant Analysis with a Robust Kernel for Face Recognition and Verification,” IEEE Transactions on Neural Networks and Learning Systems, vol. 23, no. 3, pp. 526-534, 2012.
[CrossRef] [Google Scholar] [Publisher Link]
[3] Poornima Krishnan, and S. Naveen, “RGB-D Face Recognition System Verification using Kinect and FRAV3D Databases,” Procedia Computer Science, vol. 46, pp. 1653-1660, 2015.
[CrossRef] [Google Scholar] [Publisher Link]
[4] Baraa Adil Mahmood, and Sefer Kurnaz, “An Investigational FW-MPM-LSTM Approach for Face Recognition using Defective Data,” Image and Vision Computing, vol. 132, p. 104644, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[5] Prasanna Rajendra et al., “Smart Surveillance using OpenCV, Motion Analysis and Facial Landmark,” SSRG International Journal of VLSI & Signal Processing, vol. 7, no. 1, pp. 11-14, 2020.
[CrossRef] [Publisher Link]
[6] N. Asha et al., “Principal Component Analysis on Face Recognition using Artificial Fire Firefly Swarm Optimization Algorithm,” Advances in Engineering Software, vol. 174, p. 103296, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[7] Tongguang Ni et al., “Multi-Task Deep Metric Learning with Boundary Discriminative Information for Cross-Age Face Verification,” Journal of Grid Computing, vol. 18, pp. 197-210, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[8] Bilel Ameur et al., “Hybrid Descriptors and Weighted PCA-EFMNet for Face Verification in the Wild,” International Journal of Multimedia Information Retrieval, vol. 8, pp. 143-154, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[9] Ming Liu et al., “PA-GAN: A Patch-Attention Based Aggregation Network for Face Recognition in Surveillance,” IEEE Access, vol. 8, pp. 152780-152789, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[10] Dong Li, Huiling Zhou, and Kin-Man Lam, “High-Resolution Face Verification using Pore-Scale Facial Features,” IEEE Transactions on Image Processing, vol. 24, no. 8, pp. 2317-2327, 2015.
[CrossRef] [Google Scholar] [Publisher Link]
[11] Wonjun Hwang et al., “Face Recognition System using Multiple Face Model of Hybrid Fourier Feature under Uncontrolled Illumination Variation,” IEEE Transactions on Image Processing, vol. 20, no. 4, pp. 1152-1165, 2011.
[CrossRef] [Google Scholar] [Publisher Link]
[12] Shu Zhang et al., “DeMeshNet: Blind Face Inpainting for Deep MeshFace Verification,” IEEE Transactions on Information Forensics and Security, vol. 13, no. 3, pp. 637-647, 2018.
[CrossRef] [Google Scholar] [Publisher Link]
[13] Lingshuang Du, and Haifeng Hu, “Cross-Age Identity Difference Analysis Model Based on Image Pairs for Age Invariant Face Verification,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 31, no. 7, pp. 2675-2685, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[14] Jinjin Liu et al., “CP-GAN: A Cross-Pose Profile Face Frontalization Boosting Pose-Invariant Face Recognition,” IEEE Access, vol. 8, pp. 198659-198667, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[15] Richard Jiang et al., “Face Recognition in the Scrambled Domain via Salience-Aware Ensembles of Many Kernels,” IEEE Transactions on Information Forensics and Security, vol. 11, no. 8, pp. 1807-1817, 2016.
[CrossRef] [Google Scholar] [Publisher Link]
[16] Xing Di et al., “Multi-Scale Thermal to Visible Face Verification via Attribute Guided Synthesis,” IEEE Transactions on Biometrics, Behavior, and Identity Science, vol. 3, no. 2, pp. 266-280, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[17] S. Zafeiriou et al., “Exploiting Discriminant Information in Nonnegative Matrix Factorization with Application to Frontal Face Verification,” IEEE Transactions on Neural Networks, vol. 17, no. 3, pp. 683-695, 2006.
[CrossRef] [Google Scholar] [Publisher Link]
[18] Bor-Chun Chen, Chu-Song Chen, and Winston H. Hsu, “Face Recognition and Retrieval using Cross-Age Reference Coding with Cross-Age Celebrity Dataset,” IEEE Transactions on Multimedia, vol. 17, no. 6, pp. 804-815, 2015.
[CrossRef] [Google Scholar] [Publisher Link]
[19] Ankit Jain et al., “An Overview on Facial Expression Perception Mechanisms,” SSRG International Journal of Computer Science and Engineering, vol. 6, no. 4, pp. 19-24, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[20] Heri Purwanto et al., “Design and Development of Mask Detectors in Effort to Prevent the Spread of Hepatitis Post-Covid-19 Pandemic using Viola-Jones Algorithm,” SSRG International Journal of Electronics and Communication Engineering, vol. 10, no. 5, pp. 160-169, 2023.
[CrossRef] [Publisher Link]
[21] Xinxing Xu, Wen Li, and Dong Xu, “Distance Metric Learning using Privileged Information for Face Verification and Person ReIdentification,” IEEE Transactions on Neural Networks and Learning Systems, vol. 26, no. 12, pp. 3150-3162, 2015.
[CrossRef] [Google Scholar] [Publisher Link]
[22] Yukun Ma et al., “A Secure Face-Verification Scheme Based on Homomorphic Encryption and Deep Neural Networks,” IEEE Access, vol. 5, pp. 16532-16538, 2017.
[CrossRef] [Google Scholar] [Publisher Link]
[23] Chun Pong Lau, Carlos D Castillo, and Rama Chellappa, “ATFaceGAN: Single Face Semantic Aware Image Restoration and Recognition from Atmospheric Turbulence,” IEEE Transactions on Biometrics, Behavior, and Identity Science, vol. 3, no. 2, pp. 240- 251, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[24] Marios Kyperountas, Anastasios Tefas, and Ioannis Pitas, “Weighted Piecewise LDA for Solving the Small Sample Size Problem in Face Verification,” IEEE Transactions on Neural Networks, vol. 18, no. 2, pp. 506-519, 2007.
[CrossRef] [Google Scholar] [Publisher Link]
[25] Shervin Rahimzadeh Arashloo, and Josef Kittler, “Energy Normalization for Pose-Invariant Face Recognition Based on MRF Model Image Matching,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 33, no. 6, pp. 1274-1280, 2011.
[CrossRef] [Google Scholar] [Publisher Link]
[26] Xiaofeng Liu et al., “Dependency-Aware Attention Control for Image Set-Based Face Recognition,” IEEE Transactions on Information Forensics and Security, vol. 15, pp. 1501-1512, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[27] Baochang Zhang et al., “Local Derivative Pattern versus Local Binary Pattern: Face Recognition with High-Order Local Pattern Descriptor,” IEEE Transactions on Image Processing, vol. 19, no. 2, pp. 533-544, 2010.
[CrossRef] [Google Scholar] [Publisher Link]
[28] Abirami, Kavinila K, and Kavitha T, “Role of Machine Learning in Object Detection: A Review,” International Journal of Engineering Trends and Technology, vol. 67, no. 5, 192-194, 2019.
[CrossRef] [Publisher Link]
[29] Iraj Naruei, and Farshid Keynia, “Wild Horse Optimizer: A New Meta-Heuristic Algorithm for Solving Engineering Optimization Problems,” Engineering with Computers, vol. 38, pp. 3025-3056, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[30] Reecha Sharma, and M. S. Patterh, “A New Pose Invariant Face Recognition System using PCA and ANFIS,” Optik, vol. 126, no. 23, pp. 3483-3487, 2015.
[CrossRef] [Google Scholar] [Publisher Link]
[31] Youqi Zhang, Zhiyi Tang, and Ruijing Yang, “Data Anomaly Detection for Structural Health Monitoring by Multi-View Representation Based on Local Binary Patterns,” Measurement, vol. 202, p. 111804, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[32] Pooja Sharma, and Ashutosh Sharma, “Robust Technique for Steganography on Red Component using 3- DWT-DCT Transform,” 2018 2 nd International Conference on Inventive Systems and Control (ICISC), Coimbatore, India, pp. 1049-1054, 2018.
[CrossRef] [Google Scholar] [Publisher Link]
[33] Vahid Azimirad, Mahdiyeh Hajibabzadeh, and Parviz Shahabi, “A New Brain-Robot Interface System Based on SVM-PSO Classifier,” 2017 Artificial Intelligence and Signal Processing Conference (AISP), Shiraz, Iran, pp. 124-128, 2017.
[CrossRef] [Google Scholar] [Publisher Link]
[34] V. Muthuvel Vijai, and P. A. Mathina, “An Effective Ring Partition and Half Toning Combined Face Morphing Detection,” International Journal of Computer and Organization Trends, vol. 11, no. 4, pp. 10-14, 2021.
[CrossRef] [Publisher Link]
[35] S. Ramesh, and D. Vydeki, “Recognition and Classification of Paddy Leaf Diseases using Optimized Deep Neural Network with Jaya Algorithm,” Information Processing in Agriculture, vol. 7, no. 2, pp. 249-260, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[36] Xuchun Li, Lei Wang, and Eric Sung, “AdaBoost with SVM-Based Component Classifiers,” Engineering Applications of Artificial Intelligence, vol. 21, no. 5, pp. 785-795, 2008.
[CrossRef] [Google Scholar] [Publisher Link]
[37] M. Rajababu, K. Srinivas, and H. Ravisankar, “MF-FaceNet: An Intuitive Age-Invariant Face Recognition through Multi-Feature and Multi-Fusion CNNs,” International Journal of Engineering Trends and Technology, vol. 71, no. 3, pp. 407-422, 2023.
[CrossRef] [Publisher Link]
[38] Gaurav Agarwal, and Hari Om, “Performance of Deer Hunting Optimization Based Deep Learning Algorithm for Speech Emotion Recognition,” Multimedia Tools and Applications, vol. 80, pp. 9961-9992, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[39] Benyamin Abdollahzadeh, Farhad Soleimanian Gharehchopogh, and Seyedali Mirjalili, “African Vultures Optimization Algorithm: A New Nature-Inspired Metaheuristic Algorithm for Global Optimization Problems,” Computers & Industrial Engineering, vol. 158, p. 107408, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[40] Mohd Herwan Sulaiman et al., “Barnacles Mating Optimizer: A New Bio-Inspired Algorithm for Solving Engineering Optimization Problems,” Engineering Applications of Artificial Intelligence, vol. 87, p. 103330, 2020.
[CrossRef] [Google Scholar] [Publisher Link]