Comparative Review on Automated Test Failure Detection and Healing Tools

International Journal of Electrical and Electronics Engineering

© 2025 by SSRG - IJEEE Journal

Volume 12 Issue 2

Year of Publication : 2025

Authors : Nammi Hemanth Kumar, Sireesha Rodda

10.14445/23488379/IJEEE-V12I2P113

How to Cite?

Nammi Hemanth Kumar, Sireesha Rodda, "Comparative Review on Automated Test Failure Detection and Healing Tools," SSRG International Journal of Electrical and Electronics Engineering, vol. 12,  no. 2, pp. 113-123, 2025. Crossref, https://doi.org/10.14445/23488379/IJEEE-V12I2P113

Abstract:

The main aim of this paper was to evaluate automated test failure detection and healing tools in software test automation. Although Artificial Intelligence and Machine Learning involve creating separate and individual algorithms for accessing data and making sense of it by identifying patterns to form conclusions, these predictions should be used to their full benefit for software testing. Automated test failure detection and healing tools are one approach that makes more of these predictions become a reality under software testing. This paper reviews the existing literature regarding healing tools specifically created for test failure detection and healing, particularly their performance in recognizing User Interface changes and healing the test scripts automatically. The review presents the key characteristics, features, functionalities, and technologies used in the tools, such as Artificial Intelligence, machine learning, visual testing, and integration with popular test automation frameworks. By juxtaposing the sources reviewed above, the review outlines the pros and cons and promising application areas of each and provides suggestions for appropriate uses in highly diverse testing conditions and contexts. Moreover, the review also starts with the gaps and the challenges that the current cutting-edge approaches have faced and gives a future outlook on what directions future research and development have in terms of automated test failure detection and healing. Somewhere It seems like there is no distinctive technique framework or tool available that could support the automated test failure detection and healing and can fulfill all the requirements. Finally, this paper ends with a discussion of the most popular tools available, along with the expressed thought process about the present and forthcoming artificial intelligence for test automation.

Keywords:

Test automation, Artificial Intelligence, Machine Learning, Self-healing tools.

References:

[1] Itti Hooda, and Rajender Singh Chhillar, “Software Test Process, Testing Types and Techniques,” International Journal of Computer Applications, vol. 111, no. 13, 2015.
[Google Scholar] [Publisher Link]
[2] Glenford J. Myers, Corey Sandler, and Tom Badgett, The Art of Software Testing, John Wiley & Sons, 2011.
[Google Scholar] [Publisher Link]
[3] Juha Itkonen, Mika V. Mantyla, and Casper Lassenius, “How Do Testers Do It? An Exploratory Study on Manual Testing Practices,” 3rd International Symposium on Empirical Software Engineering and Measurement, Lake Buena Vista, FL, USA, 2009.
[CrossRef] [Google Scholar] [Publisher Link]
[4] Suresh Thummalapenta et al., “Automating Test Automation,” 34th International Conference on Software Engineering (ICSE), Zurich, Switzerland, 2012.
[CrossRef] [Google Scholar] [Publisher Link]
[5] Shikha, and Kailash Bahl, “Software Testing Tools & Techniques for Web Applications,” International Journal of Engineering and Technical Research (IJETR), vol. 3, no. 5, 2015.
[Google Scholar] [Publisher Link]
[6] Nazia Islam, “A Comparative Study of Automated Software Testing Tools,” Culminating Projects in Computer Science and Information Technology, 2016.
[Google Scholar] [Publisher Link]
[7] Vishawjyoti, and Sachin Sharma, “Study and Analysis of Automation Testing Techniques,” Journal of Global Research in Computer Science, vol. 3, no. 12, pp. 36-43, 2012.
[Publisher Link]
[8] Andreas Spillner, and Tilo Linz, Software Testing Foundations: A Study Guide for the Certified Tester Exam-Foundation Level-ISTQB® Compliant, dpunkt. Verlag, 5th ed., 2021.
[Google Scholar] [Publisher Link]
[9] Dorothy Graham, and Mark Fewster, “Experiences of Test Automation: Case Studies of Software Test Automation,” Addison-Wesley Professional, 2012.
[Google Scholar] [Publisher Link]
[10] Mubarak Albarka Umar, and Chen Zhanfang, “A Study of Automated Software Testing: Automation Tools and Frameworks,” International Journal of Computer Science Engineering (IJCSE), vol. 8, no. 6, pp. 217-225, 2019.
[Google Scholar] [Publisher Link]
[11] Anand Singh Gadwal, and Lalji Prasad, “Comparative Review of the Literature of Automated Testing Tools,” 2020.
[Google Scholar]
[12] Soorajit Mukherjee, “Self-Healing Test Automation,” Medium, 2020.
[Publisher Link]
[13] Gemma Catolino et al., “Not All Bugs are the Same: Understanding, Characterizing, and Classifying Bug Types,” Journal of Systems and Software, vol. 152, pp. 165-181, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[14] Dhaya Sindhu Battina, “Artificial Intelligence in Software Test Automation: A Systematic Literature Review,” International Journal of Emerging Technologies and Innovative Research, vol. 6, no. 12, 2019.
[Google Scholar] [Publisher Link]
[15] Shahrokh Jalilian, and Shafagat J. Mahmudova. “Automatic Generation of Test Cases for Error Detection Using the Extended Imperialist Competitive Algorithm,” Problems of Information Society, vol. 13, no. 2, pp. 46-54, 2022.
[Google Scholar] [Publisher Link]
[16] Sutharsan Chiranjeevi Partha Saarathy, Suresh Bathrachalam, and Bharath Kumar Rajendran, “Self-Healing Test Automation Framework Using AI and ML,” International Journal of Strategic Management, vol. 3, no. 3, pp. 45-77, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[17] Shahbaa I. Khalee, and Raghda Anan, “A Review Paper: Optimal Test Cases for Regression Testing Using Artificial Intelligent Techniques,” International Journal of Electrical & Computer Engineering, vol. 13, no. 2, pp. 1803-1816 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[18] Gabaire Elmi Bile, “The Utilization of Log Files Generated by Test Executions: A Systematic Literature Review,” Digitala Vetenskapliga Arkivet, 2023.
[Google Scholar] [Publisher Link]
[19] Szymon Stradowski, and Lech Madeyski, “Machine Learning in Software Defect Prediction: A Business-Driven Systematic Mapping Study,” Information and Software Technology, vol. 155, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[20] Shravan Pargaonkar, “Advancements in Security Testing: A Comprehensive Review of Methodologies and Emerging Trends in Software Quality Engineering,” International Journal of Science and Research (IJSR), vol. 12, no. 9, pp. 61-66, 2023.
[Google Scholar] [Publisher Link]
[21] Sabina-Cristiana Necula, Florin Dumitriu, and Valerică Greavu-Șerban, “A Systematic Literature Review on using Natural Language Processing in Software Requirements Engineering,” Electronics, vol. 13, no. 11, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[22] Zahra Yazdanparast, “A Survey on Self-Healing Software System,” arXiv, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[23] Yasunari Matsuzaka, and Ryu Yashiro, “AI-Based Computer Vision Techniques and Expert Systems,” AI, vol. 4, no. 1, pp. 289-302, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[24] Gagan Kumar, Vinay Chopra, and Dinesh Gupta, “Systematic Literature Review in Software Test Data Generation,” Emerging Trends in Engineering and Management, pp. 91-107. 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[25] C. Anjali, Julia Punitha Malar Dhas, and J. Amar Pratap Singh, “Automated Program and Software Defect Root Cause Analysis using Machine Learning Techniques,” Automation: Journal of Automation, Measurement, Electronics, Computing and Communications, vol. 64, no. 4, pp. 878-885, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[26] Amin Milani Fard, Mehdi Mirzaaghaei, and Ali Mesbah, “Leveraging Existing Tests in Automated Test Generation for Web Applications,” Proceedings of the 29th ACM/IEEE International Conference on Automated Software Engineering, pp. 67-78, 2014.
[CrossRef] [Google Scholar] [Publisher Link]
[27] Shivkumar Goel, and Kshitija Vartak, “Selenium with Support of both Test NG and Cucumber Frameworks,” International Journal of Computer Applications, vol. 180, no. 51, 2018.
[Publisher Link]
[28] Ghada Alsuwailem, and Ohoud Alharbi, “Utilizing Machine Learning for Predicting Software Faults through Selenium Testing Tool,” International Journal of Computations, Information and Manufacturing (IJCIM), vol. 3, no. 2, 13-27, 2023.
[Google Scholar] [Publisher Link]
[29] Dalia Alamleh, “Utilizing AI in Test Automation to Perform Functional Testing on Web Application,” Science and Information Conference, Springe, vol. 507, pp. 359-377, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[30] Abdus Samad et al., “A Cognitive Approach in Software Automation Testing,” Proceedings of the International Conference on Innovative Computing & Communication, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[31] Hadeel Mohamed Eladawy, Amr E. Mohamed, and Sameh A. Salem, “A New Algorithm for Repairing Web-Locators Using Optimization Techniques,” 13th International Conference on Computer Engineering and Systems, Cairo, Egypt, pp. 327-331, 2018.
[CrossRef] [Google Scholar] [Publisher Link]
[32] Harshita Wardhan, and Suman Madan, “Study on Functioning of Selenium Testing Tool,” International Research Journal of Modernization in Engineering Technology and Science, vol. 3, no. 4, 2021.
[Google Scholar] [Publisher Link]
[33] Mubarak Albarka Umar, “A Study of Software Testing: Categories, Levels, Techniques, and Types,” Authorea Preprints, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[34] Filippo Ricca, Alessandro Marchetto, and Andrea Stocco, “AI-Based Test Automation: A Grey Literature Analysis,” IEEE International Conference on Software Testing, Verification and Validation Workshops, Porto de Galinhas, Brazil, pp. 263-270, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[35] Rohit Khankhoje, “Effortless Test Maintenance: A Critical Review of Self-Healing Frameworks,” International Journal for Research in Applied Science and Engineering Technology, vol. 11, no. 10, 2023.
[Google Scholar] [Publisher Link]
[36] João Paulo Magalhães, and Luis Moura Silva, “SHoWA: A Self-Healing Framework for Web-Based Applications,” ACM Transactions on Autonomous and Adaptive Systems, vol. 10, no. 1, pp. 1-28, 2015.
[CrossRef] [Google Scholar] [Publisher Link]
[37] Rohit Khankhoje, “An Intelligent Apitesting: Unleashing the Power of AI,” International Journal of Software Engineering and Application, vol. 15, no. 1, pp. 1-8, 2024.
[Google Scholar] [Publisher Link]
[38] Moez Krichen, “A Survey on Formal Verification and Validation Techniques for the Internet of Things,” Applied Sciences, vol. 13, no. 14, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[39] Flaviu Fuior, “An Overview of Some Tools for Automated Testing of Software Applications,” Romanian Journal of Information Technology & Automatic Control, vol. 29, no. 3, pp. 97-106, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[40] Phuoc Pham, Vu Nguyen, and Tien Nguyen, “A Review of AI-Augmented End-to-End Test Automation Tools,” Proceedings of the 37th IEEE/ACM International Conference on Automated Software Engineering, pp. 1-4, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[41] Danijel Radošević, Nikola Mrvac, and Andrija Bernik, “Robotic Process Automation with Optoklik,” Preprints, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[42] Marina Cernat, Adelina Nicoleta Staicu, and Alin Stefanescu, “Towards Automated Testing of RPA Implementations,” Proceedings of the 11th ACM SIGSOFT International Workshop on Automating TEST Case Design, Selection, and Evaluation, pp. 21-24, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[43] Yuvaraja Devarajan, “A Review on Intelligent Process Automation,” International Journal of Computer Applications, vol. 182, no. 36, 2019.
[Google Scholar] [Publisher Link]
[44] Kam K.H. Ng et al., “A Systematic Literature Review on Intelligent Automation: Aligning Concepts from Theory, Practice, and Future Perspectives,” Advanced Engineering Informatics, vol. 47, 2021.
[CrossRef] [Google Scholar] [Publisher Link]