A Hybrid MO-ACO and Deep Reinforcement Learning Framework for Energy-Aware Routing in Wireless Sensor Networks

International Journal of Electronics and Communication Engineering

© 2026 by SSRG - IJECE Journal

Volume 13 Issue 3

Year of Publication : 2026

Authors : Thalaimalaichamy. M, James A Baskaradas

10.14445/23488549/IJECE-V13I3P114

How to Cite?

Thalaimalaichamy. M, James A Baskaradas, "A Hybrid MO-ACO and Deep Reinforcement Learning Framework for Energy-Aware Routing in Wireless Sensor Networks," SSRG International Journal of Electronics and Communication Engineering, vol. 13,  no. 3, pp. 175-184, 2026. Crossref, https://doi.org/10.14445/23488549/IJECE-V13I3P114

Abstract:

Wireless Sensor Networks (WSNs) have not yet overcome the vital issues of energy conservation and adaptive communication. The research study proposes MOACO-DQN, a hybrid energy-aware framework that utilizes Multi-Objective Ant Colony Optimisation (MO-ACO) and Deep Q-Network (DQN) for the intelligent management of networks to address these problems. The proposed method optimizes the selection of Cluster Heads (CHs) by MO-ACO, considering the residual energy, intra-cluster distance, and the CHs-sink distance. This ensures that energy is evenly used across the network. Using this framework, the proposed mechanism uses network state parameters (energy of nodes, quality of links, distance to sink) to learn and choose the most suitable next hop intelligently. By incorporating reinforcement learning into the routing process, the framework enhances the energy efficiency of data transmission. The MOACO-DQN proposed makes the network more durable and offers a lower end-to-end delay and a larger packet delivery ratio. The Proposed MOACO-DQN outperforms existing systems when the number of nodes is set at 100, with improvements of 20%, 25%, 35% over EEDQN, RL-LEACH, and BLE ACO, respectively. The suggested model is adaptable and better suited to smart and IoT-based WSNs.

Keywords:

(WSNs) Wireless Sensor Network, Energy Efficiency, Multi-Objective Ant Colony Optimization (MO-ACO), Deep Q-Network (DQN), Intelligent Routing.

References:

[1] Kukunoor Shekar et al., “Implementation of Novel Learning based Energy Efficient Routing Protocols in Wireless Sensor Networks for Internet of Things Use Cases,” Discover Computing, vol. 28, pp. 1-44, 2025.
[CrossRef] [Google Scholar] [Publisher Link]
[2] Nabil Sabor et al., “A Comprehensive Survey on Hierarchical-Based Routing Protocols for Mobile Wireless Sensor Networks: Review, Taxonomy, and Future Directions,” Wireless Communications and Mobile Computing, vol. 2017, no. 1, pp. 1-23, 2017.
[CrossRef] [Google Scholar] [Publisher Link]
[3] Guihai Chen et al., “An Unequal Cluster-Based Routing Protocol in Wireless Sensor Networks,” Wireless Networks, vol. 15, pp. 193-207, 2009.
[CrossRef] [Google Scholar] [Publisher Link]
[4] W.R. Heinzelman, A. Chandrakasan, and H. Balakrishnan, “Energy-Efficient Communication Protocol for Wireless Microsensor Networks,” Proceedings of the 33rd Annual Hawaii International Conference on System Sciences, Maui, HI, USA, pp. 1-10, 2000.
[CrossRef] [Google Scholar] [Publisher Link]
[5] O. Younis, and S. Fahmy, “HEED: A Hybrid, Energy-Efficient, Distributed Clustering Approach for Ad-hoc Sensor Networks,” IEEE Transactions on Mobile Computing, vol. 3, no. 4, pp. 366-379, 2004.
[CrossRef] [Google Scholar] [Publisher Link]
[6] V.G. Saranya, and S. Karthik, “Bio-Inspired Intelligent Routing in WSN: Integrating Mayfly Optimization and Enhanced Ant Colony Optimization for Energy-Efficient Cluster Formation and Maintenance,” Computer Modeling in Engineering and Sciences, vol. 141, no. 1, pp. 127-150, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[7] Ghalib H. Alshammri, “Enhancing Wireless Sensor Network Lifespan and Efficiency through Improved Cluster Head Selection using Improved Squirrel Search Algorithm,” Artificial Intelligence Review, vol. 58, pp. 1-32, 2025.
[CrossRef] [Google Scholar] [Publisher Link]
[8] Marco Dorigo, Mauro Birattari, and Thomas Stutzle, “Ant Colony Optimization,” IEEE Computational Intelligence Magazine, vol. 1, no. 4, pp. 28-39, 2006.
[CrossRef] [Google Scholar] [Publisher Link]
[9] Hussein S. Mohammed, Hayam K. Mustafa, and Omar A. Abdulkareem, “Enhancing Wireless Sensor Networks with Bluetooth Low Energy Mesh and Ant Colony Optimization Algorithm,” Algorithms, vol. 18, no. 9, pp. 1-12, 2025.
[CrossRef] [Google Scholar] [Publisher Link]
[10] Medhat A. Tawfeek et al., “Improving Energy Efficiency and Routing Reliability in Wireless Sensor Networks using Modified Ant Colony Optimization,” EURASIP Journal on Wireless Communications and Networking, vol. 2025, pp. 1-27, 2025.
[CrossRef] [Google Scholar] [Publisher Link]
[11] L.V. Liping, “An Improved Ant Colony Algorithm in Wireless Sensor Network Routing,” International Journal of Online and Biomedical Engineering, vol. 13, no. 5, pp. 174-187, 2017.
[CrossRef] [Google Scholar] [Publisher Link]
[12] N. Mahendran, and T. Mekala, “Energy-Distance & Degree: Multi-Objective Based Optimized Clustering and Route Discovery in Wireless Sensor Network,” IOP Conference Series: Materials Science and Engineering, Institute of Physics Publishing, vol. 872, pp. 1 11, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[13] Lin Wu, Ahmad Yahya Dawod, and Fang Miao, “Data Transmission in Wireless Sensor Networks Based on Ant Colony Optimization Technique,” Applied Sciences, vol. 14, no. 12, pp. pp. 1-41, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[14] Shiwei Zhang, and Xinghan Liu, “Improving the Functionality of Wireless Sensor Networks through the Use of Reinforcement Learning and Metaheuristic based Energy Efficient System,” Scientific Reports, vol. 15, pp. 1-23, 2025.
[CrossRef] [Google Scholar] [Publisher Link]
[15] Nilesh P. Sable et al., “Enhancing Routing Performance in Software-Defined Wireless Sensor Networks through Reinforcement Learning,” International Journal of Intelligent Systems and Applications in Engineering, vol. 11, no. 10, pp. 1-11, 2023.
[Google Scholar] [Publisher Link]
[16] Zahra Hasan et al., “Deep Reinforcement Learning-Based Mechanism to Improve the Throughput of EH-WSNs,” Scientific Reports, vol. 15, pp. 1-12, 2025.
[CrossRef] [Google Scholar] [Publisher Link]
[17] Nalini Manogaran et al., “Developing a Novel Adaptive Double Deep Q-Learning-Based Routing Strategy for IoT-Based Wireless Sensor Network with Federated Learning,” Sensors, vol. 25, no. 10, pp. 1-30, 2025.
[CrossRef] [Google Scholar] [Publisher Link]
[18] Yu Song et al., “Research on High-Efficiency Routing Protocols for HWSNs Based on Deep Reinforcement Learning,” Electronics, vol. 13, no. 23, pp. 1-24, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[19] Shio Kumar Singh, M.P Singh, and D.K Singh, “Routing Protocols in Wireless Sensor Networks - A Survey,” International Journal of Computer Science & Engineering Survey, vol. 1, no. 2, pp. 63-83, 2010.
[CrossRef] [Google Scholar] [Publisher Link]
[20] Zhu Yong, and Qing Pei, “A Energy-Efficient Clustering Routing Algorithm based on Distance and Residual Energy for Wireless Sensor Networks,” Procedia Engineering, vol. 29, pp. 1882-1888, 2012.
[CrossRef] [Google Scholar] [Publisher Link]
[21] S. Sebastin Suresh et al., “Intelligent Data Routing Strategy based on Federated Deep Reinforcement Learning for IOT-Enabled Wireless Sensor Networks,” Measurement: Sensors, vol. 31, pp. 1-9, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[22] Aiqi Zhang et al., “Deep Reinforcement Learning-Based Multi-Hop State-Aware Routing Strategy for Wireless Sensor Networks,” Applied Sciences, vol. 11, no. 10, pp. 1-12, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[23] Nimisha Rajput et al., “Deep Q-Learning Driven Protocol for Enhanced Border Surveillance with Extended Wireless Sensor Network Lifespan,” CMES-Computer Modeling in Engineering and Sciences, vol. 143, no. 3, pp. 3839-3859, 2025.
[CrossRef] [Google Scholar] [Publisher Link]
[24] Zan Yao, Ying Wang, and Xuesong Qiu, “DQN-based Energy-Efficient Routing Algorithm in Software-Defined Data Centers,” International Journal of Distributed Sensor Networks, vol. 16, no. 6, pp. 1-12, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[25] Daniel Godfrey et al., “An Energy-Efficient Routing Protocol with Reinforcement Learning in Software-Defined Wireless Sensor Networks,” Sensors, vol. 23, no. 20, pp. 1-22, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[26] S.D. Vijayakumar et al., “Deep Q Network for Intelligent Energy Efficient Routing in Wireless Sensor Network,” 2025 7th International Conference on Inventive Material Science and Applications (ICIMA), Namakkal, India, pp. 579-585, 2025.
[CrossRef] [Google Scholar] [Publisher Link]
[27] Navpreet Kaur, and Inderdeep Kaur Aulakh, “An Energy Efficient Reinforcement Learning Based Clustering Approach for Wireless Sensor Network,” EAI Endorsed Transactions on Scalable Information Systems, vol. 8, no. 31, pp. 1-17, 2021.[CrossRef] [Google Scholar] [Publisher Link]