HGTBF OM: A Hybrid Graph Based Transformer Framework for Enhanced Opinion Mining in Textual Data

International Journal of Electronics and Communication Engineering

© 2025 by SSRG - IJECE Journal

Volume 12 Issue 8

Year of Publication : 2025

Authors : B. Madhurika, D. Naga Malleswari

10.14445/23488549/IJECE-V12I8P129

How to Cite?

B. Madhurika, D. Naga Malleswari, "HGTBF OM: A Hybrid Graph Based Transformer Framework for Enhanced Opinion Mining in Textual Data," SSRG International Journal of Electronics and Communication Engineering, vol. 12,  no. 8, pp. 334-351, 2025. Crossref, https://doi.org/10.14445/23488549/IJECE-V12I8P129

Abstract:

As one such process, opinion mining carries immense significance in deriving actionable insights from textual information, facilitating data-driven decisions across sectors. While existing methodologies have attained great strides, including hybrid deep learning models and artificial neural networks, they need help addressing deep sentiments and contextual relationships in complex datasets. The current state-of-the-art approaches are either reliant on heuristics-based methods such as LSTMs or independent graph learning techniques or less sophisticated strategies based on either one of graph-based techniques or domain transformers without ensembling their respective characteristics, thus causing them to lose the power of harmony between the two as a pioneering approach. This study presents the Hybrid Graph Transformer-Based Framework for Opinion Mining (HGTBF-OM) to solve these challenges. It integrates graph representation, TransformerConv layers, and multi-head attention mechanisms. Experimental validation on the Zomato dataset demonstrated that the proposed framework outperformed current models, achieving a commendable accuracy of 99.01%, surpassing TransLSTM, So-haTRed, and Hybrid GCN-RF. The focus on these results demonstrates the framework’s facet-wise analysis capacity and its performance on balanced data. It is helpful for e-commerce, healthcare, and social media monitoring applications where the precision of sentiment analysis is vital. This framework addresses the limitations of classical methods and provides a scalable, efficient approach to contemporary opinion-related sentiment analysis tasks. Future work plans to broaden its use on multilingual datasets, improve computational efficiency, and assess its usability in dynamic and task-specific sentiment analysis scenarios.

Keywords:

Opinion Mining, Hybrid Graph Transformer, Sentiment Analysis, Deep Learning Framework, Textual Data Analysis.

References:

[1] Samad Riaz et al., “TransLSTM: A Hybrid LSTM-Transformer Model for Fine-Grained Suggestion Mining,” Natural Language Processing Journal, vol. 8, pp. 1-13, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[2] Rukhshanda Ihsan et al., “A Technique to Forecast Pakistan's News Using Deep Hybrid Learning Model,” International Journal of Information Technology, vol. 16, pp. 2505-2516, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[3] Ayse Berna Altinel et al., “So-haTRed: A Novel Hybrid System for Turkish Hate Speech Detection in Social Media with Ensemble Deep Learning Improved by BERT and Clustered-Graph Networks,” IEEE Access, vol. 12, pp. 86252-86270, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[4] Chandra Gupta Maurya, and Sudhanshu Kumar Jha, “Sentiment Analysis: A Hybrid Approach on Twitter Data,” Procedia Computer Science, vol. 235, pp. 990-999, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[5] Gagandeep Kaur, and Amit Sharma, “Automatic Customer Review Summarization Using Deep Learning-Based Hybrid Sentiment Analysis,” International Journal of Electrical & Computer Engineering, vol. 14, no. 2, pp. 2110-2125, 2024.
[CrossRef] [Google Scholar] [Publisher Link] 
[6] Haewon Byeon et al., “Deep Learning Model for Recommendation System Using Web of things Based Knowledge Graph Mining,” Service Oriented Computing and Applications, vol. 19, pp. 57-76, 2025.
[CrossRef] [Google Scholar] [Publisher Link]
[7] Kunze Wang, Yihao Ding, and Soyeon Caren Han, “Graph Neural Networks for Text Classification: A Survey,” Artificial Intelligence Review, vol. 57, pp. 1-38, 2024.
[CrossRef] [Google Scholar] [Publisher Link] 
[8] V.S. Anoop, C. Subin Krishna, and Usharani Hareesh Govindarajan, “Graph Embedding Approaches for Social Media Sentiment Analysis with Model Explanation,” International Journal of Information Management Data Insights, vol. 4, no. 1, pp. 1-11, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[9] Bharti Khemani et al., “Detecting Health Misinformation: A Comparative Analysis of Machine Learning and Graph Convolutional Networks in Classification Tasks,” MethodsX, vol. 12, pp. 1-11, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[10] Krishna Kumar Mohbey et al., “A CNN-LSTM-Based Hybrid Deep Learning Approach for Sentiment Analysis on Monkeypox Tweets,” New Generation Computing, vol. 42, pp. 89-107, 2024.
[CrossRef] [Google Scholar] [Publisher Link]
[11] Rahim Sadigov et al., “Deep Learning-Based User Experience Evaluation in Distance Learning,” Cluster Computing, vol. 27, pp. 443-455, 2024.  
[CrossRef] [Google Scholar] [Publisher Link]
[12] Huang Huang, Adeleh Asemi Zavareh, and Mumtaz Begum Mustafa, “Sentiment Analysis in E-Commerce Platforms: A Review of Current Techniques and Future Directions,” IEEE Access, vol. 11, pp. 90367-90382, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[13] Sérgio Barreto et al., “Sentiment Analysis in Tweets: An Assessment Study from Classical to Modern Word Representation Models,” Data Mining and Knowledge Discovery, vol. 37, pp. 318-380, 2023.
[CrossRef] [Google Scholar] [Publisher Link] 
[14] Nikhat Parveen et al., “Twitter Sentiment Analysis Using Hybrid Gated Attention Recurrent Network,” Journal of Big Data, vol. 10, pp. 1-29, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[15] Monali Bordoloi, and Saroj Kumar Biswas, “Sentiment Analysis: A Survey on Design Framework, Applications and Future Scopes,” Artificial Intelligence Review, vol. 56, pp. 12505-12560, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[16] Emelie Rosenberg et al., “Sentiment Analysis on Twitter Data towards Climate Action,” Results in Engineering, vol. 19, pp. 1-13, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[17] Lvxiaowei Xu et al., “Learn from Structural Scope: Improving Aspect-Level Sentiment Analysis with Hybrid Graph Convolutional Networks,” Neurocomputing, vol. 518, pp. 373-383, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[18] Gaurav Meena et al., “A Hybrid Deep Learning Approach for Detecting Sentiment Polarities and Knowledge Graph Representation on Monkeypox Tweets,” Decision Analytics Journal, vol. 7, pp. 1-12, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[19] Dimple Tiwari, and Bharti Nagpal, “KEAHT: A Knowledge-Enriched Attention-Based Hybrid Transformer Model for Social Sentiment Analysis,” New Generation Computing, vol. 40, pp. 1165-1202, 2022.
[CrossRef] [Google Scholar] [Publisher Link] 
[20] Yu Zhao et al., “Stock Movement Prediction Based on Bi-Typed Hybrid-Relational Market Knowledge Graph via Dual Attention Networks,” IEEE Transactions on Knowledge and Data Engineering, vol. 35, no. 8, pp. 8559-8571, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[21] Reinald Kim Amplayo et al., “Beyond Opinion Mining: Summarizing Opinions of Customer Reviews,” Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 3447-3450, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[22] Sebastião Pais, João Cordeiro, and M. Luqman Jamil, “NLP-Based Platform as a Service: A Brief Review,” Journal of Big Data, vol. 9, pp. 1-26, 2022.
[CrossRef] [Google Scholar] [Publisher Link] 
[23] R. Nandakumar et al., “Sentimental Analysis on Student Feedback using NLP & POS Tagging,” 2022 International Conference on Edge Computing and Applications (ICECAA), Tamilnadu, India, pp. 309-313, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[24] Azizkhan F. Pathan, and Chetana Prakash, “Cross-Domain Aspect Detection and Categorization using Machine Learning for Aspect-Based Opinion Mining,” International Journal of Information Management Data Insights, vol. 2, no. 2, pp. 1-18, 2022.
[CrossRef] [Google Scholar] [Publisher Link]  
[25] Ravi Verma, Amit Chhabra, and Ankit Gupta, “A Statistical Analysis of Tweets on Covid-19 Vaccine Hesitancy Utilizing Opinion Mining: An Indian Perspective,” Social Network Analysis and Mining, vol. 13, pp. 1-12, 2023.
[CrossRef] [Google Scholar] [Publisher Link]
[26] Dionysios Karamouzas, Ioannis Mademlis, and Ioannis Pitas, “Public Opinion Monitoring Through Collective Semantic Analysis of Tweets,” Social Network Analysis and Mining, vol. 12, pp. 1-21, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[27] Srinjoy Ganguly, Sai Nandan Morapakula, and Luis Miguel Pozo Coronado, “Quantum Natural Language Processing Based Sentiment Analysis using Lambeq Toolkit,” 2022 Second International Conference on Power, Control and Computing Technologies (ICPC2T), Raipur, India, pp. 1-6, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[28] Leonidas Akritidis, and Panayiotis Bozanis, “How Dimensionality Reduction Affects Sentiment Analysis NLP Tasks: An Experimental Study,” Artificial Intelligence Applications and Innovations, pp. 301-312, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[29] Md Sabbir Hossain, Nishat Nayla, and Annajiat Alim Rassel, “Product Market Demand Analysis Using NLP in Banglish Text with Sentiment Analysis and Named Entity Recognition,” 2022 56th Annual Conference on Information Sciences and Systems (CISS), Princeton, NJ, USA, pp. 166-171, 2022.
[CrossRef] [Google Scholar] [Publisher Link] 
[30] Sangamesh Hosgurmath, Vishwanath Petli, and V.K. Jalihal, “An Omicron Variant Tweeter Sentiment Analysis Using NLP Technique,” Global Transitions Proceedings, vol. 3, no. 1, pp. 215-219, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[31] Frederico Dias Souza, and João Baptista de Oliveira e Souza Filho, “BERT for Sentiment Analysis: Pre-Trained and Fine-Tuned Alternatives,” Computational Processing of the Portuguese Language, pp. 209-218, 2022.
[CrossRef] [Google Scholar] [Publisher Link]
[32] Adil Rajput, “Natural Language Processing, Sentiment Analysis, and Clinical Analytics,” Innovation in Health Informatics, pp. 79-97, 2020.
[CrossRef] [Google Scholar] [Publisher Link]                 
[33] Cristóbal Colón-Ruiz, and Isabel Segura-Bedmar, “Comparing Deep Learning Architectures for Sentiment Analysis on Drug Reviews,” Journal of Biomedical Informatics, vol. 110, pp. 1-11, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[34] Satyen M. Parikh, and Mitali K. Shah, “Analysis of Various Sentiment Analysis Techniques of NLP,” 2021 Third International Conference on Intelligent Communication Technologies and Virtual Mobile Networks (ICICV), Tirunelveli, India, pp. 1323-1331, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[35] Leeja Mathew, and V.R Bindu “A Review of Natural Language Processing Techniques for Sentiment Analysis Using Pre-Trained Models,” 2020 Fourth International Conference on Computing Methodologies and Communication (ICCMC), Erode, India,  pp. 340-345, 2020.
[CrossRef] [Google Scholar] [Publisher Link] 
[36] Shivangi Srivastava, Aastha Nagpal, and Ashish Bagwari, “Various Approaches in Sentiment Analysis,” 2020 12th International Conference on Computational Intelligence and Communication Networks (CICN), Bhimtal, India, pp. 92-96, 2020.
[CrossRef] [Google Scholar] [Publisher Link] 
[37] Raksmey Sann, and Pei-Chun Lai, “Understanding Homophily of Service Failure within the Hotel Guest Cycle: Applying NLP-Aspect-Based Sentiment Analysis to the Hospitality Industry,” International Journal of Hospitality Management, vol. 91, 2020.
[CrossRef] [Google Scholar] [Publisher Link] 
[38] Hamed Jelodar et al., “A NLP Framework Based on Meaningful Latent-Topic Detection and Sentiment Analysis Via Fuzzy Lattice Reasoning on Youtube Comments,” Multimedia Tools and Applications, vol. 80, pp. 4155-4181, 2021.
[CrossRef] [Google Scholar] [Publisher Link] 
[39] Mohd Usama et al., “Attention-Based Sentiment Analysis using Convolutional and Recurrent Neural Network,” Future Generation Computer Systems, vol. 113, pp. 571-578, 2020.  
[CrossRef] [Google Scholar] [Publisher Link]
[40] Alexander Ligthart, Cagatay Catal, and Bedir Tekinerdogan, “Systematic Reviews in Sentiment Analysis: A Tertiary Study,” Artificial Intelligence Review, vol. 54, pp. 4997-5053, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[41] Zomato Dataset, Kaggle, 2021. [Online]. Available: https://www.kaggle.com/datasets/rajeshrampure/zomato-dataset