Optimized Fuzzy Model in Piecewise Interval for Function Approximation

International Journal of Electrical and Electronics Engineering

© 2024 by SSRG - IJEEE Journal

Volume 11 Issue 2

Year of Publication : 2024

Authors : Anup Kumar Mallick, Sumantra Chakraborty, Kabita Purkait, Angsuman Sarkar

10.14445/23488379/IJEEE-V11I2P101

How to Cite?

Anup Kumar Mallick, Sumantra Chakraborty, Kabita Purkait, Angsuman Sarkar, "Optimized Fuzzy Model in Piecewise Interval for Function Approximation," SSRG International Journal of Electrical and Electronics Engineering, vol. 11,  no. 2, pp. 1-10, 2024. Crossref, https://doi.org/10.14445/23488379/IJEEE-V11I2P101

Abstract:

Function approximation is a technique for estimating an unknown underlying function from input-output instances or examples. Researchers have proposed different methods of function approximations, such as the neural network method, the support vector regression method, the reinforced learning method, the clustering method, the neuro-fuzzy method, etc. This paper introduces a novel data-driven function approximation scheme where the input-output data set is first segmented into multiple pieces. A Mamdani-type fuzzy submodel is constructed for each piece or portion, and the membership functions’ parameters for antecedent and consequent are optimally selected through the differential evolution algorithm. The efficacy of the suggested model is verified on three nonlinear functions, viz., a piecewise polynomial function, an exponentially decreasing sinusoidal function, and an exponentially increasing sinusoidal function. A comparative analysis is done based on the simulation results from the proposed model and the results obtained through the two state-of-the-art function approximation techniques, viz., the support vector regression model and the radial basis function network. The simulation results show that the proposed function approximator has satisfactorily approximated the three functions examined here, surpasses the two state-of-the-art techniques in approximating the two sinusoidal functions, and performs the near-best performance for the piecewise polynomial function. The proposed function approximator is expected to be applied as a new state-of-the-art method for function approximation.

Keywords:

Differential evolution, Function approximation techniques, Membership function generation, Optimal fuzzy model, Piecewise function.

References:

[1] Zarita Zainuddin, and Ong Pauline, “Function Approximation Using Artificial Neural Networks,” International Journal of Systems Applications, Engineering & Development, vol. 1, no. 4, pp. 173-178, 2007.
[Google Scholar] [Publisher Link]
[2] Ivy Kidron, “Polynomial Approximation of Functions: Historical Perspective and New Tools,” International Journal of Computers for Mathematical Learning, vol. 8, pp. 299-331, 2003.
[CrossRef] [Google Scholar] [Publisher Link]
[3] Victor Zalizniak, Essentials of Scientific Computing: Numerical Methods for Science and Engineering, Horwood Publishing, England, 2008.
[Google Scholar] [Publisher Link]
[4] Michael A. Cohen, and Can Ozan Tan, “A Polynomial Approximation for Arbitrary Functions,” Applied Mathematics Letters, vol. 25, no. 11, pp. 1947-1952, 2012.
[CrossRef] [Google Scholar] [Publisher Link]
[5] Sibo Yang et al., “Investigation of Neural Networks for Function Approximation,” Procedia Computer Science, vol. 17, pp. 586-594, 2013.
[CrossRef] [Google Scholar] [Publisher Link]
[6] Mariette Awad, and Rahul Khanna, Efficient Learning Machines - Theories, Concepts, and Applications for Engineers and System Designers, Apress Open, 2015.
[Google Scholar] [Publisher Link]
[7] Chen-Chia Chuang et al., “Robust Support Vector Regression Networks for Function Approximation with Outliers,” IEEE Transactions on Neural Networks, vol. 13, no. 6, pp. 1322-1330, 2002.
[CrossRef] [Google Scholar] [Publisher Link]
[8] Xin Xu, Lei Zuo, and Zhenhua Huang, “Reinforcement Learning Algorithms with Function Approximation: Recent Advances and Applications,” Information Sciences, vol. 261, pp. 1-31, 2014.
[CrossRef] [Google Scholar] [Publisher Link]
[9] T.A. Runkler, and J.C. Bezdek, “Alternating Cluster Estimation: A New Tool for Clustering and Function Approximation,” IEEE Transactions on Fuzzy Systems, vol. 7, no. 4, pp. 377-393, 1999.
[CrossRef] [Google Scholar] [Publisher Link]
[10] J. Gonzalez et al., “A New Clustering Technique for Function Approximation,” IEEE Transactions on Neural Networks, vol. 13, no. 1, pp. 132-142, 2002.
[CrossRef] [Google Scholar] [Publisher Link]
[11] S.Y. Reutskiy, and C.S. Chen, “Approximation of Multivariate Functions and Evaluation of Particular Solutions Using Chebyshev Polynomial and Trigonometric Basis Functions,” International Journal of Numerical Methods in Engineering, vol. 67, no. 13, pp. 1811- 1829, 2006.
[CrossRef] [Google Scholar] [Publisher Link]
[12] Theodore J. Rivlin, Chebyshev Polynomials, 2nd ed., Courier Dover Publications, 2020.
[Google Scholar] [Publisher Link]
[13] Dilcia Perez, and Yamilet Quintana, “A Survey on the Weierstrass Approximation Theorem,” Arxiv, 2006.
[CrossRef] [Google Scholar] [Publisher Link]
[14] Rida T. Farouki, “The Bernstein Polynomial Basis: A Centennial Retrospective,” Computer Aided Geometric Design, vol. 29, no. 6, pp. 379-419, 2012.
[CrossRef] [Google Scholar] [Publisher Link]
[15] Lloyd N. Trefethen, Approximation Theory and Approximation Practice, Extended ed., Society for Industrial and Applied Mathematics (SIAM) Publications, 2019.
[Google Scholar] [Publisher Link]
[16] G. Cybenko, “Approximation by Superposition of a Sigmoidal Function,” Mathematics Control, Signals and Systems, vol. 2, pp. 303-314, 1989.
[CrossRef] [Google Scholar] [Publisher Link]
[17] Kurt Hornik, Maxwell Stinchcombe, and Halbert White, “Multilayer Feedforward Networks are Universal Approximator,” Neural Networks, vol. 2, no. 5, pp. 359-366, 1989.
[CrossRef] [Google Scholar] [Publisher Link]
[18] S. Ferrari, and R.F. Stengel, “Smooth Function Approximation Using Neural Networks,” IEEE Transactions on Neural Networks, vol. 16, no. 1, pp. 24-38, 2005.
[CrossRef] [Google Scholar] [Publisher Link]
[19] Ronald DeVore, Boris Hanin, and Guergana Petrova, “Neural Network Approximation,” Acta Numerica, vol. 30, pp. 327-444, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[20] Fernando Pérez-Cruz et al., “Multi-Dimensional Function Approximation and Regression Estimation,” International Conference on Artificial Neural Networks, vol. 2415, pp. 757-762, 2002.
[CrossRef] [Google Scholar] [Publisher Link]
[21] Chih-Ching Hsiao, Shun-Feng Su, and Chen-Chia Chuang, “A Rough-Based Robust Support Vector Regression Network for Function Approximation,” 2011 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2011), Taipei, Taiwan, pp. 2814-2818, 2011.
[CrossRef] [Google Scholar] [Publisher Link]
[22] Chin-Teng Lin et al., “Support-Vector-Based Fuzzy Neural Network for Pattern Classification,” IEEE Transactions on Fuzzy Systems, vol. 14, no. 1, pp. 31-41, 2006.
[CrossRef] [Google Scholar] [Publisher Link]
[23] H. Pomares et al., “An Enhanced Clustering Function Approximation Technique for A Radial Basis Function Neural Network,” Mathematical and Computer Modelling, vol. 55, no. 3-4, pp. 286-302, 2012.
[CrossRef] [Google Scholar] [Publisher Link]
[24] Jerome H. Friedman, “Greedy Function Approximation: A Gradient Boosting Machine,” The Annals of Statistics, vol. 29, no. 5, pp. 1189- 1232, 2001.
[Google Scholar] [Publisher Link]
[25] Paulo Vitor de Campos Souza, “Fuzzy Neural Networks and Neuro-Fuzzy Networks: A Review the Main Techniques and Applications Used in the Literature,” Applied Soft Computing, vol. 92, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[26] Rainer Storn, and Kenneth Price, “Differential Evolution - A Simple and Efficient Heuristic for Global Optimization over Continuous Spaces,” Journal of Global Optimization, vol. 11, pp. 341-359, 1997.
[CrossRef] [Google Scholar] [Publisher Link]
[27] Rainer Storn, “Differential Evolution Research -Trends and Open Questions,” Advances in Differential Evolution, vol. 143, pp. 1-31, 2008.
[CrossRef] [Google Scholar] [Publisher Link]
[28] Swagatam Das, and Ponnuthurai Nagaratnam Suganthan, “Differential Evolution: A Survey of the State-of-the-Art,” IEEE Transactions on Evolutionary Computation, vol. 15, no. 1, pp. 4-31, 2011.
[CrossRef] [Google Scholar] [Publisher Link]
[29] Samir Roy, and Udit Chakraborty, Introduction to Soft Computing, Neuro-Fuzzy and Genetic Algorithms, Pearson, India, 2013.
[Google Scholar] [Publisher Link]
[30] Snehashish Chakraverty, Deepti Moyi Sahoo, and Nisha Rani Mahato, Concepts of Soft Computing, Fuzzy and ANN with Programming, Springer, Singapore, 2019.
[CrossRef] [Google Scholar] [Publisher Link]