skip to main content
article

A granular-oriented development of functional radial basis function neural networks

Published: 01 December 2008 Publication History

Abstract

In this study, we develop a design methodology for generalized radial basis function neural networks. In contrast with the plethora of existing approaches, here we promote a development strategy in which a topology of the network is predominantly based upon a collection of information granules formed on a basis of available experimental data. The output space is granulated making use of the K-means clustering while the input space is clustered with the aid of a so-called context-based fuzzy clustering. The number of information granules produced for each context is adjusted so that we satisfy a certain reconstructability criterion that helps us minimize an error between the original data and the ones resulting from their reconstruction involving prototypes of the clusters and the corresponding membership values. In contrast to ''standard'' radial basis function neural networks, the output neuron of the network exhibits a certain functional nature as its connections are realized as local linear or quadratic functions whose location is determined by the values of the context and the prototypes in the input space. The other parameters of these local functions are subject to further parametric optimization. Numeric examples involve some low-dimensional synthetic data and selected data coming from the Machine Learning repository.

References

[1]
Bezdek, J.C., Pattern Recognition with Fuzzy Objective Function Algorithms. 1981. Plenum Press, New York.
[2]
Chang, F.J., Liang, J.M. and Chen, Y.C., Flood forecasting using radial basis function neural networks. IEEE Trans. Syst. Man Cybern. Part C. v31 i4. 530-535.
[3]
Devaraj, D., Yegnanarayana, B. and Ramar, K., Radial basis function networks for fast contingency ranking. Electric. Power Energy Syst. v24. 387-395.
[4]
Duy, N.M. and Cong, T.T., Numerical solution of differential equations using multiquadric radial basis function networks. Neural Netw. v14. 185-199.
[5]
Friedrichs, F. and Schmitt, M., On the power of Boolean computations in generalized RBF neural networks. Neurocomputing. v63. 483-498.
[6]
Fu, X. and Wang, L., Data dimensionality reduction with application to simplifying RBF network structure and improving classification performance. IEEE Trans. Syst. Man Cybern. Part B. v33 i3. 399-409.
[7]
Han, M. and Xi, J., Efficient clustering of radial basis perceptron neural network for pattern recognition. Pattern Recognit. v37. 2059-2067.
[8]
Harpham, C. and Dawson, C.W., The effect of different basis functions on a radial basis function network for time series prediction: a comparative study. Neurocomputing. v69. 2161-2170.
[9]
Karayiannis, N.B., Reformulated radial basis neural networks trained by gradient descent. IEEE Trans. Neural Netw. v10 i3. 657-671.
[10]
Lee, S.J. and Hou, C.L., An ART-based construction of RBF networks. IEEE Trans. Neural Netw. v13 i6. 1308-1321.
[11]
Lee, C.C., Chung, P.C., Tsai, J.R. and Chang, C.I., Robust radial basis function neural networks. IEEE Trans. Syst. Man Cybern. Part B. v29 i6. 674-685.
[12]
Loone, S.M. and Irwin, G., Improving neural network training solutions using regularization. Neurocomputing. v37. 71-90.
[13]
Mali, K. and Mitra, S., Symbolic classification, clustering and fuzzy radial basis function network. Fuzzy Sets Syst. v152. 553-564.
[14]
Mitra, S. and Basak, J., FRBF: a fuzzy radial basis function network. Neural Comput. Appl. v10. 244-252.
[15]
Moody, J. and Darken, C.J., Fast learning in networks of locally tuned processing units. Neural Comput. v1. 281-294.
[16]
Pedrycz, W., Conditional fuzzy c-means. Pattern Recognit. Lett. v17. 625-631.
[17]
Pedrycz, W., Conditional fuzzy clustering in the design of radial basis function neural networks. IEEE Trans. Neural Netw. v9 i4. 601-612.
[18]
Pedrycz, W., Chun, M.G. and Succi, G., N4: computing with neural receptive fields. Neurocomputing. v55. 383-401.
[19]
Rojas, I., Pomares, H., Bernier, J.L., Ortega, J., Pino, B., Pelayo, F.J. and Prieto, A., Time series analysis using normalized PG-RBF network with regression weights. Neurocomputing. v42. 267-285.
[20]
Sheta, A.F. and Jong, K.D., Time-series forecasting using GA-tuned radial basis functions. Inf. Sci. v133. 221-228.
[21]
Shi, D., Yeung, D.S. and Gao, J., Sensitivity analysis applied to the construction of radial basis function networks. Neural Netw. v18. 951-957.
[22]
Staiano, A., Tagliaferri, R. and Pedrycz, W., Improving RBF networks performance in regression tasks by means of a supervised fuzzy clustering. Neurocomputing. v69. 1570-1581.
[23]
Tan, Y., Wang, J. and Zurada, J.M., Nonlinear blind source separation using a radial basis function network. IEEE Trans. Neural Netw. v12 i1. 124-134.
[24]
Turnbull, D. and Elkan, C., Fast recognition of musical genres using RBF networks. IEEE Trans. Knowledge Data Eng. v17 i4. 580-584.
[25]
Vilaplana, J.M., Molina, J.L.P. and Coronado, J.L., Hyper RBF model for accurate reaching in redundant robotic systems. Neurocomputing. v61. 495-501.
[26]
Wallace, M., Tsapatsoulis, N. and Kollias, S., Intelligent initialization of resource allocating RBF networks. Neural Netw. v18. 117-122.
[27]
Wu, S. and Chow, T.W.S., Induction machine fault detection using SOM-based RBF neural networks. IEEE Trans. Ind. Electron. v51 i1. 183-194.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Neurocomputing
Neurocomputing  Volume 72, Issue 1-3
December, 2008
682 pages

Publisher

Elsevier Science Publishers B. V.

Netherlands

Publication History

Published: 01 December 2008

Author Tags

  1. Context-based fuzzy clustering
  2. Functional neuron
  3. Fuzzy clustering
  4. Information granules
  5. Local models
  6. Receptive fields

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 01 Jan 2025

Other Metrics

Citations

Cited By

View all

View Options

View options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media