Radial basis function network

Table of contents

Automate your business at $5/day with Engati

Radial basis function network

What do you mean by radial basis function network?

In the field of mathematical modeling, a radial basis function network is an artificial neural network that uses radial basis functions as activation functions. The output of the network is a linear combination of radial basis functions of the inputs and neuron parameters. They’re implemented to resolve domain problems that have a partial sample or a training data set that is too small.

In computational applications, functions of many variables often need to be approximated by other functions that are better understood or more readily evaluated. This may be for the purpose of displaying them frequently on a computer screen, for instance, so computer graphics is a field of practical use. 

Radial basis functions are used to approximate functions, much as neural networks act as function approximators. The following sum:

RBF network

represents a radial basis function network. The radial basis functions act as activation functions.

Radial basis functions are an efficient, frequently used way to do this. They also have additional uses, including function approximation, time series prediction, classification, and system control. 

What is a radial basis function example?

1. Logistic map

The basic properties of radial basis functions can be illustrated with a simple mathematical map, the logistic map, which maps the unit interval onto itself. It can be used to generate a convenient prototype data stream. The logistic map can be used to explore function approximation, time series prediction, and control theory. The map originated from the field of population dynamics and became the prototype for chaotic time series. The map, in the fully chaotic regime, is given by

where t is a time index. The value of x at time t+1 is a parabolic function of x at time t. This equation represents the underlying geometry of the chaotic time series generated by the logistic map.

The generation of the time series from this equation is the forward problem. The examples here illustrate the inverse problem; identification of the underlying dynamics, or fundamental equation, of the logistic map from exemplars of the time series. The goal is to find an estimate for f.

2. Time series prediction

Once the underlying geometry of the time series is estimated as in the previous examples, a prediction for the time series can be made by iteration:

A comparison of the actual and estimated time series is displayed in the figure. The estimated times series starts out at time zero with an exact knowledge of x(0). It then uses the estimate of the dynamics to update the time series estimate for several time steps.

Note that the estimate is accurate for only a few time steps. This is a general characteristic of chaotic time series. This is a property of the sensitive dependence on initial conditions common to chaotic time series. A small initial error is amplified with time. A measure of the divergence of time series with nearly identical initial conditions is known as the Lyapunov exponent.

Get your WhatsApp chatbot at just $5 a day

How does radial basis function work?

Radial basis functions (RBFs) are a series of exact interpolation techniques; that is, the surface must pass through each measured sample value. There are five different basis functions:

  • Thin-plate spline
  • Spline with tension
  • Completely regularized spline
  • Multiquadric function
  • Inverse multiquadric function

Each basis function has a different shape and results in a different interpolation surface. RBF methods are a special case of splines.

RBFs are conceptually similar to fitting a rubber membrane through the measured sample values while minimizing the total curvature of the surface. The basis function you select determines how the rubber membrane will fit between the values. The following diagram illustrates conceptually how an RBF surface fits through a series of elevation sample values. Notice in the cross section, the surface passes through the data values.

Being exact interpolators, the RBF methods differ from the global and local polynomial interpolators, which are both inexact interpolators that do not require the surface to pass through the measured points. When comparing an RBF to IDW (which is also an exact interpolator), IDW will never predict values above the maximum measured value or below the minimum measured value. However, the RBFs can predict values above the maximum and below the minimum measured values.

Who invented radial basis function?

Radial basis function networks were first formulated in a 1988 paper by Broomhead and Lowe, both researchers at the Royal Signals and Radar Establishment.

When to use radial basis functions?

RBFs are used to produce smooth surfaces from a large number of data points. The functions produce good results for gently varying surfaces such as elevation.

However, the techniques are inappropriate when large changes in the surface values occur within short distances and/or when you suspect the sample data is prone to measurement error or uncertainty.

What are some applications of radial basis function networks?

Applications are manifold, they include

  • Finite element or spectral methods for the solution of partial differential equations 
  • Neural networks with radial basis functions, and machine learning 
  • Approximations on spheres
  • Statistical approximations, where positive definite kernels are very important, 
  • Geophysical research
  • and many engineering applications 

Further applications include the important fields of neural networks and learning theory. Since they are radially symmetric functions that are shifted by points in multidimensional Euclidean space and then linearly combined, they form data-dependent approximation spaces. This data-dependence makes the spaces so formed suitable for providing approximations to large classes of given functions. It also opens the door to existence and unique results for interpolating scattered data by radial basis functions in very general settings (in particular in many dimensions).

Close Icon
Request a Demo!
Get started on Engati with the help of a personalised demo.
This is some text inside of a div block.
This is some text inside of a div block.
This is some text inside of a div block.
This is some text inside of a div block.
*only for sharing demo link on WhatsApp
Thanks for the information.
We will be shortly getting in touch with you.
Oops! something went wrong!
For any query reach out to us on contact@engati.com
Close Icon
Congratulations! Your demo is recorded.

Select an option on how Engati can help you.

I am looking for a conversational AI engagement solution for the web and other channels.

I would like for a conversational AI engagement solution for WhatsApp as the primary channel

I am an e-commerce store with Shopify. I am looking for a conversational AI engagement solution for my business

I am looking to partner with Engati to build conversational AI solutions for other businesses

Close Icon
You're a step away from building your Al chatbot

How many customers do you expect to engage in a month?

Less Than 2000


More than 5000

Close Icon
Thanks for the information.

We will be shortly getting in touch with you.

Close Icon

Contact Us

Please fill in your details and we will contact you shortly.

This is some text inside of a div block.
This is some text inside of a div block.
This is some text inside of a div block.
This is some text inside of a div block.
This is some text inside of a div block.
Thanks for the information.
We will be shortly getting in touch with you.
Oops! Looks like there is a problem.
Never mind, drop us a mail at contact@engati.com