Neural Networks

1. What are Artificial Neural Networks?

An artificial neural network is a hardware or software system that is designed after the working of neurons in the human nervous system. Artificial neural networks are an assortment of deep learning innovations that goes under the Artificial Intelligence domain.

‍

2. How do Neural Networks work?

A artificial neural network has multiple processors. These processors work parallely but are organised as tiers. The first tier gets the raw information similar to the optic nerve.
Each progressive tiers at that point gets input from the previous tier and gives its output to the next tier. The last output is processed by the last tier.

There are small nodes in every tier. The nodes are exceptionally interconnected with the nodes in the previous and next tier. Every node in the neural network has its own circle of information, including rules that it was modified with and rules it has learned.

Neural networks are incredibly versatile and learn quickly. Every node calculates the weight of the information it gets from the nodes before it. The inputs that contribute the most towards the correct output are given the most elevated weight.

‍

3. What are the Components of a Neural Network?

AI Neural networks are structured based on the processes inside the human brain. These models impersonate the elements of interconnected neurons by passing inputs through a few layers of what are called perceptrons ('neurons'), each changing the information using a group of functions. This segment will clarify the segments of a perceptron, the tiniest part of a neural network.
‍
A perceptron comprises three primary mathematical operations: scalar multiplication, a summation, and using an equation to transform the inputs, also known as the activation function. Since a perceptron is like a neuron in the human brain, we can assemble multiple perceptrons to model a brain.

A. Input:

The inputs are essentially the measurements of our feature

B. Weights:

Weights are scalar multiplications. Their responsibility is to survey the significance of every input, just as directionality. Getting these weights right is difficult, and there are a wide range of values to attempt.

C. Transfer Function:

The transfer function varies from different segments as it takes various inputs. The activity of the transfer function is to consolidate numerous inputs to yield one output with the goal that the activation function can be applied. This is generally finished with a straightforward summation of the inputs to the function. Prior to sending it to the perceptron, the value is modified using an activation function.

D. Activation Function:

An activation function will change the value from the transfer function into a number that changes the input. The activation function might not be linear.

E. Bias:

One component of the perceptron that is fundamental is one extra input of 1. It consistently remains the same, in each perceptron. It is multiplied by a weight simply like other inputs, and it allows the values before and after the activation function to shift, irrespective of the inputs. This permits other weights (actual inputs) to be explicit.

‍

4. What are the Different Types of Neural Networks?

Various neural systems utilize various standards in deciding their own guidelines. There are multiple ANNs, each with their one of a kind qualities.

A. Feedforward Neural Network – Artificial Neuron

This is perhaps the most straightforward type of artificial neural network. In a feedforward neural network, the information goes through multiple input nodes until it arrives at the output node.

Basically, the information moves in a single direction from the first tier until it arrives at the output node. This is otherwise called a front propagated wave which is typically accomplished by classifying activation function.

B. Radial Basis Function Neural Network

A radial basis function calculates the distance of a point to the centre. Such neural systems have two layers. In the inward layer, the features are consolidated with the radial basis function.

While calculating the output of the next step, the output of these features is considered.

C. Multilayer Perceptron

A multilayer perceptron has at least three layers. It is utilized to categorize information that can't be isolated linearly. It is a kind of ANN that is completely connected. This is because each and every node in a layer is associated with every node in the next layer.

A multilayer perceptron utilizes a nonlinear activation function.

D. Convolutional Neural Network

A convolutional neural network (CNN) utilizes a variety of multilayer perceptrons. A CNN contains more than one convolutional layer. These layers can either be totally interconnected or pooled.

Prior to passing the output to the following layer, the convolutional layer utilizes a convolutional procedure on the info. The network can be deeper but considering fewer parameters.

E. Recurrent Neural Network (RNN)

A Recurrent Neural Network is a kind of ANN wherein the output of a specific layer is fed back to the input, helping in predicting the outcome of the layer.

The first layer is similar to the layer in a  feedforward network. with the result of the sum of the weights and features. The recurrent neural network process begins in the following layers.

F. Modular Neural Network

A modular neural system has multiple networks that work autonomously and perform sub-assignments. These networks don't generally communicate with or interact with each other during the process. They work autonomously towards calculating the output.

G. Sequence-To-Sequence Models

A sequence-to-sequence model comprises of two recurrent neural networks. There's an encoder that forms the input and a decoder that forms the output. The encoder and decoder can utilize parameters accordingly. This model is especially relevant in those situations where the length of the input isn't equivalent to the length of the output.