Role of the bias in neural networks.

0 votes

Hi Guys,

I am new to Neural Network. I want to know what is the role of bias in Neural Network?

Jul 14 in Machine Learning by akhtar
• 33,120 points
136 views

1 answer to this question.

0 votes

Hi@akhtar,

The activation function in Neural Networks takes an input 'x' multiplied by a weight 'w'. Bias allows you to shift the activation function by adding a constant (i.e. the given bias) to the input. Bias in Neural Networks can be thought of as analogous to the role of a constant in a linear function, whereby the line is effectively transposed by the constant value.

In a scenario with no bias, the input to the activation function is 'x' multiplied by the connection weight 'w0'.

In a scenario with bias, the input to the activation function is 'x' times the connection weight 'w0' plus the bias times the connection weight for the bias 'w1'. This has the effect of shifting the activation function by a constant amount (b * w1).

answered Jul 14 by MD
• 78,020 points

Related Questions In Machine Learning

0 votes
1 answer
0 votes
1 answer
0 votes
1 answer
0 votes
2 answers

How do neural networks used in AI and deep learning learn?

A neural network is a hardware or software ...READ MORE

answered Apr 8, 2019 in Others by SA
• 1,050 points
199 views
0 votes
0 answers

How is AI different from Deep learning?

How is AI different from Deep Learning? READ MORE

Apr 22, 2019 in Others by Halder
75 views
0 votes
1 answer

keras model.fit_generator() several times slower than model.fit()

You may want to check out the ...READ MORE

answered May 31, 2019 in Python by SDeb
• 13,250 points
1,324 views
0 votes
0 answers

Use inverse transform with deep learning. Conceptual clarity needed

I have built a deep learning model ...READ MORE

Mar 21 in Python by Anan
• 180 points
325 views
0 votes
3 answers