Role of the bias in neural networks

0 votes

Hi Guys,

I am new to Neural Network. I want to know what is the role of bias in Neural Network?

Jul 14, 2020 in Machine Learning by akhtar
• 38,210 points
422 views

1 answer to this question.

0 votes

Hi@akhtar,

The activation function in Neural Networks takes an input 'x' multiplied by a weight 'w'. Bias allows you to shift the activation function by adding a constant (i.e. the given bias) to the input. Bias in Neural Networks can be thought of as analogous to the role of a constant in a linear function, whereby the line is effectively transposed by the constant value.

In a scenario with no bias, the input to the activation function is 'x' multiplied by the connection weight 'w0'.

In a scenario with bias, the input to the activation function is 'x' times the connection weight 'w0' plus the bias times the connection weight for the bias 'w1'. This has the effect of shifting the activation function by a constant amount (b * w1).

answered Jul 14, 2020 by MD
• 95,300 points

Related Questions In Machine Learning

0 votes
1 answer
0 votes
1 answer
0 votes
1 answer
0 votes
2 answers

How do neural networks used in AI and deep learning learn?

A neural network is a hardware or software ...READ MORE

answered Apr 8, 2019 in Others by SA
• 1,050 points
289 views
0 votes
0 answers

How is AI different from Deep learning?

How is AI different from Deep Learning? READ MORE

Apr 22, 2019 in Others by Halder
112 views
0 votes
1 answer

keras model.fit_generator() several times slower than model.fit()

You may want to check out the ...READ MORE

answered May 31, 2019 in Python by SDeb
• 13,290 points
1,707 views
0 votes
0 answers

Use inverse transform with deep learning. Conceptual clarity needed

I have built a deep learning model ...READ MORE

Mar 21, 2020 in Python by Anan
• 180 points
663 views
0 votes
3 answers

What are some best examples of AI applications in our daily life?

Hi Michael, You don’t need to be a ...READ MORE

answered Apr 9, 2020 in Machine Learning by Albert
• 160 points
359 views