Role of the bias in neural networks

0 votes

Hi Guys,

I am new to Neural Network. I want to know what is the role of bias in Neural Network?

Jul 15, 2020 in Machine Learning by akhtar
• 38,230 points
1,302 views

1 answer to this question.

0 votes

Hi@akhtar,

The activation function in Neural Networks takes an input 'x' multiplied by a weight 'w'. Bias allows you to shift the activation function by adding a constant (i.e. the given bias) to the input. Bias in Neural Networks can be thought of as analogous to the role of a constant in a linear function, whereby the line is effectively transposed by the constant value.

In a scenario with no bias, the input to the activation function is 'x' multiplied by the connection weight 'w0'.

In a scenario with bias, the input to the activation function is 'x' times the connection weight 'w0' plus the bias times the connection weight for the bias 'w1'. This has the effect of shifting the activation function by a constant amount (b * w1).

answered Jul 15, 2020 by MD
• 95,440 points

Related Questions In Machine Learning

0 votes
1 answer
0 votes
1 answer
0 votes
1 answer
0 votes
2 answers
0 votes
1 answer
0 votes
1 answer

Epoch vs Iteration when training neural networks

In the language of neural networks, this ...READ MORE

answered Feb 10, 2022 in Machine Learning by CoolCoder
• 4,400 points
1,112 views
0 votes
3 answers

What are some best examples of AI applications in our daily life?

Hi Michael, You don’t need to be a ...READ MORE

answered Apr 9, 2020 in Machine Learning by Albert
• 160 points
1,838 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP