L2 regularization in Logistic regression vs NN

0 votes
What is L2 regularization in logistic regression and neural networks.
Mar 2, 2022 in Machine Learning by Dev
• 6,000 points
1,863 views

1 answer to this question.

0 votes

L2 Regularization is known as Ridge Regression. Regularization is done to prevent overfitting. In L2 regularization the less important features will not become zero.
When we look at model complexity as a function of weights, we can see that the complexity of a feature is proportional to its weight's absolute value.
Z = w1q1 + w2q2+ w3q3+....+wnqn

L2 regularization terms :
(w1)2+ (w2)2+.........+ (wn)2
Weights are pushed toward zero by L2 regularization, but they are not made exactly zero. At each iteration, L2 regularization operates as a force that removes a small percentage of weights. As a result, weights will never be zero.
L2 is used to reduce overfitting of the model and is one of the regularization techniques.

Neural Networks are deployed to draw patterns from huge data, Neural network has input and output layers , weights and bias value and can have multiple hidden layers. The more the layers in a network the more complex it becomes and is called a deppe neural network.
Neural network uses
A neural network's weight parameter alters input data in the network's hidden layers.

Each time a neural network is updated, L2 is employed to lessen the weight and update is performed. This way L2 is used to reduce overfitting.

answered Mar 2, 2022 by Nandini
• 5,480 points

Related Questions In Machine Learning

0 votes
1 answer

Can we change the sigmoid with tanh in Logistic regression transforms??

Hi@Deepanshu, Yes, you can use tanh instead of ...READ MORE

answered May 12, 2020 in Machine Learning by MD
• 95,460 points
2,739 views
0 votes
1 answer

Bad logistic regression in trivial example [scikit-learn]

This is due to the process of ...READ MORE

answered Mar 17, 2022 in Machine Learning by Dev
• 6,000 points
617 views
0 votes
1 answer

Can we use Normal Equation for Logistic Regression ?

Well not likely,  only one discriminative method ...READ MORE

answered Feb 24, 2022 in Machine Learning by Nandini
• 5,480 points
1,024 views
0 votes
1 answer

Can we use Normal Equation for Logistic Regression ?

Unfortunately, only one discriminative method in classification ...READ MORE

answered Mar 30, 2022 in Machine Learning by Dev
• 6,000 points
1,037 views
0 votes
1 answer
0 votes
1 answer
0 votes
1 answer
0 votes
1 answer
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP