L2 regularization in Logistic regression vs NN

0 votes
What is L2 regularization in logistic regression and neural networks.
Mar 2 in Machine Learning by Dev
• 6,000 points
107 views

1 answer to this question.

0 votes

L2 Regularization is known as Ridge Regression. Regularization is done to prevent overfitting. In L2 regularization the less important features will not become zero.
When we look at model complexity as a function of weights, we can see that the complexity of a feature is proportional to its weight's absolute value.
Z = w1q1 + w2q2+ w3q3+....+wnqn

L2 regularization terms :
(w1)2+ (w2)2+.........+ (wn)2
Weights are pushed toward zero by L2 regularization, but they are not made exactly zero. At each iteration, L2 regularization operates as a force that removes a small percentage of weights. As a result, weights will never be zero.
L2 is used to reduce overfitting of the model and is one of the regularization techniques.

Neural Networks are deployed to draw patterns from huge data, Neural network has input and output layers , weights and bias value and can have multiple hidden layers. The more the layers in a network the more complex it becomes and is called a deppe neural network.
Neural network uses
A neural network's weight parameter alters input data in the network's hidden layers.

Each time a neural network is updated, L2 is employed to lessen the weight and update is performed. This way L2 is used to reduce overfitting.

answered Mar 2 by Nandini
• 5,480 points

Related Questions In Machine Learning

0 votes
1 answer

Can we change the sigmoid with tanh in Logistic regression transforms??

Hi@Deepanshu, Yes, you can use tanh instead of ...READ MORE

answered May 12, 2020 in Machine Learning by MD
• 95,360 points
981 views
0 votes
1 answer

Bad logistic regression in trivial example [scikit-learn]

This is due to the process of ...READ MORE

answered Mar 17 in Machine Learning by Dev
• 6,000 points
38 views
0 votes
1 answer

Can we use Normal Equation for Logistic Regression ?

Well not likely,  only one discriminative method ...READ MORE

answered Feb 24 in Machine Learning by Nandini
• 5,480 points
151 views
0 votes
1 answer

Can we use Normal Equation for Logistic Regression ?

Unfortunately, only one discriminative method in classification ...READ MORE

answered Mar 30 in Machine Learning by Dev
• 6,000 points
49 views
0 votes
1 answer
0 votes
1 answer
0 votes
1 answer
0 votes
1 answer
webinar REGISTER FOR FREE WEBINAR X
Send OTP
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP