What is alpha in ridge regression

0 votes
What is the parameter alpha in ridge regression and how does it influence the trained regression?
Mar 2, 2022 in Machine Learning by Dev
• 6,000 points
949 views

1 answer to this question.

0 votes
‘L2 regularization‘ or Ridge Regularization  adds penalty equal to square of the magnitude of coefficients
L2 adds a factor of sum of squares of coefficients in the optimization objective. Thus, ridge regression optimizes the following:
Objective = Residual + α * (sum of square of coefficients)

Residual sum of square
(alpha) strikes a balance between minimizing Residual and minimizing the sum of squares of coefficients. may have a variety of values:
α=0 ; objective will be like linear regression

or α = ∞, coefficients will be zero
0 < α < ∞, coefficients will be between 0 and 1

Alpha would have an effect on the magnitude of the coefficients
answered Mar 2, 2022 by Nandini
• 5,480 points

Related Questions In Machine Learning

0 votes
1 answer

What is the process involved in machine Learning?

Discussing this on a high level, these ...READ MORE

answered May 10, 2019 in Machine Learning by Rhea
1,296 views
0 votes
1 answer

What is clustering in Machine Learning?

Clustering is a type of unsupervised learning ...READ MORE

answered May 10, 2019 in Machine Learning by Shridhar
944 views
0 votes
1 answer

What is greedy approach in Decision tree algorithm?

“Greedy Approach is based on the concept ...READ MORE

answered May 13, 2019 in Machine Learning by Upadhya
14,165 views
0 votes
1 answer

What is Gini Index in decision tree

Gini Index is a metric to measure ...READ MORE

answered May 14, 2019 in Machine Learning by Raj
2,115 views
+1 vote
1 answer

Machine Learning and Python Code

You can create an array called actualScore ...READ MORE

answered Dec 13, 2018 in Data Analytics by Shubham
• 13,490 points
521 views
0 votes
2 answers
0 votes
1 answer
0 votes
1 answer

what is r-squared in linear regression models?

You inquired about the code x = ...READ MORE

answered Apr 4, 2022 in Machine Learning by Nandini
• 5,480 points
572 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP