Can we use Normal Equation for Logistic Regression

0 votes
Just like we use the Normal Equation to find out the optimum theta value in Linear Regression, can/can't we use a similar formula for Logistic Regression ?
Feb 24, 2022 in Machine Learning by Dev
• 6,000 points
993 views

1 answer to this question.

0 votes
Well not likely,  only one discriminative method in classification theory, linear regression... (linear discriminant analysis/fischer discriminant are generative, and even they have a closed form solution due to the extreme simplicity of the distributions fitted).
So, what made Normal Equation so successful in linear regression? Because once you've computed your derivatives, you'll find that the outcome is a set of linear equations, m equations with m variables, which we know can be solved directly using matrix inversions (and other techniques). When logistic regression costs are differentiated, the resultant issue is no longer linear... it is convex (thus global optimum), but not linear, and as a result, present mathematics does not offer us with tools powerful enough to identify the optimum in closed form solution.
answered Feb 24, 2022 by Nandini
• 5,480 points

Related Questions In Machine Learning

0 votes
1 answer

Can we change the sigmoid with tanh in Logistic regression transforms??

Hi@Deepanshu, Yes, you can use tanh instead of ...READ MORE

answered May 12, 2020 in Machine Learning by MD
• 95,460 points
2,681 views
0 votes
1 answer
0 votes
1 answer

Why do we use gradient descent in linear regression?

An example you gave is one-dimensional, which ...READ MORE

answered Mar 23, 2022 in Machine Learning by Dev
• 6,000 points
1,422 views
0 votes
1 answer

L2 regularization in Logistic regression vs NN

L2 Regularization is known as Ridge Regression. ...READ MORE

answered Mar 2, 2022 in Machine Learning by Nandini
• 5,480 points
1,826 views
0 votes
1 answer

Can we use Normal Equation for Logistic Regression ?

Unfortunately, only one discriminative method in classification ...READ MORE

answered Mar 30, 2022 in Machine Learning by Dev
• 6,000 points
994 views
0 votes
1 answer
0 votes
1 answer
0 votes
1 answer
0 votes
1 answer

What is the difference between linear regression and logistic regression?

Hi Dev, to answer your question Linear Regression ...READ MORE

answered Feb 2, 2022 in Machine Learning by Nandini
• 5,480 points
1,144 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP