Linear Discriminant Analysis vs Naive Bayes

0 votes
What are some advantages and disadvantages of LDA vs Naive Bayes in terms of machine learning classification?
Feb 10, 2022 in Machine Learning by Dev
• 6,000 points
2,399 views

1 answer to this question.

0 votes

There are no standards fixed as to when to use Linear Discriminant Analysis or Naive Bayes, it depends upon trials and the accuracy of the model by applying both LDA as well as Naive Bayes.
In few data sets LDA might perform well, and in other data sets chances are there that Naive Bayes will give good results.

Disadvantages of Naive Bayes:

  1. Not suitable for continuous features the features have to be converted into discrete by applying any of the techniques like one-hot encoding or label encoding, but one hot encoding leads to dummy trap and also causes multicollinearity problems, thus giving poor results.
    2) Naive Bayes makes assumptions that all the features are independent of each other, but this is rarely the case with real-life data.


Advantages of Naive Bayes:

  1. Performs better on small data sets, provided features are not correlated and are independent of each other.

  2. Works well with categorical features

  3. Naive Bayes can be used for multi-class label classification tasks.
     

Advantages of LDA

  1. LDA minimizes variance in the dataset by reducing the number of features.

  2. It is useful as it reduces the curse of dimensionality by effectively reducing the high-dimensional data into low-dimensional feature space.

Disadvantages of LDA

  1. Makes assumption requires features to be normally distributed.

  2. Does not give good results in case of unbalanced dataset.

  3. Not suitable for non-linear problems.

  4. Prone to overfitting

answered Feb 10, 2022 by Nandini
• 5,480 points

Related Questions In Machine Learning

0 votes
0 answers

Decision tree vs. Naive Bayes classifier

In which cases is it better to ...READ MORE

Feb 28, 2022 in Machine Learning by Dev
• 6,000 points
652 views
0 votes
1 answer

Classification in Naive Bayes algorithm

Hi@Ogun, The Numpy module doesn't have a predict attribute. ...READ MORE

answered Oct 5, 2020 in Machine Learning by MD
• 95,460 points
1,344 views
0 votes
1 answer

Linear Regression :: Normalization (Vs) Standardization

Your data is transformed into a range ...READ MORE

answered Mar 8, 2022 in Machine Learning by Dev
• 6,000 points
3,122 views
0 votes
1 answer
0 votes
1 answer

Assumptions of Naïve Bayes and Logistic Regression

There are very few difference between Naive ...READ MORE

answered Feb 7, 2022 in Machine Learning by Nandini
• 5,480 points
499 views
0 votes
1 answer

A simple explanation of Naïve Bayes Classification

Naive Bayes Classification uses probability to classify ...READ MORE

answered Feb 22, 2022 in Machine Learning by Nandini
• 5,480 points
497 views
0 votes
1 answer
0 votes
1 answer
0 votes
1 answer

How to specify the prior probability for scikit-learn's Naive Bayes

In GaussianNB, there is a mechanism to ...READ MORE

answered Apr 7, 2022 in Machine Learning by Nandini
• 5,480 points
1,926 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP