feature selection for regression vs classification

0 votes
can I perform the same feature selection for regression and classification problems? Is feature selection dependent on the type of algorithm used?
Mar 3, 2022 in Machine Learning by Dev
• 6,000 points
756 views

1 answer to this question.

0 votes
There are various feature selection processes used in Machine Learning like Filter methods, wrapper methods or embedded methods.
In case of wrapper method the feature selection is dependent upon the algorithm. Wrapper method uses greedy strategy, assessing all potential feature combinations against the evaluation criterion
Wrapper methods, on average, have a higher predictive accuracy than filter approaches.
Forward feature selection, backward feature elimination, exhaustive feature selection and recursive feature elimination are a few wrapper method techniques.
Filter methods select the relevant methods and do not interact with the classifier to name a few filter methods are ANOVA, Chi-Square, Fisher’s score.
Embedded methods are a combination of filter and wrapper methods. Lasso Regularization, Elastic Net are a few embedded methods.
It depends upon the methods used whether feature selection will be dependent or independent on the algorithm.
answered Mar 3, 2022 by Nandini
• 5,480 points

Related Questions In Machine Learning

0 votes
1 answer
0 votes
1 answer

Python script for linear regression on panda dataframe

Use the following code: from scipy import stats slope, ...READ MORE

answered May 23, 2019 in Machine Learning by Imran
1,998 views
0 votes
1 answer
0 votes
1 answer

Difference between classification and regression score in Python scikit learn

Classification Score is used for discrete values ...READ MORE

answered Feb 24, 2022 in Machine Learning by Nandini
• 5,480 points
609 views
0 votes
1 answer

Why is random_state required for ridge & lasso regression classifiers?

This is because the regression coefficients of ...READ MORE

answered Mar 2, 2022 in Machine Learning by Nandini
• 5,480 points
1,142 views
0 votes
1 answer

Difference between Regression and classification in Machine Learning?

The goal of regression is to forecast ...READ MORE

answered Mar 4, 2022 in Machine Learning by Dev
• 6,000 points
875 views
0 votes
0 answers

Error in Python script "Expected 2D array, got 1D array instead:"?

I wanted to make this ML prediction: import ...READ MORE

May 18, 2022 in Python by Kichu
• 19,040 points
1,551 views
0 votes
1 answer

Crawling after login in Python

You missed a few login data forms, ...READ MORE

answered Sep 7, 2018 in Python by Priyaj
• 58,020 points
1,690 views
0 votes
1 answer

Classification vs Regression?

You are correct: categorization applies a label ...READ MORE

answered Mar 9, 2022 in Machine Learning by Nandini
• 5,480 points
774 views
0 votes
1 answer

Can we use Normal Equation for Logistic Regression ?

Well not likely,  only one discriminative method ...READ MORE

answered Feb 24, 2022 in Machine Learning by Nandini
• 5,480 points
1,020 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP