What is the actual meaning implied by information gain in data mining

0 votes
But what I don't understand is what is exactly the meaning of this information gain?
Mar 2 in Machine Learning by Nandini
• 5,480 points
17 views

1 answer to this question.

0 votes
Information gain works on the concept of entropy.
The entropy of a dataset before and after a transformation is used to calculate information gain.
Entropy is the measure of uncertainty in the data. The effort is to reduce the entropy and maximize the information gain. The feature having the most information is considered important by the algorithm and is used for training the model.
Information gain is a way to find the relevant and best features from the data set. This ensures that model gives good prediction.
Decision Tree and Random forest also can use Information gain (or Gini Coefficient)  to find the best split for the tree.
If Entropy is zero this means that no information can be gained from the feature. The higher the entropy the harder it is to draw conclusions from the data.
answered Mar 2 by Dev
• 6,000 points

Related Questions In Machine Learning

0 votes
1 answer
0 votes
1 answer

What is information gain? - Decision tree algo

You can use information gain to decide ...READ MORE

answered May 14, 2019 in Machine Learning by Raj
848 views
0 votes
1 answer
0 votes
1 answer

Is there any easy way to fill in missing data?

You can try the following code: First, you ...READ MORE

answered Jun 20, 2018 in Data Analytics by DataKing99
• 8,240 points
490 views
0 votes
1 answer

SMOTE-function not working in R

If you convert 'y' to a factor, ...READ MORE

answered Jun 27, 2018 in Data Analytics by CodingByHeart77
• 3,720 points
1,906 views
0 votes
1 answer

How to find out cluster center mean of DBSCAN in R?

Just index back into the original data ...READ MORE

answered Jun 27, 2018 in Data Analytics by Sahiti
• 6,360 points
742 views
0 votes
1 answer

Create vector matrix of movie ratings using R project?

Why do'nt you try the dcast function, in the reshape2 package. d ...READ MORE

answered Jun 30, 2018 in Data Analytics by anonymous
530 views
0 votes
1 answer

What is "entropy and information gain"?

Entropy is uncertainty/ randomness in the data, ...READ MORE

answered Mar 2 in Machine Learning by Dev
• 6,000 points
24 views
webinar REGISTER FOR FREE WEBINAR X
Send OTP
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP