What is cross-entropy

0 votes
I know that there are a lot of explanations of what cross-entropy is, but I'm still confused.
Feb 23, 2022 in Machine Learning by Nandini
• 5,480 points
469 views

1 answer to this question.

0 votes

Cross-entropy is taken from the information theory field. It helps in calculation difference between two probability distributions, when we want to compare the distributions.


In Machine Learning, cross entropy is used to compare the actual and predicted outcomes.
In the above Equation,

x is the total number of values and p(x) is the probability of distribution in the real world. In the projected distribution B, A is the probability distribution and q(x) is the probability of distribution

Entropy is used as a loss function when optimizing classification problems

answered Feb 23, 2022 by Dev
• 6,000 points

Related Questions In Machine Learning

0 votes
1 answer

What is Unsupervised Learning?

Unsupervised Learning is the training of machine ...READ MORE

answered May 8, 2019 in Machine Learning by Alok
1,139 views
0 votes
1 answer

What is semi-supervised machine learning?

Hi@Ganesh, Semi-supervised machine learning is a combination of ...READ MORE

answered Jul 19, 2020 in Machine Learning by MD
• 95,440 points
782 views
0 votes
1 answer

What is Reinforcement learning?

Alright, let me not get into the ...READ MORE

answered May 9, 2019 in Machine Learning by Alok
1,133 views
0 votes
1 answer

What is the process involved in machine Learning?

Discussing this on a high level, these ...READ MORE

answered May 10, 2019 in Machine Learning by Rhea
1,295 views
0 votes
1 answer

Use different distance formula other than euclidean distance in k means

K-means is based on variance minimization. The sum-of-variance formula ...READ MORE

answered Jun 21, 2018 in Data Analytics by Sahiti
• 6,370 points
1,395 views
0 votes
1 answer

Overfitting vs Underfitting

In statistics and machine learning, one of ...READ MORE

answered Jul 11, 2018 in Data Analytics by CodingByHeart77
• 3,740 points
920 views
+1 vote
1 answer

How to handle Nominal Data?

Nominal data is basically data which can ...READ MORE

answered Jul 24, 2018 in Data Analytics by Abhi
• 3,720 points
460 views
+2 votes
2 answers

How to handle outliers

There are multiple ways to handle outliers ...READ MORE

answered Jul 24, 2018 in Data Analytics by Abhi
• 3,720 points
705 views
0 votes
1 answer

What is "entropy and information gain"?

Entropy is uncertainty/ randomness in the data, ...READ MORE

answered Mar 2, 2022 in Machine Learning by Dev
• 6,000 points
18,747 views
0 votes
1 answer

What is difference between loss function and RMSE in Machine Learning?

The loss function is a function of ...READ MORE

answered Feb 23, 2022 in Machine Learning by Dev
• 6,000 points
2,384 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP