Epoch vs Iteration when training neural networks

0 votes

What is the difference between epoch and iteration when training a multi-layer perceptron?

Feb 10, 2022 in Machine Learning by Dev
• 6,000 points
10,240 views

1 answer to this question.

0 votes

Epoch can be understood as the number of times the algorithm scans the entire data. For example if we set epoch = 10 then the algorithm will scan the entire data ten times.

Whereas, Iteration is the number of times a certain batch is passed via an algorithm. In the context of Neural Networks iteration is forward and backward pass.
For Example : a dataset having 20 samples, and batch size =4, epochs= 5

Then, in each epoch, there will be 5 batches (20/4=5). Each batch will be passed by the algorithm there will be 5 iterations per epoch. Since the epochs is set as 5.
Thus, total number of iterations will be 5*5 = 25

Supercharge Your Skills with Our Machine Learning Course!

answered Feb 10, 2022 by Nandini
• 5,480 points

Related Questions In Machine Learning

0 votes
1 answer
+1 vote
0 answers

text mining new set of data in production environment expect training feature

Hi, I have trained a model based on ...READ MORE

Nov 28, 2019 in Machine Learning by MANOJ
• 130 points
908 views
0 votes
2 answers
0 votes
1 answer

Role of the bias in neural networks.

Hi@akhtar, The activation function in Neural Networks takes ...READ MORE

answered Jul 15, 2020 in Machine Learning by MD
• 95,460 points
1,587 views
0 votes
1 answer

Epoch vs Iteration when training neural networks

In the language of neural networks, this ...READ MORE

answered Feb 10, 2022 in Machine Learning by CoolCoder
• 4,420 points
1,372 views
0 votes
1 answer
0 votes
1 answer

L2 regularization in Logistic regression vs NN

L2 Regularization is known as Ridge Regression. ...READ MORE

answered Mar 2, 2022 in Machine Learning by Nandini
• 5,480 points
1,858 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP