Epoch vs Iteration when training neural networks

0 votes

What is the difference between epoch and iteration when training a multi-layer perceptron?

Feb 10 in Machine Learning by Dev
• 6,000 points
918 views

1 answer to this question.

0 votes
Epoch can be understood as the number of times the algorithm scans the entire data. For example if we set epoch = 10 then the algorithm will scan the entire data ten times.

Whereas, Iteration is the number of times a certain batch is passed via an algorithm. In the context of Neural Networks iteration is forward and backward pass.
For Example : a dataset having 20 samples, and batch size =4, epochs= 5

Then, in each epoch, there will be 5 batches (20/4=5). Each batch will be passed by the algorithm there will be 5 iterations per epoch. Since the epochs is set as 5.
Thus, total number of iterations will be 5*5 = 25
answered Feb 10 by Nandini
• 5,480 points

Related Questions In Machine Learning

0 votes
1 answer
+1 vote
0 answers

text mining new set of data in production environment expect training feature

Hi, I have trained a model based on ...READ MORE

Nov 28, 2019 in Machine Learning by MANOJ
• 130 points
340 views
0 votes
2 answers

How do neural networks used in AI and deep learning learn?

A neural network is a hardware or software ...READ MORE

answered Apr 8, 2019 in Others by SA
• 1,050 points
441 views
0 votes
1 answer

Role of the bias in neural networks.

Hi@akhtar, The activation function in Neural Networks takes ...READ MORE

answered Jul 15, 2020 in Machine Learning by MD
• 95,380 points
865 views
0 votes
1 answer
0 votes
1 answer

L2 regularization in Logistic regression vs NN

L2 Regularization is known as Ridge Regression. ...READ MORE

answered Mar 2 in Machine Learning by Nandini
• 5,480 points
333 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP