Leave Deep Learning Process Running on AWS and Reconnect Later

0 votes
I have been doing some deep learning on simple datasets that can run in under 1 hour. However, as I am starting to work on bigger projects I want to run them on AWS and still some of them need a very long time to run (several hours if not days). Ideally, I would like to be able to leave them running, switch off my laptop and come back at a later date and check on them.

My questions is essentially:

1, Once I have ssh'd into my instance and set the Python script running, is there anything I need to type to tell it that I will be leaving it?

2, Can I just exit the terminal directly and turn my laptop off or will this interrupt the process?

3, When I come back at a later date and ssh back into the terminal, what do I need to type to reconnect with the process that has been running?

4, How can I check how far it has progressed/how far it has left to go (my Python script outputs number of epochs/batches)
Apr 23, 2018 in AWS by Flying geek
• 3,130 points
12 views

1 answer to this question.

Your answer

Your name to display (optional):
Privacy: Your email address will only be used for sending these notifications.
0 votes

You can run the process in a screen which will allow you to disconnect and reconnect without interrupting the process.

  1. SSH into instance
  2. Type 'screen'
  3. Run script
  4. Ctrl+a Ctrl+d to detach

You can now disconnect.

Reattach to the screen by typing 'screen -r'

You can have multiple screens and you can simply attach to this using the PID

For more information on screen Screen User's Manual

answered Apr 23, 2018 by Cloud gunner
• 4,240 points

Related Questions In AWS

+1 vote
2 answers

Starting with an AWS Instance with API and AUTHPARAMS

The API is usually much easier to ...READ MORE

answered Apr 17, 2018 in AWS by Cloud gunner
• 4,240 points
282 views
+1 vote
2 answers

How do I run python script on aws EC2 instance(ubuntu)?

I believe that you are using the ...READ MORE

answered Apr 17, 2018 in AWS by Cloud gunner
• 4,240 points
1,370 views
+1 vote
3 answers

Log in to AWS using Access Key ID and Secret Access Key ID

Access keys consist of an access key ...READ MORE

answered Aug 17, 2018 in AWS by Priyaj
• 56,120 points
86 views
+1 vote
3 answers

Unable to login to parse dashboard on AWS

I had the same issue, which I ...READ MORE

answered Aug 28, 2018 in AWS by eatcodesleeprepeat
• 4,670 points
383 views
0 votes
1 answer

Deploy Docker Containers from Docker Cloud

To solve this problem, I followed advice ...READ MORE

answered Sep 3, 2018 in AWS by Priyaj
• 56,120 points
57 views
+13 votes
2 answers
0 votes
1 answer
0 votes
2 answers

Receiving SMS from users and stores in AWS

As far as I know, receiving international ...READ MORE

answered Aug 21, 2018 in AWS by Priyaj
• 56,120 points
43 views

© 2018 Brain4ce Education Solutions Pvt. Ltd. All rights Reserved.
"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.