Leave Deep Learning Process Running on AWS and Reconnect Later

0 votes
I have been doing some deep learning on simple datasets that can run in under 1 hour. However, as I am starting to work on bigger projects I want to run them on AWS and still some of them need a very long time to run (several hours if not days). Ideally, I would like to be able to leave them running, switch off my laptop and come back at a later date and check on them.

My questions is essentially:

1, Once I have ssh'd into my instance and set the Python script running, is there anything I need to type to tell it that I will be leaving it?

2, Can I just exit the terminal directly and turn my laptop off or will this interrupt the process?

3, When I come back at a later date and ssh back into the terminal, what do I need to type to reconnect with the process that has been running?

4, How can I check how far it has progressed/how far it has left to go (my Python script outputs number of epochs/batches)
Apr 23, 2018 in AWS by Flying geek
• 3,210 points
34 views

1 answer to this question.

0 votes

You can run the process in a screen which will allow you to disconnect and reconnect without interrupting the process.

  1. SSH into instance
  2. Type 'screen'
  3. Run script
  4. Ctrl+a Ctrl+d to detach

You can now disconnect.

Reattach to the screen by typing 'screen -r'

You can have multiple screens and you can simply attach to this using the PID

For more information on screen Screen User's Manual

answered Apr 23, 2018 by Cloud gunner
• 4,630 points

Related Questions In AWS

0 votes
1 answer
0 votes
0 answers

Is it possible to use Prometheus and graffana on AWS?

Can I use Prometheus and graffana on ...READ MORE

Feb 6 in AWS by anonymous
• 9,500 points
45 views
+3 votes
4 answers

How to host a website on AWS?

Certainly, it can be used to do ...READ MORE

answered Mar 29, 2018 in AWS by brat_1
• 7,170 points
178 views
+1 vote
2 answers

Starting with an AWS Instance with API and AUTHPARAMS

The API is usually much easier to ...READ MORE

answered Apr 17, 2018 in AWS by Cloud gunner
• 4,630 points
827 views
0 votes
1 answer

Deploy Docker Containers from Docker Cloud

To solve this problem, I followed advice ...READ MORE

answered Sep 3, 2018 in AWS by Priyaj
• 57,530 points
449 views
+13 votes
2 answers

Git management technique when there are multiple customers and need multiple customization?

Consider this - In 'extended' Git-Flow, (Git-Multi-Flow, ...READ MORE

answered Mar 26, 2018 in DevOps & Agile by DragonLord999
• 8,400 points
421 views
0 votes
1 answer
0 votes
2 answers

Receiving SMS from users and stores in AWS

As far as I know, receiving international ...READ MORE

answered Aug 21, 2018 in AWS by Priyaj
• 57,530 points
146 views