Want to Leave Deep Learning Process Running on AWS and then reconnect later

0 votes
I am working on deep learning with simple datasets that I run in under 1 hour.
However, as I will start to work on bigger projects I want to run them on AWS and still some of them need a very long time. I want to leave them in a running state, even after switching off my laptop and see the working state.

My questions are:

1. Once I have entered into my instance using SSH and set the Python script running, is there anything I need to type to tell it that I will be leaving it?

2. If I just exit the terminal directly and turn my laptop off or will this interrupt the process?

3. When I come back at a later date and ssh back into the terminal, what do I need to type to reconnect with the process that has been running?

4. How can I check how far it has progressed/how far it has left to go, also my Python script outputs number of epochs/batches
Jun 4, 2018 in AWS by Flying geek
• 3,260 points
49 views

1 answer to this question.

0 votes

You can run the process in a screen which will allow you to disconnect and reconnect without interrupting the process.

  1. SSH into instance
  2. Type 'screen'
  3. Run script
  4. Ctrl+a Ctrl+d to detach

You can now disconnect.

Reattach to the screen by typing 'screen -r'

You can have multiple screens and you can simply attach to this using the PID

For more information on screen, check out their screen manual: CLICK HERE

answered Jun 4, 2018 by Cloud gunner
• 4,650 points

Related Questions In AWS

0 votes
1 answer
0 votes
0 answers

Is it possible to use Prometheus and graffana on AWS?

Can I use Prometheus and graffana on ...READ MORE

Feb 6 in AWS by anonymous
• 16,730 points
162 views
+1 vote
1 answer
+2 votes
1 answer

Deploy Docker Containers from Docker Cloud

To solve this problem, I followed advice ...READ MORE

answered Sep 3, 2018 in AWS by Priyaj
• 57,660 points
784 views
0 votes
1 answer

Deploy multiple platforms to Elastic Beanstalk

Solve by using .ebextentions to run pre-install commands in ...READ MORE

answered Nov 28, 2018 in AWS by Archana
• 5,600 points
209 views
0 votes
1 answer