Want to Leave Deep Learning Process Running on AWS and then reconnect later

0 votes
I am working on deep learning with simple datasets that I run in under 1 hour.
However, as I will start to work on bigger projects I want to run them on AWS and still some of them need a very long time. I want to leave them in a running state, even after switching off my laptop and see the working state.

My questions are:

1. Once I have entered into my instance using SSH and set the Python script running, is there anything I need to type to tell it that I will be leaving it?

2. If I just exit the terminal directly and turn my laptop off or will this interrupt the process?

3. When I come back at a later date and ssh back into the terminal, what do I need to type to reconnect with the process that has been running?

4. How can I check how far it has progressed/how far it has left to go, also my Python script outputs number of epochs/batches
Jun 4, 2018 in AWS by Flying geek
• 3,160 points
23 views

1 answer to this question.

0 votes

You can run the process in a screen which will allow you to disconnect and reconnect without interrupting the process.

  1. SSH into instance
  2. Type 'screen'
  3. Run script
  4. Ctrl+a Ctrl+d to detach

You can now disconnect.

Reattach to the screen by typing 'screen -r'

You can have multiple screens and you can simply attach to this using the PID

For more information on screen, check out their screen manual: CLICK HERE

answered Jun 4, 2018 by Cloud gunner
• 4,280 points

Related Questions In AWS

0 votes
1 answer
+1 vote
3 answers

Log in to AWS using Access Key ID and Secret Access Key ID

Access keys consist of an access key ...READ MORE

answered Aug 17, 2018 in AWS by Priyaj
• 56,900 points
996 views
+1 vote
3 answers

Unable to login to parse dashboard on AWS

I had the same issue, which I ...READ MORE

answered Aug 28, 2018 in AWS by eatcodesleeprepeat
• 4,670 points
622 views
0 votes
1 answer

Want to use an AWS Cognito User Pool without putting a password(for an easier approach)

Currently, AWS Cognito is not supporting passwordless ...READ MORE

answered May 4, 2018 in AWS by Cloud gunner
• 4,280 points
1,450 views
0 votes
1 answer

Deploy Docker Containers from Docker Cloud

To solve this problem, I followed advice ...READ MORE

answered Sep 3, 2018 in AWS by Priyaj
• 56,900 points
186 views
0 votes
1 answer

Deploy multiple platforms to Elastic Beanstalk

Solve by using .ebextentions to run pre-install commands in ...READ MORE

answered Nov 28, 2018 in AWS by Archana
• 5,560 points
68 views
0 votes
1 answer