Using EC2 instance to access S3 bucket locally

Question

Both the above-mentioned entities lie in the same region. I need to access large files around 20 mbs using my EC2 instance.

I open programmatically access these files using EC2 with python?

Is there a way to make it happen?

Answer 1

Let us get this straight you will have to deal with the objects that get downloaded in the background from S3 to your EC2. You need to do two things, one install plugin. I am referring to one of the several plugins for S3 file system fo fuse. After that you may use boto for accessing S3 objects which is the second thing I was referring to.

Answer 2

You can use the s3-fuse to do this.

https://github.com/s3fs-fuse/s3fs-fuse

You can use Python to then copy your files from your S3 bucket to you EC2 instance.

Answer 3

You can use the boto library to access your s3 bucket.

You can use Python code to play with the AWS Services. You can use fuctions of boto3 to copy files from s3 bucket to your instance.