AWS: S3 Request Limit

0 votes

I am dealing with an error saying slow down. Now here is my setup. 400 spot instances and multiple processes in each of these instances. All of these write to a single bucket. Do we have limit that is causing this limitation?

May 18, 2018 in Cloud Computing by DragonLord999
• 8,380 points
31 views

1 answer to this question.

0 votes
Get in touch with AWS see if they can cap your list requests. Because you have too many requests going to the same bucket.

Try dealing with your problem using AWS SQS, easier to implement and may solve your issue of custom queues
answered May 18, 2018 by code_ninja
• 6,220 points

Related Questions In Cloud Computing

+4 votes
4 answers

AWS S3 cli isn’t working on Windows server

The error message has nothing to do ...READ MORE

answered Aug 20, 2018 in Cloud Computing by Priyaj
• 56,940 points
170 views
+3 votes
6 answers

Are the S3 buckets in AWS, Region Specific?

Yes S3 buckets are region specific. When you ...READ MORE

answered Oct 16, 2018 in Cloud Computing by Rijo
2,174 views
+4 votes
3 answers

AWS S3 pricing - data transfer in/out

All traffic FROM mobile phones to S3 ...READ MORE

answered Oct 16, 2018 in Cloud Computing by anish
91 views
+3 votes
5 answers

AWS EFS vs EBS vs S3 (differences & when to use?)

EFS is: May not yet be available in ...READ MORE

answered Apr 9, 2018 in Cloud Computing by hemant
• 5,750 points
1,552 views
+2 votes
3 answers

AWS S3 copy files and folders between two buckets

A simplified example using the aws-sdk gem: AWS.config(:access_key_id ...READ MORE

answered Aug 16, 2018 in Cloud Computing by Priyaj
• 56,940 points
806 views
+2 votes
2 answers

Is there a way to add cache control in AWS S3?

use of  current upstream master branch will ...READ MORE

answered Apr 10, 2018 in Cloud Computing by hemant
• 5,750 points
1,195 views
0 votes
1 answer

Is there a way to transfer files between AWS s3 and ec2

The answer is a definite yes yes. ...READ MORE

answered Apr 17, 2018 in Cloud Computing by brat_1
• 7,080 points
64 views
0 votes
1 answer

What is the difference between AWS S3 Bucket Log Vs AWS CloudTrail

Let me give you a few pointers: In ...READ MORE

answered Apr 19, 2018 in Cloud Computing by brat_1
• 7,080 points
310 views
0 votes
1 answer

Keeping AWS S3 safe from request Attack?

Yes this is possible, because I don’t ...READ MORE

answered May 11, 2018 in Cloud Computing by code_ninja
• 6,220 points
29 views
+4 votes
2 answers

How come AWS S3 is erasing my extension from PDF files?

I think the problem should be with ...READ MORE

answered Mar 27, 2018 in Cloud Computing by code_ninja
• 6,220 points
143 views