AWS: S3 Request Limit

0 votes

I am dealing with an error saying slow down. Now here is my setup. 400 spot instances and multiple processes in each of these instances. All of these write to a single bucket. Do we have limit that is causing this limitation?

May 18, 2018 in Cloud Computing by DragonLord999
• 8,380 points
22 views

1 answer to this question.

0 votes
Get in touch with AWS see if they can cap your list requests. Because you have too many requests going to the same bucket.

Try dealing with your problem using AWS SQS, easier to implement and may solve your issue of custom queues
answered May 18, 2018 by code_ninja
• 6,220 points

Related Questions In Cloud Computing

+4 votes
4 answers

AWS S3 cli isn’t working on Windows server

The error message has nothing to do ...READ MORE

answered Aug 20, 2018 in Cloud Computing by Priyaj
• 56,520 points
139 views
+3 votes
6 answers

Are the S3 buckets in AWS, Region Specific?

Yes S3 buckets are region specific. When you ...READ MORE

answered Oct 16, 2018 in Cloud Computing by Rijo
1,259 views
+4 votes
3 answers

AWS S3 pricing - data transfer in/out

All traffic FROM mobile phones to S3 ...READ MORE

answered Oct 16, 2018 in Cloud Computing by anish
81 views
+3 votes
5 answers

AWS EFS vs EBS vs S3 (differences & when to use?)

EFS is: May not yet be available in ...READ MORE

answered Apr 9, 2018 in Cloud Computing by hemant
• 5,750 points
1,295 views
+2 votes
3 answers

AWS S3 copy files and folders between two buckets

A simplified example using the aws-sdk gem: AWS.config(:access_key_id ...READ MORE

answered Aug 16, 2018 in Cloud Computing by Priyaj
• 56,520 points
657 views
+2 votes
2 answers

Is there a way to add cache control in AWS S3?

use of  current upstream master branch will ...READ MORE

answered Apr 10, 2018 in Cloud Computing by hemant
• 5,750 points
839 views
0 votes
1 answer

Is there a way to transfer files between AWS s3 and ec2

The answer is a definite yes yes. ...READ MORE

answered Apr 17, 2018 in Cloud Computing by brat_1
• 7,080 points
49 views
0 votes
1 answer

What is the difference between AWS S3 Bucket Log Vs AWS CloudTrail

Let me give you a few pointers: In ...READ MORE

answered Apr 19, 2018 in Cloud Computing by brat_1
• 7,080 points
261 views
0 votes
1 answer

Keeping AWS S3 safe from request Attack?

Yes this is possible, because I don’t ...READ MORE

answered May 11, 2018 in Cloud Computing by code_ninja
• 6,220 points
20 views
+4 votes
2 answers

How come AWS S3 is erasing my extension from PDF files?

I think the problem should be with ...READ MORE

answered Mar 27, 2018 in Cloud Computing by code_ninja
• 6,220 points
91 views