how do I decide the throughput of the data stream

+1 vote
I am trying out Amazon's Kinesis stream for the first time. What I do not understand is, how do I decide the throughput of the data stream?
Nov 19, 2019 in AWS by Hannah
• 18,520 points
1,097 views

1 answer to this question.

0 votes

Hi @Hannah,

  1. Estimate the average size of the record written to the data stream in kilobytes
  2. Estimate the number of records written to the data stream per second
  3. Decide the number of Amazon Kinesis Applications consuming data concurrently and independently from the data stream
  4. Calculate the incoming write bandwidth
  5. Calculate the outgoing read bandwidth

Then use the following formula:

number_of_shards = max (incoming_write_bandwidth_in_KB/1000, outgoing_read_bandwidth_in_KB/2000)

answered Nov 19, 2019 by Aman

Related Questions In AWS

0 votes
1 answer
0 votes
2 answers

How do I define the principal for an AWS policy statement?

Check with AWS Policy Documentations once, rest ...READ MORE

answered Jun 26, 2018 in AWS by Cloud gunner
• 4,670 points

edited Jun 26, 2018 by Cloud gunner 1,168 views
0 votes
1 answer
0 votes
1 answer
0 votes
2 answers
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP