Defining multiple schedules in same data pipeline

0 votes

Can you define multiple schedules for different activities in the same pipeline? If yes, how? I couldn't find a proper solution for this anywhere.

Nov 15, 2018 in AWS by datageek
• 3,000 points
35 views

1 answer to this question.

0 votes

Yes, simply define multiple schedule objects in your pipeline definition file and associate the desired schedule to the correct activity via its schedule field. This allows you to define a pipeline in which, for example, log files are stored in Amazon S3 each hour to drive generation of an aggregate report one time per day.

answered Nov 15, 2018 by Archana
• 5,480 points

Related Questions In AWS

0 votes
1 answer

Trying to upload data stream in Amazon S3

Try adding the ContentType & ACL in ...READ MORE

answered Jun 28, 2018 in AWS by Cloud gunner
• 4,260 points
250 views
0 votes
1 answer

AWS S3 pricing for data in/out.

All traffic from mobile phones to S3 ...READ MORE

answered Jul 6, 2018 in AWS by Priyaj
• 56,160 points
31 views
0 votes
1 answer

In Amazon Data Pipeline, how to make sure only once instance of a pipeline is running at any time?

On the CopyTablesActivity, you could set a lateAfterTimeout attribute ...READ MORE

answered Sep 19, 2018 in AWS by Priyaj
• 56,160 points
196 views
0 votes
1 answer
0 votes
1 answer
0 votes
1 answer

On what resources does AWS Data Pipeline activities run?

AWS Data Pipeline activities are run on ...READ MORE

answered Nov 15, 2018 in AWS by Archana
• 5,480 points
26 views