Defining multiple schedules in same data pipeline

Question

Can you define multiple schedules for different activities in the same pipeline? If yes, how? I couldn't find a proper solution for this anywhere.

Answer 1

Yes, simply define multiple schedule objects in your pipeline definition file and associate the desired schedule to the correct activity via its schedule field. This allows you to define a pipeline in which, for example, log files are stored in Amazon S3 each hour to drive generation of an aggregate report one time per day.