On what resources does AWS Data Pipeline activities run

0 votes

On what resources does AWS Data Pipeline activities run? Does Amazon EMR and EC2 come under resources as well?

Nov 16, 2018 in AWS by datageek
• 3,090 points
824 views

1 answer to this question.

0 votes

AWS Data Pipeline activities are run on compute resources that you own. 

Yes, Amazon EMR & EC2 included. 

There are two types of compute resources: AWS Data Pipeline–managed and self-managed. AWS Data Pipeline–managed resources are Amazon EMR clusters or Amazon EC2 instances that the AWS Data Pipeline service launches only when they're needed. Resources that you manage are longer running and can be any resource capable of running the AWS Data Pipeline Java-based Task Runner

Example: on-premise hardware, a customer-managed Amazon EC2 instance, etc

answered Nov 16, 2018 by Archana
• 5,640 points

Related Questions In AWS

+1 vote
2 answers

How do I run python script on aws EC2 instance(ubuntu)?

I believe that you are using the ...READ MORE

answered Apr 17, 2018 in AWS by Cloud gunner
• 4,670 points
10,368 views
0 votes
1 answer

AWS is 99.999% durable what does that mean?

you can look into this hope this ...READ MORE

answered Jul 10, 2018 in AWS by Priyaj
• 58,020 points
1,161 views
0 votes
1 answer

What happens to data if the data center goes down in AWS?

When it comes to the security and ...READ MORE

answered Jul 13, 2018 in AWS by Priyaj
• 58,020 points

edited Jul 13, 2018 by Priyaj 2,481 views
0 votes
1 answer

In Amazon Data Pipeline, how to make sure only once instance of a pipeline is running at any time?

On the CopyTablesActivity, you could set a lateAfterTimeout attribute ...READ MORE

answered Sep 19, 2018 in AWS by Priyaj
• 58,020 points
2,204 views
0 votes
1 answer
0 votes
1 answer
0 votes
1 answer

Is aws glue new service? What data sources does it support?

It's not a new service. And was ...READ MORE

answered May 22, 2019 in AWS by Archana
• 5,640 points
948 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP