Can Someone tell about AWS Activities in AWS Data Pipeline

0 votes
Oct 8, 2018 in Cloud Computing by brat_1
• 7,080 points
52 views

1 answer to this question.

0 votes

In AWS Data Pipeline, an activity is a pipeline component that defines the work to perform. AWS Data Pipeline provides several pre-packaged activities that accommodate common scenarios, such as moving data from one location to another, running Hive queries, and so on. Activities are extensible, so you can run your own custom scripts to support endless combinations.

AWS Data Pipeline supports the following types of activities:

CopyActivity

Copies data from one location to another.

EmrActivity

Runs an Amazon EMR cluster.

HiveActivity

Runs a Hive query on an Amazon EMR cluster.

HiveCopyActivity

Runs a Hive query on an Amazon EMR cluster with support for advanced data filtering and support for S3DataNode and DynamoDBDataNode.

PigActivity

Runs a Pig script on an Amazon EMR cluster.

RedshiftCopyActivity

Copies data to and from Amazon Redshift tables.

ShellCommandActivity

Runs a custom UNIX/Linux shell command as an activity.

SqlActivity

Runs a SQL query on a database.

Some activities have special support for staging data and database tables. For more information, see Staging Data and Tables with Pipeline Activities.

answered Oct 8, 2018 by Meci Matt
• 9,420 points

Related Questions In Cloud Computing

0 votes
1 answer

Can someone tell me about AWS Aurora?

Amazon Aurora is a MySQL and PostgreSQL ...READ MORE

answered Sep 20, 2018 in Cloud Computing by DragonLord999
• 8,380 points
45 views
0 votes
1 answer

Can someone tell about Amazon Web Services Certificate Manager?

Amazon Web Services security manager handles the ...READ MORE

answered Jul 9, 2018 in Cloud Computing by Meci Matt
• 9,420 points
24 views
0 votes
1 answer

AWS: Can someone tell me what is a Certificate Manager?

Amazon Web Services security manager handles the ...READ MORE

answered Jul 10, 2018 in Cloud Computing by DragonLord999
• 8,380 points
24 views
0 votes
1 answer

AWS: Can Someone brief me about Elastic Block Storage

EBS is virtual storage area network (SAN) ...READ MORE

answered Jul 16, 2018 in Cloud Computing by hemant
• 5,750 points
38 views
0 votes
1 answer

Can Someone tell me why do we need AWS cloud watch?

Amazon CloudWatch is a monitoring and management ...READ MORE

answered Aug 2, 2018 in Cloud Computing by Meci Matt
• 9,420 points
27 views
0 votes
1 answer

Can someone tell me what is AWS MQ?

Amazon MQ is a managed message broker ...READ MORE

answered Aug 14, 2018 in Cloud Computing by hemant
• 5,750 points
32 views
0 votes
1 answer

Can someone tell me what is AWS Lex?

Amazon Lex is a service for building ...READ MORE

answered Aug 22, 2018 in Cloud Computing by DragonLord999
• 8,380 points
21 views
0 votes
1 answer

what is WAF in AWS? Can someone explain?

AWS WAF is a web application firewall ...READ MORE

answered Sep 4, 2018 in Cloud Computing by Meci Matt
• 9,420 points
33 views
0 votes
1 answer

AWS: Can someone tell about importance of Well Defined Interfaces in Loose Coupling

Loose Coupling As application complexity increases, a desirable ...READ MORE

answered Jul 31, 2018 in Cloud Computing by Meci Matt
• 9,420 points
21 views
0 votes
1 answer

Can someone tell me about AWS Code Commit?

AWS CodeCommit is a fully-managed source control service that ...READ MORE

answered Aug 21, 2018 in Cloud Computing by Meci Matt
• 9,420 points
35 views