Running JAR file on Amazon EMR created using Hadoop 2.7.5

+4 votes

 Amazon EMR has changed it's hadoop version from 2.7.3 to 2.8.3 and there is no option for 2.7.5. the fact that, I am using custom jar which was created using hadoop 2.7.5. Is there any way to run that JAR on Amazon EMR? The cluster  terminates with error each time I  try to run that jar using existing EMR version (either with hadoop 2.7.3 or 2.8.3) which is logical.

Mar 27, 2018 in Cloud Computing by code_ninja
• 6,220 points
237 views

2 answers to this question.

0 votes

Amazon keeps all its EMR versions intact. All you need to do while lauching a EMR job is specify the release lable. E.g. for 2.7.3, I use emr-5.11.0 . Here is detailed info :

https://docs.aws.amazon.com/emr/latest/ReleaseGuide/images/emr-releases-5x.png

answered Mar 27, 2018 by hemant
• 5,750 points
0 votes

I suggest you recompile the code or downgrade back to 2.7.3, which should be able to run most 2.7.5 code

answered Oct 11, 2018 by findingbugs
• 4,750 points

Related Questions In Cloud Computing

+3 votes
3 answers

Is there a way to install apache drill on an EMR cluster on AWS that is already Running?

It looks to be trying to get ...READ MORE

answered Oct 11, 2018 in Cloud Computing by findingbugs
• 4,750 points
290 views
0 votes
1 answer

Can you filter through the created tags by using S3 file tagging?

You cannot filter with S3 file tagging ...READ MORE

answered May 8, 2018 in Cloud Computing by Meci Matt
• 9,420 points
16 views
0 votes
1 answer

Can you mirror Amazon S3 bucket using Amazon Glacier?

Yes you can mirror Amazon S3 bucket ...READ MORE

answered Apr 19, 2018 in Cloud Computing by brat_1
• 7,080 points
142 views
+1 vote
2 answers

AWS: Four node cluster on Hadoop

Follow the following step one by one ...READ MORE

answered Aug 21, 2018 in Cloud Computing by Priyaj
• 56,520 points
29 views
0 votes
1 answer

Is there a way to simulate perimeter security using Amazon Web Services Model?

As we all know traditional perimeter security ...READ MORE

answered Jul 9, 2018 in Cloud Computing by DragonLord999
• 8,380 points
28 views
0 votes
1 answer

AWS: Is there a way to simulate perimeter security using Amazon Web Services Model?

As we all know traditional perimeter security ...READ MORE

answered Jul 11, 2018 in Cloud Computing by DragonLord999
• 8,380 points
185 views
0 votes
1 answer

What are the benefits of using Cloud over On-premise data centers ?

Cloud is also Data centers just with ...READ MORE

answered Jul 13, 2018 in Cloud Computing by Priyaj
• 56,520 points
40 views
0 votes
1 answer

How to increase the EBS volume size of an instance that is on running state ?

Unluckily, it is not possible to increase ...READ MORE

answered Jul 17, 2018 in Cloud Computing by Gopalan
• 1,260 points
74 views
+2 votes
4 answers

Scaling Amazon EBS Volume sizes

You can grow the storage or compress ...READ MORE

answered Oct 25, 2018 in Cloud Computing by prashant
60 views
0 votes
3 answers

Using EC2 instance to access S3 bucket locally

You can use the boto library to ...READ MORE

answered Nov 30, 2018 in Cloud Computing by Aniket
512 views