Where can I find hadoop-streaming jar JAR file

0 votes

I am following a tutorial & executing a Amazon EMR ( Elastic MapReduce )
Code

The error which I am receiving is:

Not a valid JAR: /home/hadoop/contrib/streaming/hadoop-streaming.jar

The steps that i took are after entering the credentials in putty

1) mkdir streamingCode`

2) wget -o ./streamingCode/wordSplitter.py s3://elasticmapreduce/samples/wordcount/wordSplitter.py

3) hadoop jar contrib/streaming/hadoop-streaming.jar -files streamingCode/wordSplitter.py -mapper wordSplitter.py input s3://elasticmapreduce/samples/wordcount/input -output streamingCode/wordCountOut -reducer aggregate`

While executing step 4 I am getting the error.

Mar 21, 2018 in Big Data Hadoop by Shubham
• 13,490 points
6,422 views

1 answer to this question.

0 votes

You will find the streaming jar here: /usr/lib/hadoop-mapreduce/hadoop-streaming.jar For further details refer: https://docs.aws.amazon.com/emr/latest/ReleaseGuide/UseCase_Streaming.html

answered Mar 21, 2018 by coldcode
• 2,080 points

Related Questions In Big Data Hadoop

0 votes
1 answer

Where can I find older versions of Hadoop?

You can check here. From the archives. In particular, ...READ MORE

answered Sep 27, 2018 in Big Data Hadoop by Frankie
• 9,830 points
472 views
0 votes
1 answer
+4 votes
3 answers

Unable to find file error- while Streaming Hadoop

Is python installed running on the slaves that ...READ MORE

answered Oct 16, 2018 in Big Data Hadoop by Vinith
3,685 views
0 votes
1 answer

Where can I find logs in Spark on YARN?

You can access logs through the command yarn ...READ MORE

answered Nov 8, 2018 in Big Data Hadoop by Omkar
• 69,210 points
840 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
10,524 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
103,829 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
4,234 views
0 votes
1 answer
0 votes
2 answers

How can I list NameNode & DataNodes from any machine in the Hadoop cluster?

You can browse hadoop page from any ...READ MORE

answered Jan 23, 2020 in Big Data Hadoop by MD
• 95,440 points
11,074 views
0 votes
1 answer

How to programmatically access hadoop cluster where kerberos is enable?

Okay,here's the code snippet to work in the ...READ MORE

answered Mar 27, 2018 in Big Data Hadoop by coldcode
• 2,080 points
6,983 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP