Hadoop error Input path does not exist

0 votes
I am trying to specify In folder but i get this error:

18/11/28 22:05:27 ERROR security.UserGroupInformation: PriviledgedActionException as:USER cause:org.apache.hadoop.mapred.InvalidInputException: Input path does not exist: hdfs://localhost:9100/user/USER/In

How to solve this?
Nov 30, 2018 in Big Data Hadoop by slayer
• 29,350 points
13,447 views

2 answers to this question.

0 votes

I think you forgot to upload the input files to hdfs. Try this:

bin/hadoop fs -mkdir In
answered Nov 30, 2018 by Omkar
• 69,210 points
0 votes
I was able to fix the issue. There was nothing wrong with my code.

I had two terminals open. In one terminal I moved the input file to HDFS.
[edureka@localhost Desktop]$ hdfs dfs -put sample1.txt ponezhil/sample.txt

In another terminal I executed the MapReduce program with this command.
[edureka@localhost ~]$ hadoop jar /home/edureka/Desktop/WordcountMR.jar hdfs:ponezhil/sample.txt hdfs:out

I got error. I referred this command from LMS in a video "How to run MapReduce Program in Edureka VM"

Then I used this command.
[edureka@localhost ~]$ hadoop jar /home/edureka/Desktop/WordcountMR.jar com.edureka.WordCountDriver ponezhil/sample.txt out

We were thought in class to fire the command in this format.
hadoop jar jarFileName className I/Ppath O/Ppath.
But this also ended up in error. After a lot of trial and error, I happened to notice that every time after executing this command, my input file was diappearing from the HDFS.

And finally I used this command which worked, again copying my input file to the HDFS.
[edureka@localhost ~]$ hadoop jar /home/edureka/Desktop/WordcountMR.jar ponezhil/sample.txt out
answered Jan 13, 2019 by Ponezhil Ramu
Hey @Ponezhil Ramu!
What error did you get when you ran the command with input and output path?

Related Questions In Big Data Hadoop

0 votes
1 answer

Error: input path does not exist

Hey, This error looks like your job History ...READ MORE

answered Apr 30, 2019 in Big Data Hadoop by Gitika
• 65,910 points
2,918 views
0 votes
1 answer
0 votes
1 answer

ERROR 2997: Encountered IOException. Directory does not exist.

Hi. I think the reason for this ...READ MORE

answered May 23, 2019 in Big Data Hadoop by Britney
2,079 views
0 votes
1 answer

Format HDFS Namenode Error: Could not find or load main class ”-Djava.library.path=.home.hadoop.hadoop-3.2.1.lib.native”

Hi@fwood, According to your configuration, you didn't set ...READ MORE

answered Jun 12, 2020 in Big Data Hadoop by MD
• 95,440 points
10,088 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
10,558 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
2,185 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
104,214 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
4,260 views
0 votes
1 answer

Hadoop Java: org.apache.hadoop.conf.Configuration does not exist error

To solve this error, add hadoop-common to ...READ MORE

answered Nov 21, 2018 in Big Data Hadoop by Omkar
• 69,210 points
6,956 views
0 votes
1 answer

Hadoop Spark: __spark_lib.zip does not exist

To find this file, your HADOOP_CONF_DIR env ...READ MORE

answered Nov 15, 2018 in Big Data Hadoop by Omkar
• 69,210 points
2,376 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP