How to write examples to test whether the installation is validated or not?

0 votes

I have successfully configured Hadoop 2.4 on my Ubuntu 14.04 using this tutorial.

http://dogdogfish.com/2014/04/26/installing-hadoop-2-4-on-ubuntu-14-04/

Now after completing installation how can I perform a test on it?

How and where can I get the test data or jar files?

Sep 5, 2018 in Big Data Hadoop by Neha
• 6,280 points
50 views

1 answer to this question.

0 votes

You have some example jars in your hadoop installation directory.

The simplest thing you can do is run the teragen example(or wordcount). It is the first step in perform terasort.

Steps:

  1. Go to the hadoop installation directory.
  2. Run "hadoop jar hadoop-examples-0.20.2-cdh3u0.jar" to see all the jars you can run.
  3. Go to home/[user] directory and create a file "example.txt" with the following data "This is a file to test Hadoop Installation example For the sake of the experiment, consider it to be 1TB"
  4. While you are in that directory, run "hadoop dfs -put examples.txt /" this uploads the file onto your HDFS
  5. Run "hadoop dfs -ls /" to check it is on there
  6. Go to your Hadoop installation directory and run "hadoop jar hadoop-examples-0.20.2-cdh3u0.jar teragen 1000 /user/teragendata" - 1000 is the size data is to be broken into and the other param is the output directory.
  7. On successful execution, you will see something like the text at the bottom.
  8. Now to see how your MR job was run, in your browser open JobTracker and see the completed jobs. "localhost50030/jobtracker.jsp"
Hope this answer helps :)
answered Sep 5, 2018 by Frankie
• 9,810 points

Related Questions In Big Data Hadoop

0 votes
1 answer

How to check the directory is present in shell script or not?

Hi, To check the directory is present in ...READ MORE

answered Jun 24, 2019 in Big Data Hadoop by Gitika
• 26,030 points
42 views
0 votes
2 answers

How to see MySql service is running or not using linux command?

Hi, You can simply run the following commands ...READ MORE

answered Jan 21 in Big Data Hadoop by anonymous
57 views
0 votes
11 answers
0 votes
1 answer

Moving files in Hadoop using the Java API?

I would recommend you to use FileSystem.rename(). ...READ MORE

answered Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,370 points
1,095 views
0 votes
1 answer

Hadoop giving java.io.IOException, in mkdir Java code.

I am not sure about the issue. ...READ MORE

answered May 3, 2018 in Big Data Hadoop by Shubham
• 13,370 points
608 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,840 points
4,211 views
+1 vote
11 answers

hadoop fs -put command?

put syntax: put <localSrc> <dest> copy syntax: copyFr ...READ MORE

answered Dec 7, 2018 in Big Data Hadoop by Aditya
22,890 views
0 votes
1 answer
0 votes
1 answer