How to write examples to test whether the installation is validated or not?

0 votes

I have successfully configured Hadoop 2.4 on my Ubuntu 14.04 using this tutorial.

http://dogdogfish.com/2014/04/26/installing-hadoop-2-4-on-ubuntu-14-04/

Now after completing installation how can I perform a test on it?

How and where can I get the test data or jar files?

Sep 5, 2018 in Big Data Hadoop by Neha
• 6,280 points
41 views

1 answer to this question.

0 votes

You have some example jars in your hadoop installation directory.

The simplest thing you can do is run the teragen example(or wordcount). It is the first step in perform terasort.

Steps:

  1. Go to the hadoop installation directory.
  2. Run "hadoop jar hadoop-examples-0.20.2-cdh3u0.jar" to see all the jars you can run.
  3. Go to home/[user] directory and create a file "example.txt" with the following data "This is a file to test Hadoop Installation example For the sake of the experiment, consider it to be 1TB"
  4. While you are in that directory, run "hadoop dfs -put examples.txt /" this uploads the file onto your HDFS
  5. Run "hadoop dfs -ls /" to check it is on there
  6. Go to your Hadoop installation directory and run "hadoop jar hadoop-examples-0.20.2-cdh3u0.jar teragen 1000 /user/teragendata" - 1000 is the size data is to be broken into and the other param is the output directory.
  7. On successful execution, you will see something like the text at the bottom.
  8. Now to see how your MR job was run, in your browser open JobTracker and see the completed jobs. "localhost50030/jobtracker.jsp"
Hope this answer helps :)
answered Sep 5, 2018 by Frankie
• 9,810 points

Related Questions In Big Data Hadoop

0 votes
1 answer
0 votes
1 answer

How to see MySql service is running or not using linux command?

This is the command you can use ...READ MORE

answered Apr 15 in Big Data Hadoop by Gitika
• 25,420 points
38 views
0 votes
11 answers
0 votes
1 answer

Moving files in Hadoop using the Java API?

I would recommend you to use FileSystem.rename(). ...READ MORE

answered Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,350 points
969 views
0 votes
1 answer

Hadoop giving java.io.IOException, in mkdir Java code.

I am not sure about the issue. ...READ MORE

answered May 3, 2018 in Big Data Hadoop by Shubham
• 13,350 points
514 views
0 votes
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,800 points
3,586 views
+1 vote
11 answers

hadoop fs -put command?

put syntax: put <localSrc> <dest> copy syntax: copyFr ...READ MORE

answered Dec 7, 2018 in Big Data Hadoop by Aditya
18,477 views
0 votes
1 answer
0 votes
1 answer