How to write examples to test whether the installation is validated or not

0 votes

I have successfully configured Hadoop 2.4 on my Ubuntu 14.04 using this tutorial.

http://dogdogfish.com/2014/04/26/installing-hadoop-2-4-on-ubuntu-14-04/

Now after completing installation how can I perform a test on it?

How and where can I get the test data or jar files?

Sep 5, 2018 in Big Data Hadoop by Neha
• 6,300 points
98 views

1 answer to this question.

0 votes

You have some example jars in your hadoop installation directory.

The simplest thing you can do is run the teragen example(or wordcount). It is the first step in perform terasort.

Steps:

  1. Go to the hadoop installation directory.
  2. Run "hadoop jar hadoop-examples-0.20.2-cdh3u0.jar" to see all the jars you can run.
  3. Go to home/[user] directory and create a file "example.txt" with the following data "This is a file to test Hadoop Installation example For the sake of the experiment, consider it to be 1TB"
  4. While you are in that directory, run "hadoop dfs -put examples.txt /" this uploads the file onto your HDFS
  5. Run "hadoop dfs -ls /" to check it is on there
  6. Go to your Hadoop installation directory and run "hadoop jar hadoop-examples-0.20.2-cdh3u0.jar teragen 1000 /user/teragendata" - 1000 is the size data is to be broken into and the other param is the output directory.
  7. On successful execution, you will see something like the text at the bottom.
  8. Now to see how your MR job was run, in your browser open JobTracker and see the completed jobs. "localhost50030/jobtracker.jsp"
Hope this answer helps :)
answered Sep 5, 2018 by Frankie
• 9,810 points

Related Questions In Big Data Hadoop

0 votes
1 answer

How to check the directory is present in shell script or not?

Hi, To check the directory is present in ...READ MORE

answered Jun 24, 2019 in Big Data Hadoop by Gitika
• 65,870 points
108 views
0 votes
2 answers

How to see MySql service is running or not using linux command?

Hi, You can simply run the following commands ...READ MORE

answered Jan 21, 2020 in Big Data Hadoop by anonymous
372 views
0 votes
11 answers
0 votes
1 answer

Moving files in Hadoop using the Java API?

I would recommend you to use FileSystem.rename(). ...READ MORE

answered Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,480 points
1,646 views
0 votes
1 answer

Hadoop giving java.io.IOException, in mkdir Java code.

I am not sure about the issue. ...READ MORE

answered May 3, 2018 in Big Data Hadoop by Shubham
• 13,480 points
1,183 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
6,860 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
48,470 views
0 votes
1 answer

How will you decide whether you need to use the Capacity Scheduler or the Fair Scheduler?

Fair Scheduling is the process in which ...READ MORE

answered Dec 20, 2018 in Big Data Hadoop by Frankie
• 9,810 points
1,016 views
0 votes
1 answer