Command to check the Hadoop distribution as well as it s version which is installed in my cluster

0 votes

What is the command or process to know that whether my cluster has Cloudera, Hadoop or Apache Hadoop distribution? Also how can I find out the various services that are installed in my cluster, and their port numbers to access them?

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
5,604 views

2 answers to this question.

+1 vote
One of the options to check the distribution of Hadoop is to check the service which is used for cluster management.

Cloudera Manager start-up script resides in /etc/init.d/cloudera-scm-agent.

Hortonworks uses Ambari agent and it’s start up script resides in etc/init.d/ambari-agent

Apache Hadoop do not have any cluster management service.

There is one more way to check using Hadoop classpath. Get the classpath using ‘hadoop classpath’ command. Most of the distributions mention their distributions in the classpath.

hdp - hortonworks

cdh - cloudera

If the classpath does not contains any of these keywords then it is the Apache Hadoop version.
answered Apr 15, 2018 by kurt_cobain
• 9,350 points
0 votes

Use this command :

`hadoop classpath`
answered Jun 7, 2019 by anonymous

Related Questions In Big Data Hadoop

0 votes
11 answers
0 votes
1 answer

How to delete a directory from Hadoop cluster which is having comma(,) in its name?

Just try the following command: hadoop fs -rm ...READ MORE

answered May 7, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
3,085 views
0 votes
1 answer

What is the command to check the number of cores in Spark?

Go to your Spark Web UI & ...READ MORE

answered May 17, 2018 in Big Data Hadoop by Shubham
• 13,490 points
7,056 views
0 votes
1 answer

I have to ingest in hadoop cluster large number of files for testing , what is the best way to do it?

Hi@sonali, It depends on what kind of testing ...READ MORE

answered Jul 8, 2020 in Big Data Hadoop by MD
• 95,460 points
1,244 views
0 votes
1 answer

What is -cp command in hadoop? How it works?

/user/cloudera/data1 is not a directory, it is ...READ MORE

answered Oct 17, 2018 in Big Data Hadoop by Frankie
• 9,830 points
4,194 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
11,077 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
2,575 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
109,073 views
0 votes
1 answer

How to find hadoop distribution and version?

Just Use the command Hadoop version ...READ MORE

answered Apr 6, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points

edited Apr 6, 2018 by kurt_cobain 2,030 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP