Monitoring Hadoop with Prometheus JMX

0 votes

I want to export my Hadoop JMX metrics to prometheus for Monitoring so i have done the following changes: Register a prometheus JMX exporter by adding following lines to hadoop-env.sh

export HADOOP_NAMENODE_OPTS
="${HADOOP_NAMENODE_OPTS} -javaagent:/usr/local/hive/hadoop/etc/hadoop/jmx_prometheus_javaagent-0.11.0.jar=19850:/usr/local/hive/hadoop/etc/hadoop/namenode.yml"

Restarted the server using:

./stop-dfs.sh
./stop-yarn.sh

On starting ./start-dfs.sh i am getting below error:

WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.
Starting namenodes on [localhost]
localhost: ERROR: Cannot set priority of namenode process 20930
Starting datanodes
Starting secondary namenodes [my-worker]
Sep 11, 2020 in Big Data Hadoop by Som
• 140 points
449 views

Hey, @Som,

Just check is your Datanode working fine?

1 answer to this question.

0 votes

Hi@Som,

This error is not related to Prometheus I guess. First, check the environment variables in the .bashrc file. Also, check the logs of master node. You will get the exact problem. If you are facing a problem to troubleshoot the error, then paste the error here.

answered Sep 14, 2020 by MD
• 95,060 points

Related Questions In Big Data Hadoop

0 votes
1 answer

The file exists before processing with hadoop command

Took session and it got resolved. READ MORE

answered Dec 18, 2017 in Big Data Hadoop by Sudhir
• 1,610 points
236 views
0 votes
1 answer

How to get started with Hadoop?

Well, hadoop is actually a framework that ...READ MORE

answered Mar 21, 2018 in Big Data Hadoop by coldcode
• 2,080 points
344 views
0 votes
1 answer

How to integrate Hadoop with Elasticsearch?

The HDFS snapshot/restore plugin comes in three ...READ MORE

answered Mar 21, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
638 views
0 votes
1 answer

How to practice programming with Hadoop?

Well there are multiple ways to solve ...READ MORE

answered Mar 29, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
994 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
6,839 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
1,095 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
48,217 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
2,594 views
0 votes
1 answer

Can I run Hadoop with Docker for both DEV and PROD environments?

Hi, Yes, you can run Hadoop with Docker ...READ MORE

answered Jan 24, 2020 in Big Data Hadoop by MD
• 95,060 points
87 views
0 votes
1 answer