How to get resource utilized(memory and CPU) by each hive query which is running under single application Id?

0 votes
I am running some bunch of queries using hql files. Usually these all queries will run under a single application Id. How to find out resource utilized by each query which is running under single appication Id.
Sep 17 in Big Data Hadoop by sivachandran
• 150 points
113 views

1 answer to this question.

0 votes
Best answer

Hi@sivachandran,

You can monitor the metrics of your cluster. Generally to monitor the sources we use monitoring tools like Grafana, ELK, etc. You can learn the concepts of JMX monitoring for the hive.

answered Sep 17 by MD
• 65,200 points

selected Sep 18 by sivachandran
Thanks @MD,

I am using Hive version 1.2 hope that JMX is not available. I want to store the number of core and memory used for that particular query into a hive table. So I want to know where i can get those info.
Hi@sivachandran,

In other options, you may find all this information in the log files. Try to find with executor ID.

Related Questions In Big Data Hadoop

0 votes
1 answer

How to retrieve/get complete HQL hive query from hive,spark and tez?

To get full query running for the ...READ MORE

answered Jul 11, 2019 in Big Data Hadoop by Yogi
1,165 views
0 votes
1 answer

How Impala is fast compared to Hive in terms of query response?

Impala provides faster response as it uses MPP(massively ...READ MORE

answered Mar 21, 2018 in Big Data Hadoop by nitinrawat895
• 10,950 points
711 views
0 votes
1 answer

How to find the port on which hdfs is running?

If you are using hadoop 2.7 or ...READ MORE

answered Jan 24, 2019 in Big Data Hadoop by Omkar
• 69,030 points
232 views
0 votes
1 answer

Can you please help with Hive Query to get FirstName, MiddleName, LastName and Suffix from FullName in Hive. Thank you

Hey, You can get first name, middle name, ...READ MORE

answered May 15, 2019 in Big Data Hadoop by Gitika
• 41,360 points

edited May 15, 2019 by Gitika 664 views
0 votes
1 answer
0 votes
1 answer

How to get started with Hadoop and do some development using Eclipse IDE?

Alright, there are couple of things that ...READ MORE

answered Apr 4, 2018 in Big Data Hadoop by Ashish
• 2,650 points
568 views
0 votes
11 answers
0 votes
9 answers

Is there any way to check which Hadoop daemons are running?

use jps command, It will show all the running ...READ MORE

answered Dec 27, 2018 in Big Data Hadoop by Rakesh
• 160 points
19,824 views
0 votes
1 answer

How to create hive table without location?

Hi@akhtar, We can create a hive table for ...READ MORE

answered 5 days ago in Big Data Hadoop by MD
• 65,200 points
6 views
0 votes
1 answer

How to rename the Hive table?

Hi@akhtar, You can rename the table name in ...READ MORE

answered 2 days ago in Big Data Hadoop by MD
• 65,200 points
8 views