How to get resource utilized memory and CPU by each hive query which is running under single application Id

0 votes
I am running some bunch of queries using hql files. Usually these all queries will run under a single application Id. How to find out resource utilized by each query which is running under single appication Id.
Sep 17, 2020 in Big Data Hadoop by sivachandran
• 150 points
614 views

1 answer to this question.

0 votes
Best answer

Hi@sivachandran,

You can monitor the metrics of your cluster. Generally to monitor the sources we use monitoring tools like Grafana, ELK, etc. You can learn the concepts of JMX monitoring for the hive.

answered Sep 17, 2020 by MD
• 95,240 points

selected Sep 18, 2020 by sivachandran
Thanks @MD,

I am using Hive version 1.2 hope that JMX is not available. I want to store the number of core and memory used for that particular query into a hive table. So I want to know where i can get those info.
Hi@sivachandran,

In other options, you may find all this information in the log files. Try to find with executor ID.

Related Questions In Big Data Hadoop

0 votes
1 answer

How to retrieve/get complete HQL hive query from hive,spark and tez?

To get full query running for the ...READ MORE

answered Jul 11, 2019 in Big Data Hadoop by Yogi
1,874 views
0 votes
1 answer

How Impala is fast compared to Hive in terms of query response?

Impala provides faster response as it uses MPP(massively ...READ MORE

answered Mar 21, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
925 views
0 votes
1 answer

How to find the port on which hdfs is running?

If you are using hadoop 2.7 or ...READ MORE

answered Jan 24, 2019 in Big Data Hadoop by Omkar
• 69,150 points
632 views
0 votes
1 answer

Can you please help with Hive Query to get FirstName, MiddleName, LastName and Suffix from FullName in Hive. Thank you

Hey, You can get first name, middle name, ...READ MORE

answered May 15, 2019 in Big Data Hadoop by Gitika
• 65,930 points

edited May 15, 2019 by Gitika 1,027 views
0 votes
1 answer
0 votes
1 answer
0 votes
1 answer

How to get started with Hadoop and do some development using Eclipse IDE?

Alright, there are couple of things that ...READ MORE

answered Apr 4, 2018 in Big Data Hadoop by Ashish
• 2,650 points
1,035 views
0 votes
11 answers
0 votes
1 answer

How to create hive table without location?

Hi@akhtar, We can create a hive table for ...READ MORE

answered Oct 15, 2020 in Big Data Hadoop by MD
• 95,240 points
155 views
0 votes
1 answer

How to rename the Hive table?

Hi@akhtar, You can rename the table name in ...READ MORE

answered Oct 18, 2020 in Big Data Hadoop by MD
• 95,240 points
125 views