How to get resource utilized memory and CPU by each hive query which is running under single application Id

0 votes
I am running some bunch of queries using hql files. Usually these all queries will run under a single application Id. How to find out resource utilized by each query which is running under single appication Id.
Sep 17, 2020 in Big Data Hadoop by sivachandran
• 150 points
2,616 views

1 answer to this question.

0 votes
Best answer

Hi@sivachandran,

You can monitor the metrics of your cluster. Generally to monitor the sources we use monitoring tools like Grafana, ELK, etc. You can learn the concepts of JMX monitoring for the hive.

answered Sep 18, 2020 by MD
• 95,460 points

selected Sep 18, 2020 by sivachandran
Thanks @MD,

I am using Hive version 1.2 hope that JMX is not available. I want to store the number of core and memory used for that particular query into a hive table. So I want to know where i can get those info.
Hi@sivachandran,

In other options, you may find all this information in the log files. Try to find with executor ID.

Related Questions In Big Data Hadoop

0 votes
1 answer

How to retrieve/get complete HQL hive query from hive,spark and tez?

To get full query running for the ...READ MORE

answered Jul 11, 2019 in Big Data Hadoop by Yogi
4,122 views
0 votes
1 answer

How Impala is fast compared to Hive in terms of query response?

Impala provides faster response as it uses MPP(massively ...READ MORE

answered Mar 21, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
2,107 views
0 votes
1 answer

How to find the port on which hdfs is running?

If you are using hadoop 2.7 or ...READ MORE

answered Jan 25, 2019 in Big Data Hadoop by Omkar
• 69,230 points
3,658 views
0 votes
1 answer

Can you please help with Hive Query to get FirstName, MiddleName, LastName and Suffix from FullName in Hive. Thank you

Hey, You can get first name, middle name, ...READ MORE

answered May 15, 2019 in Big Data Hadoop by Gitika
• 65,890 points

edited May 15, 2019 by Gitika 2,067 views
0 votes
1 answer
0 votes
1 answer
0 votes
1 answer

How to get started with Hadoop and do some development using Eclipse IDE?

Alright, there are couple of things that ...READ MORE

answered Apr 4, 2018 in Big Data Hadoop by Ashish
• 2,650 points
2,025 views
0 votes
11 answers
0 votes
1 answer

How to create hive table without location?

Hi@akhtar, We can create a hive table for ...READ MORE

answered Oct 16, 2020 in Big Data Hadoop by MD
• 95,460 points
1,058 views
0 votes
1 answer

How to rename the Hive table?

Hi@akhtar, You can rename the table name in ...READ MORE

answered Oct 19, 2020 in Big Data Hadoop by MD
• 95,460 points
12,324 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP