Hive: Execute MapReduce jobs locally

0 votes
I don't have a cluster and I don't want to set up one. I have written a MapReduce code and want to see if it works. How can I configure Hive to run the MapReduce jobs locally without a cluster?
May 21, 2019 in Big Data Hadoop by Ratan
163 views

1 answer to this question.

0 votes

You can set Hive to run MapReduce locally as follows:

hive> SET mapreduce.framework.name=local;

But not that by default only one reducer is assigned for MapReduce jobs and so that execution will be slow for larger datasets.

answered May 21, 2019 by Gani

Related Questions In Big Data Hadoop

0 votes
1 answer

If there are two joins in hive, how many mapreduce jobs will run?

There are two conditions for no. of ...READ MORE

answered Dec 19, 2018 in Big Data Hadoop by Omkar
• 69,030 points
1,296 views
0 votes
1 answer

Difference between hive.exec.compress.output=true; and mapreduce.output.fileoutputformat.compress=true;

Hey there! The definition of these two properties ...READ MORE

answered Dec 28, 2018 in Big Data Hadoop by Omkar
• 69,030 points
2,078 views
–1 vote
1 answer

Not able to execute mapreduce code

Follow the below steps to execute the ...READ MORE

answered Jan 7, 2019 in Big Data Hadoop by Omkar
• 69,030 points
100 views
0 votes
0 answers

How Pig programming gets converted into MapReduce jobs?

Could you please give me a brief ...READ MORE

Feb 21, 2019 in Big Data Hadoop by Neha
• 6,300 points
107 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,950 points
5,824 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,950 points
872 views
+1 vote
11 answers

hadoop fs -put command?

put syntax: put <localSrc> <dest> copy syntax: copyF ...READ MORE

answered Dec 7, 2018 in Big Data Hadoop by Aditya
36,603 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,320 points
2,184 views
0 votes
1 answer

How to compress output of the mapreduce output in Hive?

To compress the output of the MapReduce ...READ MORE

answered May 20, 2019 in Big Data Hadoop by Hiran
234 views
0 votes
1 answer

Hive queries from mapreduce gives Null Pointer Exception.

I think you have upgraded CDH. This ...READ MORE

answered Jun 4, 2019 in Big Data Hadoop by Rihan
472 views