Is there any way to increase Java Heap size in Hadoop

Question

I am getting JAVA Heap error when I'm running "insert into table" query in Hive. I'm using Hadoop 2.6.0 version.

Can anyone tell me how can I increase the heap size in hadoop through out the cluster?

Thanks in advance!

Answer 1

You can add some more memory by editing the mapred-site.xml

<property>
    <name>mapred.child.java.opts</name>
    <value>-Xmx4096m</value>
</property>
 

Alternatively you can also edit the hadoop-env.sh file 

add 

export HADOOP_OPTS="-Xmx5096m"
 

Hope this will resolve your error.