Unhandled internal error. Java heap space

+1 vote

Hi everyone

This is an error, I'm getting when running group operator in a pig. This is a approx 1.5 GB data file.

Can anyone plzz help me!! How to eliminate this error....

Thank you

Jan 20 in Big Data Hadoop by akhtar
• 10,330 points
52 views

1 answer to this question.

+1 vote

Hi

As your file size is too large, so it reaches the maximum heap size of your VM. So try to increase the heap size.

Below is the command you can use.

java -Xmx2048m

You can mention according to your needs. I mentioned it here in 2048.

Hope this will work.
 

answered Jan 21 by anonymous

Related Questions In Big Data Hadoop

0 votes
1 answer

Is there any way to increase Java Heap size in Hadoop?

You can add some more memory by ...READ MORE

answered Apr 12, 2018 in Big Data Hadoop by nitinrawat895
• 10,920 points
1,937 views
0 votes
1 answer

Java MapReduce error saying No FileSystem for scheme:hdfs

The problem is with the dependencies. The ...READ MORE

answered May 9, 2018 in Big Data Hadoop by Shubham
• 13,380 points
536 views
0 votes
1 answer

Hadoop: Format namenode gives error: Shutting down NameNode at java.net.UnknownHostException

UnknownHostException is thrown when hadoop tries to resolve ...READ MORE

answered Nov 12, 2018 in Big Data Hadoop by Omkar
• 69,060 points
1,412 views
0 votes
1 answer

Hadoop: "Caused by: java.lang.ClassNotFoundException" error

Have you placed the jar files in ...READ MORE

answered Nov 19, 2018 in Big Data Hadoop by Omkar
• 69,060 points
2,316 views
0 votes
1 answer

Error while connecting to Hive using Java JDBC

Use ​org.apache.hive.jdbc.HiveDriver as your driver ...READ MORE

answered Nov 21, 2018 in Big Data Hadoop by Omkar
• 69,060 points
382 views
0 votes
1 answer

Hadoop: namenode -format error "java.io.IOException"

Run the command as sudo or add the ...READ MORE

answered Nov 26, 2018 in Big Data Hadoop by Omkar
• 69,060 points
557 views
0 votes
1 answer

Getting some warning/error while loading java file using Hbase commands

In your code, you have set some ...READ MORE

answered Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,060 points
114 views
0 votes
1 answer

Hadoop Java Error: java.lang.NoClassDefFoundError: WordCount (wrong name: org/myorg/WordCount)

Hey, try this code import java.io.IOException; import java.util.Iterator; import java.util.StringTokenizer; import ...READ MORE

answered Sep 19, 2018 in Big Data Hadoop by slayer
• 29,280 points
2,103 views
0 votes
1 answer

Hadoop Java: org.apache.hadoop.conf.Configuration does not exist error

To solve this error, add hadoop-common to ...READ MORE

answered Nov 20, 2018 in Big Data Hadoop by Omkar
• 69,060 points
1,785 views