Hadoop Warning Unable to load Native-Hadoop Library for your platform [closed]

0 votes

I am using the CentOS and trying to run my Hadoop Cluster on the CentOS Server. I have tried to start all environment variables in .sh file using the following command

#start-dfs.sh

and tried to stop it using the following command

#stop-dfs.sh

None of both work and above that am receiving an error saying.

#WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

My current version of Hadoop is 2.2.0 and I have tried to google the error which popped this link up

Strange thing is that the contents of /native/ directory on hadoop 2.x appear to be different so I am not sure what to do.

I've also added these two environment variables in Hadoop-env.sh file

#export HADOOP_OPTS="$HADOOP_OPTS -Djava.library.path=/usr/local/hadoop/lib/"
#export HADOOP_COMMON_LIB_NATIVE_DIR="/usr/local/hadoop/lib/native/"

Someone, please help me out on this one.

May 28, 2019 in Big Data Hadoop by nitinrawat895
• 11,380 points

closed May 29, 2019 by Omkar 559 views
+1 vote

Are you sure you're running Hadoop on 32bit CentOS? 

I think the reason you saw that warning is the native Hadoop library $HADOOP_HOME/lib/native/libhadoop.so.1.0.0 is that it is actually expected to be compiled on a 32 bit CentOS.

It's just a warning, and won't impact Hadoop's functionalities.

If you are running CentOS 64 bit then I would suggest you to download the source code of Hadoop and recompile libhadoop.so.1.0.0 on a 64bit system, then replace the 32bit one.

Even then if the Warning is existing, then you can follow the following solution.

Steps on how to recompile source code are included here for Ubuntu:

solve this issue by ingesting these lines into my .bashrc file.

#export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/native
#export HADOOP_OPTS="-Djava.library.path=$HADOOP_HOME/lib"

This must resolve your issue.

answered May 28, 2019 by ravikiran
• 4,620 points

Related Questions In Big Data Hadoop

+11 votes
11 answers

Hadoop “Unable to load native-hadoop library for your platform” warning

modify the glibc version.CentOS provides safe softwares ...READ MORE

answered Sep 10, 2018 in Big Data Hadoop by bug_seeker
• 15,550 points
39,647 views
0 votes
1 answer

Hadoop: Can not start namenode: Unable to load native-hadoop library for your platform

The entries in your .bashrc file looks ...READ MORE

answered Dec 5, 2018 in Big Data Hadoop by Omkar
• 69,130 points
1,309 views
–1 vote
1 answer

Getting error when writing to HDFS. Unable to load native-hadoop library for your platform

Try this: sudo service hadoop-master restart After that try ...READ MORE

answered Dec 19, 2018 in Big Data Hadoop by Omkar
• 69,130 points
579 views
0 votes
1 answer

Error: Unable to load native-hadoop library for your platform.

Hi,  You should execute the command hdfs dfs -ls ...READ MORE

answered Jun 17, 2019 in Big Data Hadoop by Gitika
• 65,870 points
316 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
7,247 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
53,279 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
2,746 views
0 votes
1 answer
0 votes
1 answer

Warning: Unable to load Hadoop Native Library for your platform.

 I had the same issue. It's solved ...READ MORE

answered Jun 28, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
3,223 views
0 votes
1 answer