Hadoop Warning: Unable to load Native-Hadoop Library for your platform. [closed]

0 votes

I am using the CentOS and trying to run my Hadoop Cluster on the CentOS Server. I have tried to start all environment variables in .sh file using the following command

#start-dfs.sh

and tried to stop it using the following command

#stop-dfs.sh

None of both work and above that am receiving an error saying.

#WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

My current version of Hadoop is 2.2.0 and I have tried to google the error which popped this link up

Strange thing is that the contents of /native/ directory on hadoop 2.x appear to be different so I am not sure what to do.

I've also added these two environment variables in Hadoop-env.sh file

#export HADOOP_OPTS="$HADOOP_OPTS -Djava.library.path=/usr/local/hadoop/lib/"
#export HADOOP_COMMON_LIB_NATIVE_DIR="/usr/local/hadoop/lib/native/"

Someone, please help me out on this one.

May 28 in Big Data Hadoop by nitinrawat895
• 10,110 points

closed May 29 by Omkar 49 views
+1 vote

Are you sure you're running Hadoop on 32bit CentOS? 

I think the reason you saw that warning is the native Hadoop library $HADOOP_HOME/lib/native/libhadoop.so.1.0.0 is that it is actually expected to be compiled on a 32 bit CentOS.

It's just a warning, and won't impact Hadoop's functionalities.

If you are running CentOS 64 bit then I would suggest you to download the source code of Hadoop and recompile libhadoop.so.1.0.0 on a 64bit system, then replace the 32bit one.

Even then if the Warning is existing, then you can follow the following solution.

Steps on how to recompile source code are included here for Ubuntu:

solve this issue by ingesting these lines into my .bashrc file.

#export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/native
#export HADOOP_OPTS="-Djava.library.path=$HADOOP_HOME/lib"

This must resolve your issue.

answered May 28 by ravikiran
• 3,560 points

Related Questions In Big Data Hadoop

+10 votes
11 answers

Hadoop “Unable to load native-hadoop library for your platform” warning

modify the glibc version.CentOS provides safe softwares ...READ MORE

answered Sep 10, 2018 in Big Data Hadoop by bug_seeker
• 15,310 points
8,364 views
0 votes
1 answer

Hadoop: Can not start namenode: Unable to load native-hadoop library for your platform

The entries in your .bashrc file looks ...READ MORE

answered Dec 5, 2018 in Big Data Hadoop by Omkar
• 67,140 points
124 views
0 votes
1 answer

Getting error when writing to HDFS. Unable to load native-hadoop library for your platform

Try this: sudo service hadoop-master restart After that try ...READ MORE

answered Dec 19, 2018 in Big Data Hadoop by Omkar
• 67,140 points
98 views
0 votes
1 answer

Error: Unable to load native-hadoop library for your platform.

Hi,  You should execute the command hdfs dfs -ls ...READ MORE

answered Jun 17 in Big Data Hadoop by Gitika
• 19,880 points
29 views
0 votes
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,110 points
2,059 views
0 votes
10 answers

hadoop fs -put command?

copy command can be used to copy files ...READ MORE

answered Dec 7, 2018 in Big Data Hadoop by Sujay
10,541 views
0 votes
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,240 points
771 views
0 votes
1 answer
0 votes
1 answer

Warning: Unable to load Hadoop Native Library for your platform.

 I had the same issue. It's solved ...READ MORE

answered Jun 28 in Big Data Hadoop by ravikiran
• 3,560 points
23 views