Hadoop Warning: Unable to load Native-Hadoop Library for your platform. [closed]

0 votes

I am using the CentOS and trying to run my Hadoop Cluster on the CentOS Server. I have tried to start all environment variables in .sh file using the following command

#start-dfs.sh

and tried to stop it using the following command

#stop-dfs.sh

None of both work and above that am receiving an error saying.

#WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

My current version of Hadoop is 2.2.0 and I have tried to google the error which popped this link up

Strange thing is that the contents of /native/ directory on hadoop 2.x appear to be different so I am not sure what to do.

I've also added these two environment variables in Hadoop-env.sh file

#export HADOOP_OPTS="$HADOOP_OPTS -Djava.library.path=/usr/local/hadoop/lib/"
#export HADOOP_COMMON_LIB_NATIVE_DIR="/usr/local/hadoop/lib/native/"

Someone, please help me out on this one.

May 28 in Big Data Hadoop by nitinrawat895
• 9,450 points

closed May 29 by Omkar 29 views
+1 vote

Are you sure you're running Hadoop on 32bit CentOS? 

I think the reason you saw that warning is the native Hadoop library $HADOOP_HOME/lib/native/libhadoop.so.1.0.0 is that it is actually expected to be compiled on a 32 bit CentOS.

It's just a warning, and won't impact Hadoop's functionalities.

If you are running CentOS 64 bit then I would suggest you to download the source code of Hadoop and recompile libhadoop.so.1.0.0 on a 64bit system, then replace the 32bit one.

Even then if the Warning is existing, then you can follow the following solution.

Steps on how to recompile source code are included here for Ubuntu:

solve this issue by ingesting these lines into my .bashrc file.

#export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/native
#export HADOOP_OPTS="-Djava.library.path=$HADOOP_HOME/lib"

This must resolve your issue.

answered May 28 by ravikiran
• 2,280 points

Related Questions In Big Data Hadoop

+10 votes
11 answers

Hadoop “Unable to load native-hadoop library for your platform” warning

modify the glibc version.CentOS provides safe softwares ...READ MORE

answered Sep 10, 2018 in Big Data Hadoop by bug_seeker
• 15,300 points
7,065 views
0 votes
1 answer

Hadoop: Can not start namenode: Unable to load native-hadoop library for your platform

The entries in your .bashrc file looks ...READ MORE

answered Dec 5, 2018 in Big Data Hadoop by Omkar
• 66,910 points
100 views
0 votes
1 answer

Getting error when writing to HDFS. Unable to load native-hadoop library for your platform

Try this: sudo service hadoop-master restart After that try ...READ MORE

answered Dec 19, 2018 in Big Data Hadoop by Omkar
• 66,910 points
77 views
0 votes
1 answer

Error: Unable to load native-hadoop library for your platform.

Hi,  You should execute the command hdfs dfs -ls ...READ MORE

answered 2 days ago in Big Data Hadoop by Gitika
• 14,910 points
12 views
0 votes
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 9,450 points
1,844 views
0 votes
10 answers

hadoop fs -put command?

copy command can be used to copy files ...READ MORE

answered Dec 7, 2018 in Big Data Hadoop by Sujay
9,139 views
0 votes
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
656 views
0 votes
1 answer
0 votes
1 answer

Help me solve this error "Unable to load Hadoop Native library for your platform"

I hope I understood your query properly I ...READ MORE

answered 6 hours ago in Big Data Hadoop by ravikiran
• 2,280 points
6 views

© 2018 Brain4ce Education Solutions Pvt. Ltd. All rights Reserved.
"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.