Most answered questions in Big Data Hadoop

0 votes
1 answer

Hadoop: ERROR: namenode.NameNode: Could not initialize shared edits dir java.io.IOException: Cannot start an HA namenode with name dirs that need recovery.

Hi, You can do one thing: Create namenode dir with ...READ MORE

Aug 8, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 1,248 views
0 votes
1 answer

Error: Hive show tables does not display table "sqooptest" , which was imported by SQOOP

Hi, You can follow the below-given solution. Just enter ...READ MORE

Aug 7, 2019 in Big Data Hadoop by Gitika
 • 65,910 points
edited Aug 7, 2019 by Gitika • 1,227 views
0 votes
1 answer

Error: ERROR security.UserGroupInformation: PriviledgedActionException as:root (auth:SIMPLE)

Hey, For me, my Hadoop NameNode was in ...READ MORE

Aug 7, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 1,476 views
0 votes
1 answer

Hadoop: ERROR1070: Could not resolve count using imports: [, java.lang., org.apache.pig.builtin., org.apache.pig.impl.builtin.]

Hi, I can see the error arose because the count ...READ MORE

Aug 7, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 2,345 views
0 votes
1 answer

Hadoop: Error: Exception in thread "main" java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.JobContext, but class was expected

Hey, The error seems you have not add ...READ MORE

Aug 7, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 1,643 views
0 votes
1 answer

Hadoop:Error: Network is unreachable; Host Details : local host is: "localhost/127.0.0.1"; destination host is: "boss":32939;

Hey,  I guess there is no IP address ...READ MORE

Aug 7, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 1,289 views
0 votes
1 answer

Hadoop: Error: Hadoop Master cannot start the Slave with different user (or) Slave with different user failed to start by Hadoop Master node.

Hi, You can use these commands to get ...READ MORE

Aug 7, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 1,507 views
0 votes
1 answer

Hadoop: Error: slave: bash: line 0: cd: /opt/hadoop-1.1.0/libexec/..: No such file or directory

Hi,   In this case, it is searching ...READ MORE

Aug 7, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 1,133 views
0 votes
1 answer

Zookeeper: client.HConnnectionManager HConbectionImplementation: Cant get connection to Zookeeper:KeeperErrorCode

In edureka vm once you start hbase ...READ MORE

Aug 6, 2019 in Big Data Hadoop by Chiraya
 • 575 views
0 votes
1 answer

Unable to create table in Hive

It is looking like your Hadoop daemons ...READ MORE

Aug 6, 2019 in Big Data Hadoop by Yogi
 • 643 views
0 votes
1 answer

Error: Zookeeper address not found from MapRFilesystem

Hey, Yarn is configured with the "zero-configuration failover". So ...READ MORE

Aug 6, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 1,126 views
0 votes
1 answer

How to assign server access to client(s) through NFS export file?

Hi, You can create the export folder, you will ...READ MORE

Aug 5, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 538 views
0 votes
1 answer

Hadoop: ERROR: datanode.DataNode: java.io.IOException: Datanode state: LV = -32 CTime = 1377582559943 is newer than the namespace state: LV = -32 CTime = 0

Hey, You can do one thing, open the file ...READ MORE

Aug 5, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 859 views
0 votes
1 answer

Hadoop: ERROR: datanode.DataNode: java.io.IOException: Incompatible namespaceIDs in /app/hadoop/tmp/dfs/data: namenode namespaceID = 1580775695; datanode namespaceID = 1494801914

Hi, Namenode generates new namespaceID every time you ...READ MORE

Aug 5, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 910 views
0 votes
1 answer

Hadoop: ERROR datanode.DataNode: All directories in dfs.data.dir are invalid.

Hi, Try this, first delete all contents from ...READ MORE

Aug 5, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 1,633 views
0 votes
1 answer

ERROR org.apache.hadoop.hdfs.server.namenode.FSNamesystem: FSNamesystem initialization failed. java.io.FileNotFoundException: /app/hadoop/tmp/dfs/name/in_use.lock

Hi, You can change the owner to Hadoop ...READ MORE

Aug 5, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 1,532 views
0 votes
1 answer

Hadoop: error: Cannot lock storage /app/hadoop/tmp/dfs/name. The directory is already locked.

Hi, Check your dfs.name.dir and dfs.data.dir path in hdfs-site.xml. Or ...READ MORE

Aug 5, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 1,969 views
0 votes
1 answer

DJOB TRACKER : Can not start task tracker because java.lang.IllegalArgumentException: Does not contain a valid host:port authority: 127.0.0.1:9001

Hey, According to your property set up, there ...READ MORE

Aug 5, 2019 in Big Data Hadoop by Gitika
 • 65,910 points • 549 views
0 votes
1 answer

Sqoop: ERROR tool.BaseSqoopTool: Error parsing arguments

There are two mistakes in the command ...READ MORE

Aug 2, 2019 in Big Data Hadoop by Kunal
 • 7,125 views
0 votes
1 answer

Can't seem to read files: "Invalid container ID"

You will have to start pig first ...READ MORE

Aug 2, 2019 in Big Data Hadoop by TIna
 • 1,101 views
0 votes
1 answer

Sqoop: ERROR tool.BaseSqoopTool: Unrecognized argument

The command you are executing is slightly ...READ MORE

Aug 1, 2019 in Big Data Hadoop by Sam
 • 4,964 views
0 votes
1 answer

Hive: org.apache.hadoop.security.AccessControlException Permission denied: user

This error is generally thrown when the ...READ MORE

Aug 1, 2019 in Big Data Hadoop by Waniku
 • 2,830 views
0 votes
1 answer

Cassandra: time out when using select * or copy command

If we get the TimeOut Exception, then ...READ MORE

Aug 1, 2019 in Big Data Hadoop by Esha
 • 1,221 views
0 votes
1 answer

Unzip files in hdfs

To unzip a gzipped (or bzipped) file, ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Joe
 • 5,826 views
0 votes
1 answer

PIG Error while loading file: -bash: syntax error near unexpected token `('

Since your data is delimited with tabs ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Ritu
 • 1,796 views
0 votes
1 answer

How to select particular column In a table in hive?

Hive is a high-level language to analyze ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Killian
 • 9,655 views
0 votes
1 answer

Pig: Remove header line in csv file

Refer to the below file det.txt: Name,Age,Location a,10,chennai b,20,bangalore We will ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Yogi
 • 1,796 views
0 votes
1 answer

Does Caching stand as the only advantage in Spark compared to Hadoop?

Spark has much lower per job and ...READ MORE

Jul 31, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 380 views
0 votes
1 answer

The total number of Data Nodes running in this operation are 0 and note that there are no nodes excluded in this process.

Follow these steps: STEP 1 : stop hadoop ...READ MORE

Jul 31, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 1,197 views
0 votes
1 answer

Different between zkfc and zookeeper

Hey, The key difference between both the components ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Sunny
 1 flag • 3,497 views
0 votes
1 answer

Hive: Assign subquery to variable

Refer to this example: Step1: Check table test1 ...READ MORE

Jul 30, 2019 in Big Data Hadoop by Tina
 • 7,096 views
0 votes
1 answer

FAILEDError: java.io.IOException: Type mismatch in key from map

This error is thrown when the parameters ...READ MORE

Jul 30, 2019 in Big Data Hadoop by Rishi
 • 1,519 views
0 votes
1 answer

Converting CSV files to Parquet

--Create Hive external Table for existing data CREATE ...READ MORE

Jul 30, 2019 in Big Data Hadoop by Yogi
 • 6,918 views
0 votes
1 answer

java.lang.IllegalArgumentException: Unable to instantiate SparkSession with Hive support because Hive classes are not found.

 Try using the below build.sbt, code.scala and command ...READ MORE

Jul 30, 2019 in Big Data Hadoop by Kishan
 • 7,365 views
0 votes
1 answer

What is "java.sql.SQLException: org.apache.thrift.transport.TTransportException" in Hive?

This particular exception is related to Hive logs. ...READ MORE

Jul 30, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 6,609 views
0 votes
1 answer

What is the difference between S3n, S3a, and S3?

Your doubt is quite an interesting one. Yes, ...READ MORE

Jul 30, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 10,411 views
0 votes
1 answer

How to choose number of Executors and Executor cores?

Refer to the below when you are ...READ MORE

Jul 29, 2019 in Big Data Hadoop by Veer
 • 3,517 views
0 votes
1 answer

Error while Loading data to Hive.

Your data node is not running that ...READ MORE

Jul 29, 2019 in Big Data Hadoop by Quill
 • 953 views
0 votes
1 answer

Killing oozie Jobs by userid

Suppose you want to kill the jobs ...READ MORE

Jul 29, 2019 in Big Data Hadoop by Esha
 • 1,644 views
0 votes
1 answer

ERROR tool.ImportTool: Encountered IOException running import job: java.io.IOException: Cannot run program "hive": error=2, No such file or directory

The tables look fine. Follow these steps ...READ MORE

Jul 29, 2019 in Big Data Hadoop by Kiran
 • 1,769 views
0 votes
1 answer

Difference between put and copyFromLocal

-Put and -copyFromLocal is almost same command ...READ MORE

Jul 29, 2019 in Big Data Hadoop by Neeraj
 • 12,055 views
0 votes
1 answer

Multiple Output format in Hadoop

Each reducer uses an OutputFormat to write ...READ MORE

Jul 26, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 1,760 views
0 votes
1 answer

Does HQL query go to all the nodes to process data?

InputSplits are created by logical division of ...READ MORE

Jul 26, 2019 in Big Data Hadoop by Tina
 • 506 views
0 votes
1 answer

Why is Hive called as Data Warehouse?

Hive is a data warehouse infrastructure tool ...READ MORE

Jul 26, 2019 in Big Data Hadoop by Joshua
 • 5,793 views
0 votes
1 answer

Write data into hive table in a parquet

Below is an example query which you ...READ MORE

Jul 26, 2019 in Big Data Hadoop by Sadu
 • 2,698 views
0 votes
1 answer

Explanation to outputcollector vs context

Both codes contain different API of Map ...READ MORE

Jul 26, 2019 in Big Data Hadoop by Rasheed
 • 1,445 views
0 votes
1 answer

Query regarding ArrayBuffer

It's because that is the syntax. This ...READ MORE

Jul 26, 2019 in Big Data Hadoop by Rishi
 • 334 views
0 votes
1 answer

How to find in incorrect file/records in hive?

A value with a wrong datatype causes ...READ MORE

Jul 25, 2019 in Big Data Hadoop by Ritu
 • 2,310 views
0 votes
1 answer

Hive Query: Split value

You can use the SUBSTR() in hive ...READ MORE

Jul 25, 2019 in Big Data Hadoop by Paul
 • 487 views
0 votes
1 answer

Parquet & Avro File hadling with HIVE

For avro you can follow the format ...READ MORE

Jul 25, 2019 in Big Data Hadoop by Tarun
 • 2,357 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.