Most answered questions in Big Data Hadoop

0 votes
1 answer

Hadoop: ERROR: namenode.NameNode: Could not initialize shared edits dir java.io.IOException: Cannot start an HA namenode with name dirs that need recovery.

Hi, You can do one thing: Create namenode dir with ...READ MORE

Aug 8, 2019 in Big Data Hadoop by Gitika
 • 65,930 points • 1,128 views
0 votes
1 answer

Error: Hive show tables does not display table "sqooptest" , which was imported by SQOOP

Hi, You can follow the below-given solution. Just enter ...READ MORE

Aug 7, 2019 in Big Data Hadoop by Gitika
 • 65,930 points
edited Aug 7, 2019 by Gitika • 1,121 views
0 votes
1 answer

Error: ERROR security.UserGroupInformation: PriviledgedActionException as:root (auth:SIMPLE)

Hey, For me, my Hadoop NameNode was in ...READ MORE

Aug 7, 2019 in Big Data Hadoop by Gitika
 • 65,930 points • 1,314 views
0 votes
1 answer

Hadoop: ERROR1070: Could not resolve count using imports: [, java.lang., org.apache.pig.builtin., org.apache.pig.impl.builtin.]

Hi, I can see the error arose because the count ...READ MORE

Aug 7, 2019 in Big Data Hadoop by Gitika
 • 65,930 points • 2,163 views
0 votes
1 answer

Hadoop:Error: Network is unreachable; Host Details : local host is: "localhost/127.0.0.1"; destination host is: "boss":32939;

Hey,  I guess there is no IP address ...READ MORE

Aug 7, 2019 in Big Data Hadoop by Gitika
 • 65,930 points • 1,145 views
0 votes
1 answer

Hadoop: Error: Hadoop Master cannot start the Slave with different user (or) Slave with different user failed to start by Hadoop Master node.

Hi, You can use these commands to get ...READ MORE

Aug 7, 2019 in Big Data Hadoop by Gitika
 • 65,930 points • 1,412 views
0 votes
1 answer

Hadoop: Error: slave: bash: line 0: cd: /opt/hadoop-1.1.0/libexec/..: No such file or directory

Hi,   In this case, it is searching ...READ MORE

Aug 7, 2019 in Big Data Hadoop by Gitika
 • 65,930 points • 997 views
0 votes
1 answer

Zookeeper: client.HConnnectionManager HConbectionImplementation: Cant get connection to Zookeeper:KeeperErrorCode

In edureka vm once you start hbase ...READ MORE

Aug 6, 2019 in Big Data Hadoop by Chiraya
 • 511 views
0 votes
1 answer

Unable to create table in Hive

It is looking like your Hadoop daemons ...READ MORE

Aug 6, 2019 in Big Data Hadoop by Yogi
 • 514 views
0 votes
1 answer

Error: Zookeeper address not found from MapRFilesystem

Hey, Yarn is configured with the "zero-configuration failover". So ...READ MORE

Aug 6, 2019 in Big Data Hadoop by Gitika
 • 65,930 points • 944 views
0 votes
1 answer

How to assign server access to client(s) through NFS export file?

Hi, You can create the export folder, you will ...READ MORE

Aug 5, 2019 in Big Data Hadoop by Gitika
 • 65,930 points • 415 views
0 votes
1 answer

Hadoop: ERROR datanode.DataNode: All directories in dfs.data.dir are invalid.

Hi, Try this, first delete all contents from ...READ MORE

Aug 5, 2019 in Big Data Hadoop by Gitika
 • 65,930 points • 1,397 views
0 votes
1 answer

Hadoop: error: Cannot lock storage /app/hadoop/tmp/dfs/name. The directory is already locked.

Hi, Check your dfs.name.dir and dfs.data.dir path in hdfs-site.xml. Or ...READ MORE

Aug 5, 2019 in Big Data Hadoop by Gitika
 • 65,930 points • 1,744 views
0 votes
1 answer

DJOB TRACKER : Can not start task tracker because java.lang.IllegalArgumentException: Does not contain a valid host:port authority: 127.0.0.1:9001

Hey, According to your property set up, there ...READ MORE

Aug 5, 2019 in Big Data Hadoop by Gitika
 • 65,930 points • 468 views
0 votes
1 answer

Sqoop: ERROR tool.BaseSqoopTool: Error parsing arguments

There are two mistakes in the command ...READ MORE

Aug 2, 2019 in Big Data Hadoop by Kunal
 • 6,790 views
0 votes
1 answer

Can't seem to read files: "Invalid container ID"

You will have to start pig first ...READ MORE

Aug 2, 2019 in Big Data Hadoop by TIna
 • 895 views
0 votes
1 answer

Sqoop: ERROR tool.BaseSqoopTool: Unrecognized argument

The command you are executing is slightly ...READ MORE

Aug 1, 2019 in Big Data Hadoop by Sam
 • 4,651 views
0 votes
1 answer

Hive: org.apache.hadoop.security.AccessControlException Permission denied: user

This error is generally thrown when the ...READ MORE

Aug 1, 2019 in Big Data Hadoop by Waniku
 • 2,694 views
0 votes
1 answer

Cassandra: time out when using select * or copy command

If we get the TimeOut Exception, then ...READ MORE

Aug 1, 2019 in Big Data Hadoop by Esha
 • 1,082 views
0 votes
1 answer

Unzip files in hdfs

To unzip a gzipped (or bzipped) file, ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Joe
 • 5,352 views
0 votes
1 answer

PIG Error while loading file: -bash: syntax error near unexpected token `('

Since your data is delimited with tabs ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Ritu
 • 1,624 views
0 votes
1 answer

How to select particular column In a table in hive?

Hive is a high-level language to analyze ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Killian
 • 9,056 views
0 votes
1 answer

Pig: Remove header line in csv file

Refer to the below file det.txt: Name,Age,Location a,10,chennai b,20,bangalore We will ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Yogi
 • 1,620 views
0 votes
1 answer

Does Caching stand as the only advantage in Spark compared to Hadoop?

Spark has much lower per job and ...READ MORE

Jul 31, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 325 views
0 votes
1 answer

The total number of Data Nodes running in this operation are 0 and note that there are no nodes excluded in this process.

Follow these steps: STEP 1 : stop hadoop ...READ MORE

Jul 31, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 1,048 views
0 votes
1 answer

Different between zkfc and zookeeper

Hey, The key difference between both the components ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Sunny
 1 flag • 3,266 views
0 votes
1 answer

Hive: Assign subquery to variable

Refer to this example: Step1: Check table test1 ...READ MORE

Jul 30, 2019 in Big Data Hadoop by Tina
 • 6,772 views
0 votes
1 answer

FAILEDError: java.io.IOException: Type mismatch in key from map

This error is thrown when the parameters ...READ MORE

Jul 30, 2019 in Big Data Hadoop by Rishi
 • 1,388 views
0 votes
1 answer

Converting CSV files to Parquet

--Create Hive external Table for existing data CREATE ...READ MORE

Jul 30, 2019 in Big Data Hadoop by Yogi
 • 6,730 views
0 votes
1 answer

java.lang.IllegalArgumentException: Unable to instantiate SparkSession with Hive support because Hive classes are not found.

 Try using the below build.sbt, code.scala and command ...READ MORE

Jul 30, 2019 in Big Data Hadoop by Kishan
 • 7,122 views
0 votes
1 answer

What is "java.sql.SQLException: org.apache.thrift.transport.TTransportException" in Hive?

This particular exception is related to Hive logs. ...READ MORE

Jul 30, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 6,374 views
0 votes
1 answer

What is the difference between S3n, S3a, and S3?

Your doubt is quite an interesting one. Yes, ...READ MORE

Jul 30, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 10,032 views
0 votes
1 answer

How to choose number of Executors and Executor cores?

Refer to the below when you are ...READ MORE

Jul 29, 2019 in Big Data Hadoop by Veer
 • 3,418 views
0 votes
1 answer

Error while Loading data to Hive.

Your data node is not running that ...READ MORE

Jul 29, 2019 in Big Data Hadoop by Quill
 • 754 views
0 votes
1 answer

Killing oozie Jobs by userid

Suppose you want to kill the jobs ...READ MORE

Jul 29, 2019 in Big Data Hadoop by Esha
 • 1,474 views
0 votes
1 answer

Difference between put and copyFromLocal

-Put and -copyFromLocal is almost same command ...READ MORE

Jul 29, 2019 in Big Data Hadoop by Neeraj
 • 11,398 views
0 votes
1 answer

Multiple Output format in Hadoop

Each reducer uses an OutputFormat to write ...READ MORE

Jul 26, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 1,669 views
0 votes
1 answer

Does HQL query go to all the nodes to process data?

InputSplits are created by logical division of ...READ MORE

Jul 26, 2019 in Big Data Hadoop by Tina
 • 356 views
0 votes
1 answer

Why is Hive called as Data Warehouse?

Hive is a data warehouse infrastructure tool ...READ MORE

Jul 26, 2019 in Big Data Hadoop by Joshua
 • 5,271 views
0 votes
1 answer

Write data into hive table in a parquet

Below is an example query which you ...READ MORE

Jul 26, 2019 in Big Data Hadoop by Sadu
 • 2,525 views
0 votes
1 answer

Explanation to outputcollector vs context

Both codes contain different API of Map ...READ MORE

Jul 26, 2019 in Big Data Hadoop by Rasheed
 • 1,264 views
0 votes
1 answer

Query regarding ArrayBuffer

It's because that is the syntax. This ...READ MORE

Jul 26, 2019 in Big Data Hadoop by Rishi
 • 268 views
0 votes
1 answer

How to find in incorrect file/records in hive?

A value with a wrong datatype causes ...READ MORE

Jul 25, 2019 in Big Data Hadoop by Ritu
 • 2,063 views
0 votes
1 answer

Hive Query: Split value

You can use the SUBSTR() in hive ...READ MORE

Jul 25, 2019 in Big Data Hadoop by Paul
 • 333 views
0 votes
1 answer

Parquet & Avro File hadling with HIVE

For avro you can follow the format ...READ MORE

Jul 25, 2019 in Big Data Hadoop by Tarun
 • 2,171 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.