Most answered questions in Big Data Hadoop

0 votes
1 answer

Error: Hive show tables does not display table "sqooptest" , which was imported by SQOOP

Hi, You can follow the below-given solution. Just enter ...READ MORE

Aug 7, 2019 in Big Data Hadoop by Gitika
 • 65,730 points
edited Aug 7, 2019 by Gitika • 1,721 views
0 votes
1 answer

Error: ERROR security.UserGroupInformation: PriviledgedActionException as:root (auth:SIMPLE)

Hey, For me, my Hadoop NameNode was in ...READ MORE

Aug 7, 2019 in Big Data Hadoop by Gitika
 • 65,730 points • 2,034 views
0 votes
1 answer

Hadoop: ERROR1070: Could not resolve count using imports: [, java.lang., org.apache.pig.builtin., org.apache.pig.impl.builtin.]

Hi, I can see the error arose because the count ...READ MORE

Aug 7, 2019 in Big Data Hadoop by Gitika
 • 65,730 points • 3,009 views
0 votes
1 answer

Hadoop: Error: Exception in thread "main" java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.JobContext, but class was expected

Hey, The error seems you have not add ...READ MORE

Aug 7, 2019 in Big Data Hadoop by Gitika
 • 65,730 points • 2,241 views
0 votes
1 answer

Hadoop:Error: Network is unreachable; Host Details : local host is: "localhost/127.0.0.1"; destination host is: "boss":32939;

Hey,  I guess there is no IP address ...READ MORE

Aug 7, 2019 in Big Data Hadoop by Gitika
 • 65,730 points • 1,784 views
0 votes
1 answer

Hadoop: Error: Hadoop Master cannot start the Slave with different user (or) Slave with different user failed to start by Hadoop Master node.

Hi, You can use these commands to get ...READ MORE

Aug 7, 2019 in Big Data Hadoop by Gitika
 • 65,730 points • 2,038 views
0 votes
1 answer

Hadoop: Error: slave: bash: line 0: cd: /opt/hadoop-1.1.0/libexec/..: No such file or directory

Hi,   In this case, it is searching ...READ MORE

Aug 7, 2019 in Big Data Hadoop by Gitika
 • 65,730 points • 1,970 views
0 votes
1 answer

Zookeeper: client.HConnnectionManager HConbectionImplementation: Cant get connection to Zookeeper:KeeperErrorCode

In edureka vm once you start hbase ...READ MORE

Aug 6, 2019 in Big Data Hadoop by Chiraya
 • 1,029 views
0 votes
1 answer

Unable to create table in Hive

It is looking like your Hadoop daemons ...READ MORE

Aug 6, 2019 in Big Data Hadoop by Yogi
 • 1,071 views
0 votes
1 answer

Error: Zookeeper address not found from MapRFilesystem

Hey, Yarn is configured with the "zero-configuration failover". So ...READ MORE

Aug 6, 2019 in Big Data Hadoop by Gitika
 • 65,730 points • 1,838 views
0 votes
1 answer

How to assign server access to client(s) through NFS export file?

Hi, You can create the export folder, you will ...READ MORE

Aug 5, 2019 in Big Data Hadoop by Gitika
 • 65,730 points • 964 views
0 votes
1 answer

Hadoop: ERROR: datanode.DataNode: java.io.IOException: Datanode state: LV = -32 CTime = 1377582559943 is newer than the namespace state: LV = -32 CTime = 0

Hey, You can do one thing, open the file ...READ MORE

Aug 5, 2019 in Big Data Hadoop by Gitika
 • 65,730 points • 1,469 views
0 votes
1 answer

Hadoop: ERROR: datanode.DataNode: java.io.IOException: Incompatible namespaceIDs in /app/hadoop/tmp/dfs/data: namenode namespaceID = 1580775695; datanode namespaceID = 1494801914

Hi, Namenode generates new namespaceID every time you ...READ MORE

Aug 5, 2019 in Big Data Hadoop by Gitika
 • 65,730 points • 1,495 views
0 votes
1 answer

Hadoop: ERROR datanode.DataNode: All directories in dfs.data.dir are invalid.

Hi, Try this, first delete all contents from ...READ MORE

Aug 5, 2019 in Big Data Hadoop by Gitika
 • 65,730 points • 2,263 views
0 votes
1 answer

ERROR org.apache.hadoop.hdfs.server.namenode.FSNamesystem: FSNamesystem initialization failed. java.io.FileNotFoundException: /app/hadoop/tmp/dfs/name/in_use.lock

Hi, You can change the owner to Hadoop ...READ MORE

Aug 5, 2019 in Big Data Hadoop by Gitika
 • 65,730 points • 2,191 views
0 votes
1 answer

Hadoop: error: Cannot lock storage /app/hadoop/tmp/dfs/name. The directory is already locked.

Hi, Check your dfs.name.dir and dfs.data.dir path in hdfs-site.xml. Or ...READ MORE

Aug 5, 2019 in Big Data Hadoop by Gitika
 • 65,730 points • 2,636 views
0 votes
1 answer

DJOB TRACKER : Can not start task tracker because java.lang.IllegalArgumentException: Does not contain a valid host:port authority: 127.0.0.1:9001

Hey, According to your property set up, there ...READ MORE

Aug 5, 2019 in Big Data Hadoop by Gitika
 • 65,730 points • 1,142 views
0 votes
1 answer

Sqoop: ERROR tool.BaseSqoopTool: Error parsing arguments

There are two mistakes in the command ...READ MORE

Aug 2, 2019 in Big Data Hadoop by Kunal
 • 8,079 views
0 votes
1 answer

Can't seem to read files: "Invalid container ID"

You will have to start pig first ...READ MORE

Aug 2, 2019 in Big Data Hadoop by TIna
 • 1,742 views
0 votes
1 answer

Sqoop: ERROR tool.BaseSqoopTool: Unrecognized argument

The command you are executing is slightly ...READ MORE

Aug 1, 2019 in Big Data Hadoop by Sam
 • 5,672 views
0 votes
1 answer

Hive: org.apache.hadoop.security.AccessControlException Permission denied: user

This error is generally thrown when the ...READ MORE

Aug 1, 2019 in Big Data Hadoop by Waniku
 • 3,472 views
0 votes
1 answer

Cassandra: time out when using select * or copy command

If we get the TimeOut Exception, then ...READ MORE

Aug 1, 2019 in Big Data Hadoop by Esha
 • 1,876 views
0 votes
1 answer

Unzip files in hdfs

To unzip a gzipped (or bzipped) file, ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Joe
 • 6,851 views
0 votes
1 answer

PIG Error while loading file: -bash: syntax error near unexpected token `('

Since your data is delimited with tabs ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Ritu
 • 2,601 views
0 votes
1 answer

How to select particular column In a table in hive?

Hive is a high-level language to analyze ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Killian
 • 10,964 views
0 votes
1 answer

Pig: Remove header line in csv file

Refer to the below file det.txt: Name,Age,Location a,10,chennai b,20,bangalore We will ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Yogi
 • 2,382 views
0 votes
1 answer

Does Caching stand as the only advantage in Spark compared to Hadoop?

Spark has much lower per job and ...READ MORE

Jul 31, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 955 views
0 votes
1 answer

The total number of Data Nodes running in this operation are 0 and note that there are no nodes excluded in this process.

Follow these steps: STEP 1 : stop hadoop ...READ MORE

Jul 31, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 1,960 views
0 votes
1 answer

Different between zkfc and zookeeper

Hey, The key difference between both the components ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Sunny
 1 flag • 4,307 views
0 votes
1 answer

Hive: Assign subquery to variable

Refer to this example: Step1: Check table test1 ...READ MORE

Jul 30, 2019 in Big Data Hadoop by Tina
 • 8,113 views
0 votes
1 answer

FAILEDError: java.io.IOException: Type mismatch in key from map

This error is thrown when the parameters ...READ MORE

Jul 30, 2019 in Big Data Hadoop by Rishi
 • 2,180 views
0 votes
1 answer

Converting CSV files to Parquet

--Create Hive external Table for existing data CREATE ...READ MORE

Jul 30, 2019 in Big Data Hadoop by Yogi
 • 7,922 views
0 votes
1 answer

java.lang.IllegalArgumentException: Unable to instantiate SparkSession with Hive support because Hive classes are not found.

 Try using the below build.sbt, code.scala and command ...READ MORE

Jul 30, 2019 in Big Data Hadoop by Kishan
 • 8,250 views
0 votes
1 answer

What is "java.sql.SQLException: org.apache.thrift.transport.TTransportException" in Hive?

This particular exception is related to Hive logs. ...READ MORE

Jul 30, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 7,626 views
0 votes
1 answer

What is the difference between S3n, S3a, and S3?

Your doubt is quite an interesting one. Yes, ...READ MORE

Jul 30, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 11,921 views
0 votes
1 answer

How to choose number of Executors and Executor cores?

Refer to the below when you are ...READ MORE

Jul 29, 2019 in Big Data Hadoop by Veer
 • 3,968 views
0 votes
1 answer

Error while Loading data to Hive.

Your data node is not running that ...READ MORE

Jul 29, 2019 in Big Data Hadoop by Quill
 • 1,687 views
0 votes
1 answer

Killing oozie Jobs by userid

Suppose you want to kill the jobs ...READ MORE

Jul 29, 2019 in Big Data Hadoop by Esha
 • 2,295 views
0 votes
1 answer

ERROR tool.ImportTool: Encountered IOException running import job: java.io.IOException: Cannot run program "hive": error=2, No such file or directory

The tables look fine. Follow these steps ...READ MORE

Jul 29, 2019 in Big Data Hadoop by Kiran
 • 2,478 views
0 votes
1 answer

Difference between put and copyFromLocal

-Put and -copyFromLocal is almost same command ...READ MORE

Jul 29, 2019 in Big Data Hadoop by Neeraj
 • 13,633 views
0 votes
1 answer

Multiple Output format in Hadoop

Each reducer uses an OutputFormat to write ...READ MORE

Jul 26, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 2,233 views
0 votes
1 answer

Does HQL query go to all the nodes to process data?

InputSplits are created by logical division of ...READ MORE

Jul 26, 2019 in Big Data Hadoop by Tina
 • 1,053 views
0 votes
1 answer

Why is Hive called as Data Warehouse?

Hive is a data warehouse infrastructure tool ...READ MORE

Jul 26, 2019 in Big Data Hadoop by Joshua
 • 6,947 views
0 votes
1 answer

Write data into hive table in a parquet

Below is an example query which you ...READ MORE

Jul 26, 2019 in Big Data Hadoop by Sadu
 • 3,395 views
0 votes
1 answer

Explanation to outputcollector vs context

Both codes contain different API of Map ...READ MORE

Jul 26, 2019 in Big Data Hadoop by Rasheed
 • 2,098 views
0 votes
1 answer

Query regarding ArrayBuffer

It's because that is the syntax. This ...READ MORE

Jul 26, 2019 in Big Data Hadoop by Rishi
 • 910 views
0 votes
1 answer

How to find in incorrect file/records in hive?

A value with a wrong datatype causes ...READ MORE

Jul 25, 2019 in Big Data Hadoop by Ritu
 • 3,035 views
0 votes
1 answer

Hive Query: Split value

You can use the SUBSTR() in hive ...READ MORE

Jul 25, 2019 in Big Data Hadoop by Paul
 • 934 views
0 votes
1 answer

Parquet & Avro File hadling with HIVE

For avro you can follow the format ...READ MORE

Jul 25, 2019 in Big Data Hadoop by Tarun
 • 3,000 views
0 votes
1 answer

Delimiter on the data

You can use this: import org.apache.spark.sql.functions.struct val df = ...READ MORE

Jul 25, 2019 in Big Data Hadoop by Vinay
 • 933 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.