Trending questions in Big Data Hadoop

0 votes
1 answer

Unable to create table in Hive

It is looking like your Hadoop daemons ...READ MORE

Aug 6 in Big Data Hadoop by Yogi
 • 28 views
0 votes
1 answer

Hadoop: error: Cannot lock storage /app/hadoop/tmp/dfs/name. The directory is already locked.

Hi, Check your dfs.name.dir and dfs.data.dir path in hdfs-site.xml. Or ...READ MORE

Aug 5 in Big Data Hadoop by Gitika
 • 25,340 points • 52 views
0 votes
1 answer

Hadoop: ERROR datanode.DataNode: All directories in dfs.data.dir are invalid.

Hi, Try this, first delete all contents from ...READ MORE

Aug 5 in Big Data Hadoop by Gitika
 • 25,340 points • 35 views
0 votes
1 answer

How to assign server access to client(s) through NFS export file?

Hi, You can create the export folder, you will ...READ MORE

Aug 5 in Big Data Hadoop by Gitika
 • 25,340 points • 24 views
0 votes
1 answer

Error: Zookeeper address not found from MapRFilesystem

Hey, Yarn is configured with the "zero-configuration failover". So ...READ MORE

Aug 5 in Big Data Hadoop by Gitika
 • 25,340 points • 22 views
0 votes
1 answer

java.lang.IllegalArgumentException: Unable to instantiate SparkSession with Hive support because Hive classes are not found.

 Try using the below build.sbt, code.scala and command ...READ MORE

Jul 30 in Big Data Hadoop by Kishan
 • 281 views
0 votes
0 answers

Job failed as tasks failed. failedMaps

Hello All, I am new to hadoop, i ...READ MORE

Aug 1 in Big Data Hadoop by Hemanth
 • 210 points
edited Aug 1 by Omkar • 199 views
0 votes
1 answer

Sqoop: ERROR tool.BaseSqoopTool: Error parsing arguments

There are two mistakes in the command ...READ MORE

Aug 2 in Big Data Hadoop by Kunal
 • 111 views
0 votes
1 answer

What is the difference between S3n, S3a, and S3?

Your doubt is quite an interesting one. Yes, ...READ MORE

Jul 30 in Big Data Hadoop by ravikiran
 • 4,560 points • 238 views
0 votes
1 answer

What is the best way to merge multi-part HDFS files into single file?

1. In order to merge two or ...READ MORE

Jul 29 in Big Data Hadoop by Tina
 • 269 views
0 votes
1 answer

Converting CSV files to Parquet

--Create Hive external Table for existing data CREATE ...READ MORE

Jul 30 in Big Data Hadoop by Yogi
 • 210 views
0 votes
1 answer

Hive: org.apache.hadoop.security.AccessControlException Permission denied: user

This error is generally thrown when the ...READ MORE

Aug 1 in Big Data Hadoop by Waniku
 • 77 views
0 votes
1 answer

Can't seem to read files: "Invalid container ID"

You will have to start pig first ...READ MORE

Aug 2 in Big Data Hadoop by TIna
 • 28 views
0 votes
1 answer

Sqoop: ERROR tool.BaseSqoopTool: Unrecognized argument

The command you are executing is slightly ...READ MORE

Aug 1 in Big Data Hadoop by Sam
 • 69 views
0 votes
1 answer

What is "java.sql.SQLException: org.apache.thrift.transport.TTransportException" in Hive?

This particular exception is related to Hive logs. ...READ MORE

Jul 30 in Big Data Hadoop by ravikiran
 • 4,560 points • 156 views
0 votes
1 answer

Different between zkfc and zookeeper

Hey, The key difference between both the components ...READ MORE

Jul 31 in Big Data Hadoop by Sunny
 1 flag • 77 views
0 votes
1 answer

Cassandra: time out when using select * or copy command

If we get the TimeOut Exception, then ...READ MORE

Aug 1 in Big Data Hadoop by Esha
 • 24 views
0 votes
1 answer

PIG Error while loading file: -bash: syntax error near unexpected token `('

Since your data is delimited with tabs ...READ MORE

Jul 31 in Big Data Hadoop by Ritu
 • 40 views
0 votes
1 answer

The total number of Data Nodes running in this operation are 0 and note that there are no nodes excluded in this process.

Follow these steps: STEP 1 : stop hadoop ...READ MORE

Jul 31 in Big Data Hadoop by ravikiran
 • 4,560 points • 36 views
0 votes
1 answer

Unzip files in hdfs

To unzip a gzipped (or bzipped) file, ...READ MORE

Jul 31 in Big Data Hadoop by Joe
 • 30 views
0 votes
1 answer

How to select particular column In a table in hive?

Hive is a high-level language to analyze ...READ MORE

Jul 31 in Big Data Hadoop by Killian
 • 28 views
0 votes
1 answer

Pig: Remove header line in csv file

Refer to the below file det.txt: Name,Age,Location a,10,chennai b,20,bangalore We will ...READ MORE

Jul 31 in Big Data Hadoop by Yogi
 • 20 views
0 votes
1 answer

Does Caching stand as the only advantage in Spark compared to Hadoop?

Spark has much lower per job and ...READ MORE

Jul 31 in Big Data Hadoop by ravikiran
 • 4,560 points • 19 views
0 votes
1 answer

How can I append data to an existing file in HDFS?

You have to do some configurations as ...READ MORE

Jul 25 in Big Data Hadoop by ravikiran
 • 4,560 points • 266 views
0 votes
2 answers

Namenode is not getting started

Hi, You can do one thing, first delete all ...READ MORE

Aug 5 in Big Data Hadoop by Namisha
 • 37 views
0 votes
1 answer

FAILEDError: java.io.IOException: Type mismatch in key from map

This error is thrown when the parameters ...READ MORE

Jul 30 in Big Data Hadoop by Rishi
 • 29 views
0 votes
1 answer

Hive: Assign subquery to variable

Refer to this example: Step1: Check table test1 ...READ MORE

Jul 30 in Big Data Hadoop by Tina
 • 25 views
0 votes
1 answer

How to choose number of Executors and Executor cores?

Refer to the below when you are ...READ MORE

Jul 29 in Big Data Hadoop by Veer
 • 57 views
0 votes
1 answer

Difference between put and copyFromLocal

-Put and -copyFromLocal is almost same command ...READ MORE

Jul 29 in Big Data Hadoop by Neeraj
 • 50 views
0 votes
1 answer

Error while Loading data to Hive.

Your data node is not running that ...READ MORE

Jul 29 in Big Data Hadoop by Quill
 • 26 views
0 votes
1 answer

Killing oozie Jobs by userid

Suppose you want to kill the jobs ...READ MORE

Jul 29 in Big Data Hadoop by Esha
 • 23 views
0 votes
1 answer

Why is Hive called as Data Warehouse?

Hive is a data warehouse infrastructure tool ...READ MORE

Jul 26 in Big Data Hadoop by Joshua
 • 88 views
0 votes
2 answers

Exception in thread "main" java.lang.UnsupportedClassVersionError

Hi, keep in mind do not forget to ...READ MORE

Aug 5 in Big Data Hadoop by Rashi
 • 52 views
0 votes
2 answers

Error in running hdfs commands

Hey, You can check this command also  hadoop fs ...READ MORE

Aug 5 in Big Data Hadoop by Rashi
 • 21 views
0 votes
1 answer

Multiple Output format in Hadoop

Each reducer uses an OutputFormat to write ...READ MORE

Jul 26 in Big Data Hadoop by ravikiran
 • 4,560 points • 33 views
0 votes
1 answer

Does HQL query go to all the nodes to process data?

InputSplits are created by logical division of ...READ MORE

Jul 26 in Big Data Hadoop by Tina
 • 22 views
0 votes
1 answer

Write data into hive table in a parquet

Below is an example query which you ...READ MORE

Jul 26 in Big Data Hadoop by Sadu
 • 25 views
0 votes
1 answer

Explanation to outputcollector vs context

Both codes contain different API of Map ...READ MORE

Jul 26 in Big Data Hadoop by Rasheed
 • 23 views
0 votes
1 answer

Load data into the hive table

You can try something like this: hadoop dfs ...READ MORE

Jul 26 in Big Data Hadoop by Vaibhav
 • 21 views
0 votes
1 answer

Query regarding ArrayBuffer

It's because that is the syntax. This ...READ MORE

Jul 26 in Big Data Hadoop by Rishi
 • 20 views
0 votes
2 answers

How to set up Map and Reduce Tasks?

Hi, The number of map tasks for a ...READ MORE

Aug 5 in Big Data Hadoop by Rashi
 • 54 views
+1 vote
1 answer

Which programming language is most preferable for working Hadoop? Java and Python? and which one is most easy to learn?

Hi, To start with Hadoop I would suggest ...READ MORE

Jul 24 in Big Data Hadoop by Nitu
 • 59 views
0 votes
1 answer

Parquet & Avro File hadling with HIVE

For avro you can follow the format ...READ MORE

Jul 25 in Big Data Hadoop by Tarun
 • 33 views
0 votes
1 answer

Current Date in Hive

Try this instead: select from_unixtime(unix_timestamp()); If you have an ...READ MORE

Jul 25 in Big Data Hadoop by Tina
 • 28 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.