Trending questions in Big Data Hadoop

0 votes
1 answer

Synchronizing sqoop imported data in HDFS

Data can be synchronised using incremental parameter ...READ MORE

Jul 19, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
133 views
0 votes
1 answer

How the FIFO Scheduler arbitrates the cluster resources for a job and its tasks?

Let me clear your doubt. So what ...READ MORE

Jul 19, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
121 views
+1 vote
1 answer

When I try to execute any Hadoop commands error pops up saying unable to find or load main class M

The error might be due to the ...READ MORE

Jul 17, 2018 in Big Data Hadoop by Frankie
• 9,810 points
128 views
0 votes
1 answer

How to pause and resume hive job?

Practically speaking, it's difficult/impossible to pause and resume ...READ MORE

Jul 17, 2018 in Big Data Hadoop by Neha
• 6,280 points
106 views
0 votes
1 answer

Channel in Flume

 A transient store that receives the events ...READ MORE

Jul 17, 2018 in Big Data Hadoop by Ashish
• 2,630 points
34 views
0 votes
1 answer

How does HDFS Federation help HDFS Scale horizontally?

Let me try to explain you the ...READ MORE

Jul 12, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
190 views
0 votes
1 answer

Hive Precedence Order

SET Command in HIVE The command line –hiveconf ...READ MORE

Jul 9, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
99 views
0 votes
1 answer

Hadoop Nodes for Multiple Disks

Datanodes can store blocks in multiple directories ...READ MORE

Jul 3, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
281 views
0 votes
1 answer

“no such file or directory" in case of hadoop fs -ls

The behaviour that you are seeing is ...READ MORE

May 9, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points

edited May 9, 2018 by nitinrawat895 2,598 views
0 votes
1 answer

Checkpointing in Hadoop

Checkpointing is the process of combining the ...READ MORE

Jul 3, 2018 in Big Data Hadoop by Data_Nerd
• 2,360 points
206 views
0 votes
1 answer

MapFile in Pig

MapFile is a class which serves file-based ...READ MORE

Jul 6, 2018 in Big Data Hadoop by Data_Nerd
• 2,360 points
72 views
0 votes
1 answer

Are there any Limitations of Pig?

Limitations of the Apache Pig are: As the ...READ MORE

Jul 6, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
67 views
0 votes
1 answer

How to retrieve the list of sql (Hive QL) commands that has been executed in a hadoop cluster?

Well, what you can do is use ...READ MORE

Apr 4, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
3,816 views
0 votes
1 answer

NameNode Status Check

There's one more way of checking the ...READ MORE

Jun 18, 2018 in Big Data Hadoop by shams
• 3,580 points
443 views
0 votes
1 answer

Different partitoners in Cassandra

Murmur3Partitioner is the default partitioner. It is ...READ MORE

Jun 27, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
48 views
0 votes
2 answers

Download & Install Cloudera parcels without being connected to internet?

You can find the details over here ...READ MORE

Aug 16, 2018 in Big Data Hadoop by Priyaj
• 56,900 points
388 views
0 votes
1 answer

Gossip Protocol features.

Gossip Protocol in Cassandra is a peer-to-peer ...READ MORE

Jun 26, 2018 in Big Data Hadoop by Data_Nerd
• 2,360 points
30 views
0 votes
2 answers

What is the difference between the Smart Data Access of SAP HANA and SAP HANA Vora?

Hadoop: Used to store Big Data in ...READ MORE

Jun 21, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
182 views
+1 vote
2 answers

Execute Pig Script from Grunt Shell

From your current directory run  pig -x local Then ...READ MORE

Oct 25, 2018 in Big Data Hadoop by Kunal
935 views
0 votes
1 answer

After installing Hadoop on Windows7, NameNode failed to start

You need to install Hadoop winutils to ...READ MORE

May 3, 2018 in Big Data Hadoop by Shubham
• 13,300 points
2,329 views
0 votes
1 answer

How to analyze block placement on datanodes and rebalancing data across Hadoop nodes?

HDFS provides a tool for administrators i.e. ...READ MORE

Jun 21, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
132 views
0 votes
1 answer

Is there any way to setup Hadoop nodes (data nodes/namenodes) to use multiple volumes/disks?

Datanodes can store blocks in multiple directories ...READ MORE

Jun 20, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
177 views
0 votes
1 answer

How can anyone recover deleted HDFS data?

Yes, there is a trash policy in ...READ MORE

May 15, 2018 in Big Data Hadoop by Shubham
• 13,300 points
1,721 views
0 votes
1 answer

InputSplit vs HDFS Block

By definition Block – Block is the continuous ...READ MORE

Jun 1, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
957 views
0 votes
3 answers

Cloudera Hadoop - Daemons not running

Please run below mentioned command. It will ...READ MORE

Aug 7, 2018 in Big Data Hadoop by Priyaj
• 56,900 points
637 views
+1 vote
2 answers

How to authenticate username & password while using Connector for Cloudera Hadoop in Tableau?

Hadoop server installed was kerberos enabled server. ...READ MORE

Aug 21, 2018 in Big Data Hadoop by Priyaj
• 56,900 points
215 views
0 votes
1 answer

Where does HDFS stores data on the local file system?

First find the Hadoop directory present in ...READ MORE

May 8, 2018 in Big Data Hadoop by Shubham
• 13,300 points
1,899 views
0 votes
1 answer

How can I list NameNode & DataNodes from any machine in the Hadoop cluster?

You can use the jps command to ...READ MORE

Apr 18, 2018 in Big Data Hadoop by coldcode
• 2,020 points
2,753 views
0 votes
1 answer

Difference between Application Master and Application Manager?

The Application Master is responsible for the ...READ MORE

Apr 10, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
3,067 views
0 votes
1 answer

What is Speculative Execution?

If a node is executing a task ...READ MORE

Jun 18, 2018 in Big Data Hadoop by shams
• 3,580 points
38 views
0 votes
1 answer

Different Hadoop Modes

Hadoop can run in 3 different modes. 1. ...READ MORE

Jun 13, 2018 in Big Data Hadoop by shams
• 3,580 points
196 views
+1 vote
2 answers

Failed to restart Hadoop namenode using cloudera quickstart

You can use cloudera manager to manage ...READ MORE

Mar 19, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
821 views
0 votes
1 answer

NAS and HDFS Comparison

NAS stands for Network-attached Storage and is ...READ MORE

Jun 11, 2018 in Big Data Hadoop by Data_Nerd
• 2,360 points
163 views
0 votes
1 answer

What are SUCCESS and part-r-00000 files in Hadoop?

Yes, both the files i.e. SUCCESS and ...READ MORE

Apr 12, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
2,677 views
0 votes
1 answer

NameNode & DataNode memory

Name Node only store metadata which is ...READ MORE

Jun 12, 2018 in Big Data Hadoop by Data_Nerd
• 2,360 points
49 views
0 votes
1 answer

HDFS usage for small files

Well, the HDFS works more reliably with ...READ MORE

Jun 12, 2018 in Big Data Hadoop by BigData_is_my_ex
30 views
0 votes
1 answer

Replication and Calculations

Since there are 3 nodes, when we ...READ MORE

Jun 11, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
45 views
0 votes
1 answer

Is there any way to pull data from Mainframe to Hadoop?

First of all, COBOL is a programming ...READ MORE

May 21, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
872 views
0 votes
1 answer

JobTracker Task Scheduling

The task tracker send out heartbeat messages ...READ MORE

Jun 5, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
88 views
0 votes
1 answer

hadoop: command not found

The reason you are getting hadoop as ...READ MORE

Mar 27, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
3,032 views
0 votes
1 answer

How to extract only few lines of data from HDFS?

Here also in case of Hadoop, it is ...READ MORE

May 2, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
1,449 views
0 votes
1 answer

Sqoop vs distCP

DistCP utility can be used to transfer ...READ MORE

May 30, 2018 in Big Data Hadoop by Data_Nerd
• 2,360 points
175 views
0 votes
1 answer

Why minimum 3 Journal Nodes are required in Hadoop HA architecture?

Initially in Hadoop 1.x, the NameNode was ...READ MORE

Apr 20, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
1,846 views
0 votes
1 answer

When is the reduce tasks start in Hadoop?

Let me explain you the whole scenario. ...READ MORE

May 22, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
461 views
0 votes
1 answer

out of Memory Error in Hadoop

See if you can share the screenshot ...READ MORE

May 22, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
428 views
0 votes
1 answer

How can we list files in HDFS directory as per timestamp?

No, there is no other option to ...READ MORE

May 8, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
1,033 views
0 votes
1 answer

How to move data from Oracle database to Hadoop?

Yes, you heard it correctly. Apache Sqoop is ...READ MORE

Apr 11, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
2,186 views
0 votes
1 answer

NameNode without any data

There does not exist any NameNode without ...READ MORE

May 29, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
29 views
0 votes
1 answer

What is the command to check the number of cores in Spark?

Go to your Spark Web UI & ...READ MORE

May 16, 2018 in Big Data Hadoop by Shubham
• 13,300 points
550 views
0 votes
1 answer

What is new in Hadoop 3?

Here are few changes in Hadoop 3 1. ...READ MORE

May 28, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
37 views