Trending questions in Big Data Hadoop

0 votes
1 answer

How Hadoop distributes block writes into HDFS?

So, what happens is the slave node ...READ MORE

Aug 16, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
39 views
0 votes
1 answer

Determining HDFS space in a cluster?

There are two ways to determine available ...READ MORE

Aug 16, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
36 views
0 votes
1 answer

Determining number of reduces?

Number of reduces are set by the ...READ MORE

Aug 16, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
33 views
0 votes
2 answers

Which framework allows random, realtime read/write access to hundreds of terabytes of data?

For this type of case you can ...READ MORE

Aug 13, 2018 in Big Data Hadoop by anonymous
145 views
0 votes
1 answer

Can I have a list of property files used in Hadoop Framework?

Here is a complete list of configuration ...READ MORE

Aug 14, 2018 in Big Data Hadoop by Frankie
• 9,810 points
69 views
0 votes
1 answer

How should I connect Hadoop in C#?

The Uri should be your Cluster Name, ...READ MORE

Aug 7, 2018 in Big Data Hadoop by Neha
• 6,280 points
353 views
0 votes
2 answers

Which of these will vanish: Flink vs Spark?

At first glance, Flink and Spark would ...READ MORE

Aug 13, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
88 views
0 votes
1 answer

GROUP and COGROUP in PIG

Both GROUP and COGROUP operators are identical ...READ MORE

Jul 25, 2018 in Big Data Hadoop by shams
• 3,580 points
865 views
0 votes
1 answer

Determining how many mappers will run?

Here what happens is, each file would ...READ MORE

Aug 8, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
150 views
0 votes
2 answers

How does Hadoop/Spark is used for building large analytics report?

The best possible framework for this task ...READ MORE

Aug 7, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
163 views
0 votes
1 answer

What is the difference between a Big Data Warehouse and a traditional Data Warehouse?

Hadoop is similar in architecture to MPP data ...READ MORE

Aug 9, 2018 in Big Data Hadoop by Frankie
• 9,810 points
88 views
0 votes
1 answer

How to extract Cloudera Hadoop VM archive?

If you are Windows, you need to ...READ MORE

Aug 9, 2018 in Big Data Hadoop by Frankie
• 9,810 points
101 views
0 votes
1 answer

How to run Map Reduce program using Ubuntu terminal?

 I used the following steps to execute it ...READ MORE

Aug 7, 2018 in Big Data Hadoop by Neha
• 6,280 points
183 views
0 votes
1 answer

What is the difference between a Big Data Warehouse and a traditional Data Warehouse

Hadoop is similar in architecture to MPP data ...READ MORE

Aug 9, 2018 in Big Data Hadoop by Frankie
• 9,810 points
47 views
0 votes
1 answer

What are the different ways of Installing Hadoop into our local machine?

Hadoop runs on Unix and on Windows. ...READ MORE

Aug 3, 2018 in Big Data Hadoop by Neha
• 6,280 points
311 views
+2 votes
1 answer

How to calculate Maximum salary of the employee with the name using the Map Reduce Technique

Please try the below code and it ...READ MORE

Jul 25, 2018 in Big Data Hadoop by Neha
• 6,280 points
598 views
0 votes
1 answer

Storing collection of images in HDFS

Using Hadoop Sequence Files, you can store ...READ MORE

Aug 8, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
43 views
0 votes
1 answer

Operation to simulate a Hadoop Production Cluster

In this case, what you can do ...READ MORE

Aug 8, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
43 views
0 votes
1 answer

When a reduce class also serve as a combiner?

It will act as a combiner when ...READ MORE

Aug 8, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
41 views
0 votes
1 answer

Example or Use Case of Big Data

Let me answer your questions one by ...READ MORE

Aug 8, 2018 in Big Data Hadoop by Frankie
• 9,810 points
25 views
0 votes
1 answer

How to assess and compare Hadoop for Business Intelligence?

Hadoop is a great tool to be ...READ MORE

Aug 8, 2018 in Big Data Hadoop by Frankie
• 9,810 points
36 views
0 votes
1 answer

Increasing HFile block size

If you increase the block size then ...READ MORE

Aug 6, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
93 views
0 votes
1 answer

Designing Schema in HBase

Just create a single table with two ...READ MORE

Aug 6, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
59 views
0 votes
1 answer

How a client reads a file from HDFS?

Let me explain you it briefly. So, ...READ MORE

Jul 31, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
315 views
0 votes
1 answer

What are the security guidelines for Impala?

Security Guidelines for Impala: The following are the ...READ MORE

Aug 6, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
59 views
0 votes
1 answer

Cloudera Managing and Compatibality

With more partners than any other Hadoop ...READ MORE

Aug 6, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
30 views
0 votes
1 answer

What happens in a MapReduce job when you set the number of reducers to one?

If you set number of reducers as ...READ MORE

Jul 31, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
214 views
0 votes
1 answer

Which is the most preferable language for Hadooop Map-Reduce programs?

MapReduce is a programming model to perform ...READ MORE

Aug 3, 2018 in Big Data Hadoop by Neha
• 6,280 points
62 views
0 votes
1 answer

Passing keys and values to the reducers during a standard sort and shuffle phase of MapReduce

Let me explain you the whole scenario Reducer ...READ MORE

Jul 27, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
346 views
0 votes
1 answer

Difference between a failed task attempt and a killed task attempt

Let me explain you the difference between ...READ MORE

Jul 24, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
475 views
0 votes
1 answer

Reading the file and populating the associative array

You can use the configure method to ...READ MORE

Aug 2, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
78 views
0 votes
1 answer

Is there any way to make Apache Commons Math Library available to MapReducer job at runtime?

So, what you can do is when ...READ MORE

Aug 2, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
55 views
0 votes
1 answer

Block Scanner HDFS

Block scanner runs periodically on every DataNode ...READ MORE

Jul 31, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
146 views
0 votes
1 answer

Checkpoint Node in Hadoop

Checkpoint Node keeps track of the latest ...READ MORE

Jul 31, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
144 views
0 votes
2 answers

How do I integrate Kdb+ and hadoop?

 kdb+ could be installed on every Hadoop ...READ MORE

Aug 6, 2018 in Big Data Hadoop by Anmol
• 3,620 points
312 views
0 votes
1 answer

Backup and Checkpoint Node

Checkpoint Node keeps track of the latest ...READ MORE

Jul 31, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
49 views
0 votes
1 answer

HDFS for customer information file

No, because HDFS is optimized for write-once, ...READ MORE

Jul 31, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
34 views
0 votes
1 answer

How compression works in Hadoop?

It basically depends on the file type ...READ MORE

Jul 26, 2018 in Big Data Hadoop by Frankie
• 9,810 points
223 views
0 votes
1 answer

Mappers in Hadoop

The number of mappers is determined by ...READ MORE

Jul 31, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
21 views
0 votes
1 answer

How to avoid a “split-brain” scenario with NameNodes?

Okay, so let me tell you that ...READ MORE

Jul 11, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
867 views
0 votes
1 answer

Hortonworks vs Cloudera Architecture Difference

Features Cloudera MapR HortonWorks License Commercial Commercial Open-Source Community Yes Yes Yes SQL Impala Hive, Drill, Shark Stinger MapReduce Yes Yes Yes Unique Features Cloudera Manager Direct Access NFS 100% ...READ MORE

Jul 26, 2018 in Big Data Hadoop by Frankie
• 9,810 points
93 views
0 votes
1 answer

How to create a project for the first time in Hadoop.?

If you want to learn Hadoop framework ...READ MORE

Jul 26, 2018 in Big Data Hadoop by Neha
• 6,280 points
92 views
0 votes
1 answer

What metadata is stored on a DataNode when a block is written to it?

Let me explain you step by step.  Each ...READ MORE

Jul 23, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
228 views
+1 vote
0 answers

How to set up Hadoop cluster on Mac in intelliJ IDEA

I have Installed hadoop using brew and ...READ MORE

Jul 25, 2018 in Big Data Hadoop by Neha
• 6,280 points
147 views
0 votes
1 answer

Use of MapReduce in PIG

Apache Pig programs are written in a ...READ MORE

Jul 25, 2018 in Big Data Hadoop by shams
• 3,580 points
128 views
0 votes
1 answer

When do reduce tasks start in Hadoop?

The reduce phase has 3 steps: shuffle, ...READ MORE

Jul 26, 2018 in Big Data Hadoop by Frankie
• 9,810 points
38 views
+1 vote
1 answer

Reading Performance in Hadoop Cluster

For speeding up reading performance of your ...READ MORE

Jul 25, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
35 views
0 votes
1 answer

Sqoop Metastore ?

Sqoop metastore is a shared metadata repository ...READ MORE

Jul 19, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
175 views
0 votes
1 answer

How can Hadoop discover missing or corrupt HDFS data?

HDFS supports fsck command to check for ...READ MORE

Jul 19, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
167 views
0 votes
1 answer

Importing a portion of Relational Database to HDFS

Yes, there is a tool called Sqoop ...READ MORE

Jul 20, 2018 in Big Data Hadoop by nitinrawat895
• 10,710 points
89 views