Hadoop Data node acknowledgement

0 votes

Will the first data node waits to send acknowledgment to core switch until it receives acknowledgment from the other(second ) data node?

Dec 18, 2018 in Big Data Hadoop by slayer
• 29,240 points
52 views

1 answer to this question.

0 votes
Let's understand full write mechanism so that you can get the full concept of this structure.

DS --> DN1 -->DN4 --> DN6

The above structure of data nodes shows that the order can't be a break so that the Data streamer should know how the data is traversing and to which data node to data node the data is been copied.

Data Streamer will transfer data to Data node 1 and Datanode 1 will transfer data to Data Node 4 and the process continues.

While receiving Acknowledgement data Node 6 will first respond that data is copied in me and it will send acknowledgment to Data Node 4 then data Node 4 will send acknowledgement to data node 1 that in data node 6 and on my data is been written  then data node 1 will be responding data streamer that pleases acknowledge name node that the data is been written to all three data nodes.

This process is followed in data transfer state.

When transferring data node 1 to data node 4 this is the flow:

DN1--> switch on rack 1 -->core switch-->switchon rack 5 -->DN4

Switch involvement comes only in data transferring not in sending acknowledgement state.

Coming to the scenario of Blocks

Data is very vast so we have divided into two blocks A and B.

A is stored in Rack 1 and then it is stored in Rack 4 which is fulfilling Rack awareness 3 rules.

B is randomly stored in Rack 1 randomly than in a different rack, it needs to store another replica so it chooses that fulfils rack 7 and 2 and 3 rule of rack awareness.

Hope this helps.
answered Dec 18, 2018 by Omkar
• 68,160 points

Related Questions In Big Data Hadoop

0 votes
1 answer

Understanding Hadoop Master Node, Slave Node and Data Node.

The NameNode and the JobTracker are single ...READ MORE

answered Sep 6, 2018 in Big Data Hadoop by Frankie
• 9,810 points
570 views
0 votes
1 answer

How to install and configure a multi-node Hadoop cluster?

I would recommend you to install Cent ...READ MORE

answered Mar 21, 2018 in Big Data Hadoop by Shubham
• 13,350 points
731 views
0 votes
1 answer
0 votes
1 answer

Hadoop vs Data Lake

A data lake is a storage repository that holds ...READ MORE

answered Mar 26, 2018 in Big Data Hadoop by Ashish
• 2,630 points
544 views
0 votes
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,760 points
3,561 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,760 points
443 views
+1 vote
11 answers

hadoop fs -put command?

put syntax: put <localSrc> <dest> copy syntax: copyFr ...READ MORE

answered Dec 7, 2018 in Big Data Hadoop by Aditya
18,286 views
0 votes
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,280 points
1,322 views
0 votes
1 answer

Hadoop: “Unhealthy Node local-dirs and log-dirs are bad”

You can increase the threshold in yarn-site.xml <property> ...READ MORE

answered Nov 8, 2018 in Big Data Hadoop by Omkar
• 68,160 points
712 views
0 votes
1 answer

Hadoop Hive: How to insert data in Hive table?

First, copy data into HDFS. Then create ...READ MORE

answered Nov 12, 2018 in Big Data Hadoop by Omkar
• 68,160 points
1,983 views