Hadoop Data node acknowledgement

0 votes

Will the first data node waits to send acknowledgment to core switch until it receives acknowledgment from the other(second ) data node?

Dec 18, 2018 in Big Data Hadoop by slayer
• 29,040 points
18 views

1 answer to this question.

Your answer

Your name to display (optional):
Privacy: Your email address will only be used for sending these notifications.
0 votes
Let's understand full write mechanism so that you can get the full concept of this structure.

DS --> DN1 -->DN4 --> DN6

The above structure of data nodes shows that the order can't be a break so that the Data streamer should know how the data is traversing and to which data node to data node the data is been copied.

Data Streamer will transfer data to Data node 1 and Datanode 1 will transfer data to Data Node 4 and the process continues.

While receiving Acknowledgement data Node 6 will first respond that data is copied in me and it will send acknowledgment to Data Node 4 then data Node 4 will send acknowledgement to data node 1 that in data node 6 and on my data is been written  then data node 1 will be responding data streamer that pleases acknowledge name node that the data is been written to all three data nodes.

This process is followed in data transfer state.

When transferring data node 1 to data node 4 this is the flow:

DN1--> switch on rack 1 -->core switch-->switchon rack 5 -->DN4

Switch involvement comes only in data transferring not in sending acknowledgement state.

Coming to the scenario of Blocks

Data is very vast so we have divided into two blocks A and B.

A is stored in Rack 1 and then it is stored in Rack 4 which is fulfilling Rack awareness 3 rules.

B is randomly stored in Rack 1 randomly than in a different rack, it needs to store another replica so it chooses that fulfils rack 7 and 2 and 3 rule of rack awareness.

Hope this helps.
answered Dec 18, 2018 by Omkar
• 65,840 points

Related Questions In Big Data Hadoop

0 votes
1 answer

Understanding Hadoop Master Node, Slave Node and Data Node.

The NameNode and the JobTracker are single ...READ MORE

answered Sep 6, 2018 in Big Data Hadoop by Frankie
• 9,570 points
252 views
0 votes
1 answer

How to install and configure a multi-node Hadoop cluster?

I would recommend you to install Cent ...READ MORE

answered Mar 21, 2018 in Big Data Hadoop by Shubham
• 12,150 points
445 views
0 votes
1 answer
0 votes
1 answer

Hadoop vs Data Lake

A data lake is a storage repository that holds ...READ MORE

answered Mar 26, 2018 in Big Data Hadoop by Ashish
• 2,630 points
275 views
0 votes
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 9,030 points
1,645 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 9,030 points
130 views
0 votes
10 answers

hadoop fs -put command?

copy command can be used to copy files ...READ MORE

answered Dec 7, 2018 in Big Data Hadoop by Sujay
7,980 views
0 votes
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
555 views
0 votes
1 answer

Hadoop: “Unhealthy Node local-dirs and log-dirs are bad”

You can increase the threshold in yarn-site.xml <property> ...READ MORE

answered Nov 8, 2018 in Big Data Hadoop by Omkar
• 65,840 points
271 views
0 votes
1 answer

Hadoop Hive: How to insert data in Hive table?

First, copy data into HDFS. Then create ...READ MORE

answered Nov 12, 2018 in Big Data Hadoop by Omkar
• 65,840 points
98 views

© 2018 Brain4ce Education Solutions Pvt. Ltd. All rights Reserved.
"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.