What happens to RDD when one of the nodes goes down

0 votes
In Spark, data is distributed on the different nodes in the form of RDD. What happens if one of the node goes down where RDD is distributed?

Thanks in advance!
Sep 3, 2018 in Apache Spark by Shubham
• 13,490 points
1,794 views

1 answer to this question.

0 votes
Whenever a node goes down, Spark knows how to prepare a certain data set because it is aware of various transformations and actions that have lead to the dataset in the form of a DAG, it will be able to apply the same transformations and actions to prepare the lost partition of the node which has gone down.

Hope this will help!
answered Sep 3, 2018 by nitinrawat895
• 11,380 points

Related Questions In Apache Spark

–1 vote
0 answers
0 votes
1 answer
0 votes
2 answers

5)Using which one of the given choices will you create an RDD with specific partitioning?

Hi, @Ritu, option b for you, as Hash Partitioning ...READ MORE

answered Nov 23, 2020 in Apache Spark by Gitika
• 65,890 points
4,262 views
+1 vote
1 answer
0 votes
1 answer

Writing File into HDFS using spark scala

The reason you are not able to ...READ MORE

answered Apr 6, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
17,278 views
0 votes
1 answer

Is there any way to check the Spark version?

There are 2 ways to check the ...READ MORE

answered Apr 19, 2018 in Apache Spark by nitinrawat895
• 11,380 points
8,489 views
0 votes
1 answer

What's the difference between 'filter' and 'where' in Spark SQL?

Both 'filter' and 'where' in Spark SQL ...READ MORE

answered May 23, 2018 in Apache Spark by nitinrawat895
• 11,380 points
34,315 views
0 votes
1 answer

When running Spark on Yarn, do I need to install Spark on all nodes of Yarn Cluster?

No, it is not necessary to install ...READ MORE

answered Jun 14, 2018 in Apache Spark by nitinrawat895
• 11,380 points
6,212 views
+1 vote
8 answers

How to print the contents of RDD in Apache Spark?

Save it to a text file: line.saveAsTextFile("alicia.txt") Print contains ...READ MORE

answered Dec 10, 2018 in Apache Spark by Akshay
61,708 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP