16 What allows spark to periodically persist data about an application such that it can recover from failures

0 votes
16)What allows spark to periodically persist data about an application such that it can recover from failures?
a)  recomputing lost RDDs from HDFS
b)  RDD lineage
c)  Checkpoint
d)  RDD partitions
Nov 25, 2020 in Apache Spark by Edureka
 • 200 points • 1,653 views

1 answer to this question.

0 votes
Hi@Edureka,

Checkpointing is a process of truncating RDD lineage graph by calling its function and saving it to a reliable hard disk which is distributed in nature or local file system. You can go with option C.
answered Nov 26, 2020 by MD
 • 95,440 points

Related Questions In Apache Spark

0 votes
0 answers

What allows spark to periodically persist data about an application such that it can recover from failures?

What allows spark to periodically persist data ...READ MORE

Nov 26, 2020 in Apache Spark by ritu
 • 960 points
closed Nov 26, 2020 by MD • 2,505 views
+1 vote
1 answer

How can I write a text file in HDFS not from an RDD, in Spark program?

Yes, you can go ahead and write ...READ MORE

answered May 29, 2018 in Apache Spark by Shubham
 • 13,490 points • 7,960 views
0 votes
1 answer

Is it mandatory to start Hadoop to run spark application?

No, it is not mandatory, but there ...READ MORE

answered Jun 14, 2018 in Apache Spark by nitinrawat895
 • 11,380 points • 691 views
0 votes
1 answer

Is it mandatory to start Hadoop to run spark application?

Hi, No, not mandatory, but there is no ...READ MORE

answered Jul 5, 2019 in Apache Spark by Gitika
 • 65,910 points • 750 views
+1 vote
1 answer

How to read a data from text file in Spark?

Hey, You can try this: from pyspark import SparkContext SparkContext.stop(sc) sc ...READ MORE

answered Aug 6, 2019 in Apache Spark by Gitika
 • 65,910 points • 4,716 views
0 votes
1 answer

Efficient way to read specific columns from parquet file in spark

As parquet is a column based storage ...READ MORE

answered Apr 20, 2018 in Apache Spark by kurt_cobain
 • 9,390 points • 7,334 views
0 votes
1 answer

How to stop messages from being displayed on spark console?

In your log4j.properties file you need to ...READ MORE

answered Apr 24, 2018 in Apache Spark by kurt_cobain
 • 9,390 points • 5,061 views
+1 vote
1 answer

Can anyone explain what is RDD in Spark?

RDD is a fundamental data structure of ...READ MORE

answered May 24, 2018 in Apache Spark by Shubham
 • 13,490 points • 2,428 views
0 votes
1 answer

6)What allows spark streaming to provide fault tolerance for network sources of data?

Hi@ritu, Fault tolerance is the property that enables ...READ MORE

answered Dec 1, 2020 in Apache Spark by MD
 • 95,440 points • 2,106 views
0 votes
1 answer

In AWS, if user wants to run spark, then on top of which one of the following can the user do it?

Hi@ritu, AWS has lots of services. For spark ...READ MORE

answered Nov 26, 2020 in Apache Spark by MD
 • 95,440 points • 1,166 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP
"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.