start-master and start-all?

0 votes

I'm new to apache spark. Is there any difference between sbin/start-master.sh and sbin/start-all.sh ?

May 7, 2018 in Apache Spark by Data_Nerd
• 2,390 points
567 views

1 answer to this question.

0 votes

sbin/start-master.sh : Starts a master instance on the machine the script is executed on

sbin/start-slaves.sh : Starts a slave instance on each machine specified in the conf/slaves file

sbin/start-slave.sh : Starts a slave instance on the machine the script is executed on

sbin/start-all.sh : Starts both a master and a number of slaves 

Hope this helps

answered May 7, 2018 by kurt_cobain
• 9,320 points
Thanks very helpful!

Related Questions In Apache Spark

0 votes
1 answer

how can I get all executors' pending jobs and stages of particular sparksession?

Hi@Neha, You can find all the job status ...READ MORE

answered Aug 19 in Apache Spark by MD
• 57,560 points
75 views
0 votes
1 answer

When not to use foreachPartition and mapPartition?

With mapPartion() or foreachPartition(), you can only ...READ MORE

answered Apr 30, 2018 in Apache Spark by Data_Nerd
• 2,390 points
4,554 views
0 votes
1 answer

What's the difference between 'filter' and 'where' in Spark SQL?

Both 'filter' and 'where' in Spark SQL ...READ MORE

answered May 23, 2018 in Apache Spark by nitinrawat895
• 10,950 points
16,224 views
0 votes
1 answer

Is it possible to run Spark and Mesos along with Hadoop?

Yes, it is possible to run Spark ...READ MORE

answered May 29, 2018 in Apache Spark by Data_Nerd
• 2,390 points
176 views
+1 vote
1 answer
0 votes
3 answers

Can we run Spark without using Hadoop?

No, you can run spark without hadoop. ...READ MORE

answered May 7, 2019 in Big Data Hadoop by pradeep
406 views
0 votes
1 answer

What is the benefit of using CDH over other Distributors?

CDH is basically a packaged deal, where ...READ MORE

answered Mar 29, 2018 in Big Data Hadoop by kurt_cobain
• 9,320 points
104 views
0 votes
1 answer

Writing File into HDFS using spark scala

The reason you are not able to ...READ MORE

answered Apr 5, 2018 in Big Data Hadoop by kurt_cobain
• 9,320 points
11,014 views
+1 vote
2 answers

Hadoop 3 compatibility with older versions of Hive, Pig, Sqoop and Spark

Hadoop 3 is not widely used in ...READ MORE

answered Apr 20, 2018 in Apache Spark by kurt_cobain
• 9,320 points
3,311 views
0 votes
2 answers

Difference between createOrReplaceTempView and registerTempTable

I am pretty sure createOrReplaceTempView just replaced ...READ MORE

answered Sep 18 in Apache Spark by Nathan Mott
5,829 views