Spark context sc not found

Question

I start spark using spark-shell. 

But I am getting "sc not found " error . I have set the SPARK_MASTER_ID in spark-env.sh. stopped the service and started again using the following commands, still the same error.

sudo service hadoop-master stop
sudo service hadoop-master start hadoop dfsadmin -safemode leave

Answer 1

Maybe the hadoop service didn't start properly. Try restarting the services:

cd /usr/lib/spark-2.1.1-bin-hadoop2.7

./sbin/stop-all.sh

and then, start it again:

./sbin/start-all.sh

And then run your command