Can we run Spark without using Hadoop

Question

Are Spark & Hadoop tightly coupled? Can we use Spark in a standalone mode without Hadoop?

Answer 1

Yes you can. To install Spark Standalone mode, you simply place a compiled version of Spark on each node on the cluster. Spark Standalone cluster is Spark's own built-in clustered environment. Since Spark Standalone is available in the default distribution of Apache Spark it is the easiest way to run your Spark applications in a clustered environment in many cases. 

Answer 2

No, you can run spark without hadoop.
Spark is just a processing engine. If you run it on hadoop then you have an option to utilize HDFS features.

Answer 3

Hey,

Yes, Spark can run without Hadoop. All core spark features will continue to work, but you will miss things like, easily distributed all your files to all the nodes in the cluster in HDFS, etc.

But, Spark is only doing processing and it uses dynamic memory to perform the task, but to store the data you need some data storage system. Here Hadoop comes into the role with the spark, it provides the storage for spark. One more reason for using with spark is they are open source and both can integrate with each other as easily compare to other storage systems.