Spark Submit class does not exists

Question

Hi,

When executing below command getting the error "class does not exists". What am I doing wrong?

./spark-submit \
--class com/edureka/Assignments/App.class \
--master yarn \
--deploy-mode client \
/mnt/home/edureka_394914/Assignments-0.0.1-SNAPSHOT.jar

I also copied .jar file at HDFS

/mnt/home/edureka_394914/Assignments-0.0.1-SNAPSHOT.jar /user/edureka_394914/JarFile

spark home path is:

/opt/cloudera/parcels/SPARK2-2.1.0.cloudera2-1.cdh5.7.0.p0.171658/lib/spark2

Answer 1

In the command, you have mentioned the package name and class name incorrectly. You have mentioned packagename/classname whereas you need to mention packagename.classname. Also, the .class extension after the classname does not have to be mentioned.

Make the changes according to the above solution and try to execute the command once again.