Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/spark/sql/SparkSessi

Technical Discussions Apache Spark
#1

Hi Team,

I am submitting scala app with below command
spark-submit --class “SimpleApp” --master local[4] target/scala-2.11/simple-project_2.11-1.0.jar

and getting below error

Exception in thread “main” java.lang.NoClassDefFoundError: org/apache/spark/sql/SparkSession$
at SimpleApp$.main(simpleApp.scala:7)
at SimpleApp.main(simpleApp.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$

My sbt file looks like below

name := “Simple Project”
version := “1.0”
scalaVersion := “2.11.8”
libraryDependencies += “org.apache.spark” %% “spark-sql” % “2.0.1”

Could you please suggest???

#2

Have you got solution??
i am also facing same issue

#3

Hi @Uday_Reddy,

Can you please try it on Spark 2.0.2?

@MADHAVI_NAIK tried it on Spark 2.0.2 and it worked for her.

Thanks

#4

i am trying on same spark version

/usr/spark2.0.2/bin/ spark-submit --name hello --master yarn --deploy-mode cluster --executor-memory 1g --executor-cores 1 --num-executors 1 --class com.first.load.Hello /home/udaychitukula6587/first.load/target/scala-2.10/helloworld_2.10-1.0.jar

for client mode it is working fine