Hi Team,
I am facing the below issue while submitting the spark[-application.
Exception in thread “main” java.lang.NoSuchMethodError: scala.Predef$.longArrayOps([J)[J
Myspark program
package org.spark.learning
import org.apache.spark.SparkConf
import org.apache.spark.SparkContext
object Demo {
def main(args:Array[String]){
val conf = new SparkConf()
conf.set(“spark.master”,“local”)
conf.set(“spark.app.name”,“Demo”)
val sc = new SparkContext(conf)
val r1 = sc.range(1,10)
r1.collect.foreach(println)
sc.stop()
}
}
spark-submit command
spark-submit --class org.spark.learning.Demo /home/maruboyina90663392/SparkProject-0.0.1-SNAPSHOT.jar
Scala version in my system is : 2.12.3
spark dependencies:
<dependency>
<groupId>org.apache.spark</groupId>
<artifactId>spark-core_2.12</artifactId>
<version>2.4.0</version>
</dependency>
<dependency>
<groupId>org.apache.spark</groupId>
<artifactId>spark-sql_2.12</artifactId>
<version>2.4.1</version>
<scope>provided</scope>
</dependency>
<dependency>
<groupId>com.thoughtworks.paranamer</groupId>
<artifactId>paranamer</artifactId>
<version>2.8</version>
</dependency>
Thanks,
Madhu M