I am getting following error while trying to use foldLeft/foldRight/reduceLeft/reduceRight in spark but when using same thing in my local scala console working fine.
scala> dataRDD.foldLeft(1)(_ + )<console>:26: error: value foldLeft is not a member of org.apache.spark.rdd.RDD[Int] dataRDD.foldLeft(1)( + _)
dataRDD.reduceLeft(_ + )
:26: error: value reduceLeft is not a member of org.apache.spark.rdd.RDD[Int]
dataRDD.reduceLeft( + _)
Also when using only fold function with initial value 1 for list mentioned below I think I am getting wrong answer coming 35 instead of 27 …could you pleas check ?
scala> val data = List(1,2,3,5,7,8)data: List[Int] = List(1, 2, 3, 5, 7, 8)
scala> dataRDD.fold(1)(_ + _) res7: Int = 35