getNumPartitions in Spark not working

Lab Support
#1

Hi,

I am trying to execute the below command to get number of partitions and its not working. please guide.

scala> val myf = sc.textFile(“file:///home/maheshharuvaiah8134/emp_info”)

scala> myf.getNumPartitions()
:24: error: value getNumPartitions is not a member of org.apache.spark.rdd.RDD[String]
myf.getNumPartitions()
Thanks,
Mahesh .H

#2

Try myf.getNumPartitions

And

myf.partitions.length for older version

1 Like