DAG flow not showing up in SparkUI

#1

HI,

I am not able to see the correct flow of the DAG stages in SparkUI. I am submitting the Action on any RDD, the log can be seen but not the stages of SparkUI. Please guide me

Thanks,
Mahesh .H

#2

Hi Mahesh,

Could you share the screenshots?

#3

These are the commands i am executing for example:

DAG1
DAG11280×800 79.9 KB

scala> val a = sc.parallelize(1 to 10,2).
a: org.apache.spark.rdd.RDD[Int] = ParallelCollectionRDD[0] at parallelize at :21
scala> val b = sc.parallelize(5 to 15,2)
b: org.apache.spark.rdd.RDD[Int] = ParallelCollectionRDD[1] at parallelize at :21
scala> a.union(b).collect

#4

Could you please check and update me…

Thanks,
Mahesh .H

#5

Hi,

Could you please check and update me ASAP.

Thanks,
Mahesh .H