Spark job not coming in history server

Technical Discussions Apache Spark
#1

I ran some spark jobs, But my jobs are not coming in the history server - I can see others in that

http://ec2-52-22-42-138.compute-1.amazonaws.com:18080/

=
Is there any specific UI to see the spark running jobs status

#2

Hi Sachin,

To run a job on YARN, you should run the job with “–master yarn” option.

Are you doing that?

#3

Hi sgiri,
I am facing the same issue. Older jobs are showing but not the current ones.

#4

To run a job on YARN, you should run the job with “–master yarn” option for example:
spark-shell --master yarn