I ran below command on web console.
spark-submit --master yarn --class com.cloudxlab.logparser.LogParser --conf spark.eventLog.enabled=true log-parsing-ap
Below is the snippet from output.
20/06/21 13:00:46 INFO Utils: Successfully started service ‘SparkUI’ on port 4040.
20/06/21 13:00:46 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://10.142.0.24:4040
When I type this URL in browser, I get “Connection has timed out error”.
I tried below URL as well. It shows jobs from other users.
Could you advise on below:
How do I see my job on Spark UI while spark-submit is running ?
Is there a Spark history server configured on Cloudxlab ?