Issue with Accessing Spark web UI

Lab Support
#1

Hi Team,

I am unable to access Spark web UI. Executing the spark shell on server e.cloudxlab.com and on port 4043.

Snapshot from Log:
Tracking URL from log is http://ip-172-31-35-141.ec2.internal:8088/proxy/application_1547862802432_0924/

19/01/23 20:05:57 INFO Utils: Successfully started service ‘SparkUI’ on port 4043.

When i am giving URL e.cloudxlab.com:4043 the web page is routed to http://ip-172-31-35-141.ec2.internal:8088/proxy/redirect/application_1547862802432_0924/, but giving error as “This site cannot be reached”.

Thanks

#2

Hi,

If you are using Spark in Yarn mode, you would need to use the yarn logs interface from command line. Earlier we had the yarn logs interface open for www which cause a lot of attacks so we stopped it.

This blog outlines the yarn logs:

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.5/bk_yarn-resource-management/content/ch_yarn_cli_view_running_applications.html

Regards,
Sandeep Giri