Hdfs url to get the data into spark?


#1

val input = sc.textFile(“hdfs://e.cloudxlab.com:8020/home/lovableranji3469/flightdata.txt”) - this is giving error, please suggest what should be given in the data source URL.


#2

Access to HDFS from WWW is restricted because it opens up for attacks.

Please use the following commands from console: hadoop fs -ls

To learn more about the HDFS Command, Please use: https://github.com/cloudxlab/bigdata/blob/master/hdfs/gettingstarted.md

You can try free tutorials: https://cloudxlab.com/course/all/?type=free