How to run scala IDE for spark jobs in Cloudxlab?


#1

Hi,

Is there any command to open to open Eclipse IDE(scala).I mean need to write Scala and Spark code. (or) is there any steps to follow to install scala IDE on our local machine and can build end to end scala and spark programs in local machine and then deploy it to cloudxlab spark server. Please let me know.

Thx,
Kiran


Spark/scala IDE
#2

Hi Kiran,

Probably, tomorrow I will be sending you. I am working on an end to end guide.

Regards,
Sandeep Giri


#3

Sure. …Thanks Sandeep…


#4

Hi,

Is there any update on this.

Thx,
Kiran


#5

Hi Kiran,

We have created a detailed tutorial which is available here: https://cloudxlab.com/assessment/playlist-intro/18/writing-spark-applications?course_id=1&playlist_id=18 (corrected)

Please do not miss the video on page#16.

Regards,
Sandeep Giri


#6

@sgiri Hi Sandeep…I am not able to view the content in this link

https://cloudxlab.com/assessment/slide/writing-spark-applications

page not found

Please advise


#7

​We have the Jupyter notebook and the unix text editors on CloudxLab using which you can code.
​It is not possible to install the softwares like intellij or Eclipse on a Cloud based environment. You can use such IDEs on desktops/laptop and then upload the code on CloudxLab for execution. See this chapter to learn about it in more details:

https://cloudxlab.com/assessment/playlist-intro/18/writing-spark-applications?course_id=1&playlist_id=18