HOW CAN I DOWNLOAD ALL THE DATA THAT I COPY TO MY HOME DIRECTORY TO MY LAPTOP SO THAT I CAN DELETE THE FILES IN THE HOME DIR AS I AM RUNNING OUT OF SPACE??
PLEASE SOLVE MY PROBLEM AS I AM NOT ABLE TO PERFORM THE PRACTICE>>
THANKYOU
If want to copy the data from HDFS, you can use Hue or use hadoop fs -get to copy it to your cloudxlab linux home directory.
For copying the data from linux home directory, please read on. There are multiple ways:
- Using Jupyter
Open Jupyter and navigate to the directory where the file is located and select the file. The “Download” button will appear. See this image:
In case, you want to download multiple files, you can package these together using:
tar -cvf mydata.tar folder1 folder2 folder3
Then you can download mydata.tar using Jupyter as mentioned above.
- Use the file transfer software
You can use any of the file transfer software that works over ssh to copy the data to you laptop. You can use: WinSCP, FIleZilla etc.
Please note that you will have to select ssh as protocol and login/password as mentioned on “My Lab” page.
how to access this file ?
/cxldata/datasets/project/mbox-short.txt
i have tried but don’t understand, need detail how to access it
You can try using the ‘cat’ or ‘more’ command to view the content of the file.