DSQuotaExceededException

Hi

I am getting following error and not able to save data. If you check below screenshot
I have tried du-hs command and it shows 642M only I have also deleted files from HDFS
Please let me know how it is calculating and what is the solution.

scala> resultdf.write.format(“csv”).mode(“append”).option(“header”,“true”).save(“results/practice2/problem3/problem3result.csv”)
[Stage 5:=============================================> (167 + 17) / 200]20/06/11 14:53:32 WARN DFSClient: DataStreamer Exception
org.apache.hadoop.hdfs.protocol.DSQuotaExceededException: The DiskSpace quota of /user/mearupmukherjee17025 is exceeded: quota = 4294967296 B = 4 GB but diskspace
consumed = 4647448445 B = 4.33

image

Hi,

Kindly refer to this discussions for more insights.


All the best!