Spark-Shell Throws Error

scala> 20/10/22 11:49:30 WARN DFSClient: DFSOutputStream ResponseProcessor exception for block BP-726716649-10.142.1.1-1559900602525:blk_1079116581_5398520
java.io.EOFException: Premature EOF: no length prefix available
at org.apache.hadoop.hdfs.protocolPB.PBHelper.vintPrefixed(PBHelper.java:2464)
at org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:244)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer$ResponseProcessor.run(DFSOutputStream.java:843)
20/10/22 11:49:30 WARN DFSClient: Error Recovery for block BP-726716649-10.142.1.1-1559900602525:blk_1079116581_5398520 in pipeline DatanodeInfoWithStorage[10.142.0.5:50010,DS-fd852e12-9417-40cb-8097-6b7ca8a8889d,DISK], DatanodeInfoWithStorage[10.142.1.1:50010,DS-c5771155-beda-4d3b-91ec-ed95cad48cee,DISK], DatanodeInfoWithStorage[10.142.1.4:50010,DS-c7e9dc38-f6c1-4102-a5eb-7baa670e5c95,DISK]: bad datanode DatanodeInfoWithStorage[10.142.0.5:50010,DS-fd852e12-9417-40cb-8097-6b7ca8a8889d,DISK]

Hi Geeth,

When are you getting this error?

Could you help me with the steps you are following in order for us to replicate the error?