Hi,
Getting the following error while trying to run a MapReduce:
[sureshnairmaxout7567@cxln4 MapReduce]$ hadoop jar /usr/hdp/2.6.2.0-205/hadoop-mapreduce/hadoop-streaming.jar -input input/yob2014.txt -out
put fnoutput -file femalenames_mapper.py -file femalenames_reducer.py -mapper femalenames_mapper.py -reducer femalenames_reducer.py
19/12/19 05:51:56 WARN streaming.StreamJob: -file option is deprecated, please use generic option -files instead.
packageJobJar: [femalenames_mapper.py, femalenames_reducer.py] [/usr/hdp/2.6.2.0-205/hadoop-mapreduce/hadoop-streaming-2.7.3.2.6.2.0-205.ja
r] /tmp/streamjob6367332392747694206.jar tmpDir=null
19/12/19 05:51:58 INFO client.RMProxy: Connecting to ResourceManager at cxln2.c.thelab-240901.internal/10.142.1.2:8050
19/12/19 05:51:58 INFO client.AHSProxy: Connecting to Application History server at cxln2.c.thelab-240901.internal/10.142.1.2:10200
19/12/19 05:51:58 INFO client.RMProxy: Connecting to ResourceManager at cxln2.c.thelab-240901.internal/10.142.1.2:8050
19/12/19 05:51:58 INFO client.AHSProxy: Connecting to Application History server at cxln2.c.thelab-240901.internal/10.142.1.2:10200
19/12/19 05:51:59 INFO mapred.FileInputFormat: Total input paths to process : 1
19/12/19 05:51:59 INFO mapreduce.JobSubmitter: number of splits:2
19/12/19 05:51:59 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1573919454381_3875
19/12/19 05:52:00 INFO impl.YarnClientImpl: Submitted application application_1573919454381_3875
19/12/19 05:52:00 INFO mapreduce.Job: The url to track the job: http://cxln2.c.thelab-240901.internal:8088/proxy/application_1573919454381_
3875/
19/12/19 05:52:00 INFO mapreduce.Job: Running job: job_1573919454381_3875
19/12/19 05:52:07 INFO mapreduce.Job: Job job_1573919454381_3875 running in uber mode : false
19/12/19 05:52:07 INFO mapreduce.Job: map 0% reduce 0%
19/12/19 05:52:18 INFO mapreduce.Job: Task Id : attempt_1573919454381_3875_m_000000_0, Status : FAILED
Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:322)
at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:535)
at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:130)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:170)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:164)