Python map reduce program

Lab Support
#1

Dear sir ,

I am getting a folowing error :slight_smile:
Not a valid JAR: /usr/hdp/2.3.4.0-3485/hadoop-mapreduce/hadoop-streaming

Command :hadoop jar /usr/hdp/2.3.4.0-3485/hadoop-mapreduce/hadoop-streaming

#2

Hi @CS19M007_Mahendra_Va,

Did you check if the JAR is present in the above location?

#3

Can you please let me know how to check.
Please this is the first time I am doing it

#4

It would be great if you can also share the full command that you are using.

#5

Sir this is the command

hadoop jar /usr/hdp/2.3.4.0-3485/hadoop-mapreduce/hadoop-streaming

#6

Atleast can i get the command to compile it?

#7

Sir my code ran correctly

Command : hadoop jar /usr/hdp/2.6.2.0-205/hadoop-mapreduce/hadoop-streaming-2.7.3.2.6.2.0-205.jar -input sales_data.csv -output output -mapper mapper_1.py -file mapper_1.
py -reducer reducer_1.py -file reducer_1.py

But in file browser i am not getting output in output folder.

image
image1880×398 28.3 KB