MRjob not working

#1

what is the command to run MRjob on hadoop?

#2

You can see it here: https://cloudxlab.com/assessment/displayslide/279/run-mapreduce-jobs-using-hadoop-streaming?course_id=1&playlist_id=8&audit=true

#3

I am talking about MRjob specifically when there is only one file that has both mapper and reducer.

https://mrjob.readthedocs.io/en/latest/guides/configs-hadoopy-runners.html

#4

when I run below command it is saying hadoop streaming jar not found

-o

Screen Shot 2021-03-05 at 9.56.19 PM
Screen Shot 2021-03-05 at 9.56.19 PM2246×1160 489 KB

#5

I think you will have to create your virtual environment and install MR Job in it.

#6

ok great thanks. Also how do we handle the missing streaming jar error?

#7

@sandeepgiri can you kindly answer to my previous question?

#8

The streaming jar should be located here: /usr/hdp/current/hadoop-mapreduce-client/hadoop-streaming.jar

As mentioned in the error, use the command line argument to specify the streaming jar.