Help with Map Reduce WordCount Exercise


#1

Hi - I’m trying to run the WordCount exercise on the web console and am coming upon some errors.

I use the standard setup:

export JAVA_HOME=/usr/java/default
export PATH=${JAVA_HOME}/bin:${PATH}
export HADOOP_CLASSPATH=${JAVA_HOME}/lib/tools.jar

But when I try to access the hadoop directory and then create a jar I get errors that no such files or directories exist:

bin/hadoop com.sun.tools.javac.Main WordCount.java
jar cf wc.jar WordCount*.class

How do I correct this so that I can compile a map reduce Java class file and create an executable jar file on the cloudxlab cluster?


#2

Hi, Adam.

The jar file is present at the location below.
/usr/hdp/2.6.2.0-205/hadoop-mapreduce/hadoop-streaming.jar
Also kindly check the host id.

Now you will be able to do it.
All the best!