Hi @abhinav,
I’m trying to run few sqoop actions in oozie, I have created few oozie jobs using Hue ‘Job Designer’.
Even when trying for basic sqoop commands like:
sqoop job --list
sqoop list-databases
There are oozie job running issues, please find the logs below:
> Sqoop command arguments :
> sqoop
> job
> --list
> Fetching child yarn jobs
> tag id : oozie-45f098a5a4ae34d6ba53a09bd93a1b38
> 2017-12-30 11:57:34,774 INFO [main] client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at ip-172-31-53-48.ec2.internal/172.31.53.48:8050
> Child yarn jobs are found -
> =================================================================
**> **
> >>> Invoking Sqoop command line now >>>
**> **
> 1655 [main] WARN org.apache.sqoop.tool.SqoopTool - $SQOOP_CONF_DIR has not been set in the environment. Cannot check for additional configuration.
> 2017-12-30 11:57:34,936 WARN [main] tool.SqoopTool (SqoopTool.java:loadPluginsFromConfDir(177)) - $SQOOP_CONF_DIR has not been set in the environment. Cannot check for additional configuration.
> Intercepting System.exit(1)
**> **
> <<< Invocation of Main class completed <<<
**> **
> Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SqoopMain], exit code [1]
**> **
> Oozie Launcher failed, finishing Hadoop job gracefully
When these commands are running properly from command line, but same is giving errors when running from oozie.
I have verified few paths for required JARs are available or not, but they are available.
hadoop fs -ls /user/oozie/share/lib/sqoop/
hadoop fs -ls /user/oozie/share/lib/lib_20151227132519/sqoop/
Sqoop JAR & MySQL connector jars are available.
Please help to resolve the issue