Hi All,
I am creating sqoop job
sqoop job --create proj1 – import -Dmapreduce.job.user.classpath.first=true --connect jdbc:mysql://cxln2.c.thelab-240901.internal/sqoopex --username=sqoopuser --password-file “file:///home/shonabawa8272912/Passwd.txt” --table web_log_source -m 1 --incremental append --check-column id --target-dir /user/shonabawa8272912/proj1 --as-avrodatafile;
its giving me error
20/11/05 07:47:51 ERROR tool.BaseSqoopTool: Unrecognized argument: -Dmapreduce.job.user.classpath.first=true
If I am removing this, sqoop job creation is successfull but then when I am executimng this job , getting error
Error: org.apache.avro.reflect.ReflectData.addLogicalTypeConversion(Lorg/apache/avro/Conversion;)V
20/11/05 09:08:26 INFO mapreduce.Job: Task Id : attempt_1602440478847_6513_m_000000_2, Status : FAILED
Error: org.apache.avro.reflect.ReflectData.addLogicalTypeConversion(Lorg/apache/avro/Conversion;)V
As I read in earlier discussions its required in avro import -Dmapreduce.job.user.classpath.first=true but its not letting me to create job with these parameteres. Kindly help how to proceed