When I am trying to run customer UDF in HIVE using python getting below error message:-
FAILED: Execution Error, return code 20003 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask. An error occurred when trying to close the Operator running your custom script.
Followed below process :-
custom udf python script stored at location ///user/sanjayglcloud3746/myudf1.py:-
import sys
import datetime
for line in sys.stdin:
line = line.strip()
fname , lname = line.split(’\t’)
l_name = lname.lower()
print ‘\t’.join([fname, str(l_name)])
In HIVE shell performed following :-
add file hdfs:///user/sanjayglcloud3746/myudf1.py
SELECT TRANSFORM(fname, lname) USING ‘myudf1.py’ AS (fname, l_name) FROM mytable;