Sqoop import tables to Hive failing

Technical Discussions
#1

20/01/22 15:07:00 INFO mapreduce.ImportJobBase: Beginning import of orders
20/01/22 15:07:01 INFO client.RMProxy: Connecting to ResourceManager at cxln2.c.thelab-240901.internal/10.142.1.2:8050
20/01/22 15:07:01 INFO client.AHSProxy: Connecting to Application History server at cxln2.c.thelab-240901.internal/10.142.1.2:10200
20/01/22 15:07:08 INFO db.DBInputFormat: Using read commited transaction isolation
20/01/22 15:07:08 INFO db.DataDrivenDBInputFormat: BoundingValsQuery: SELECT MIN(order_id), MAX(order_id) FROM orders
20/01/22 15:07:08 INFO db.IntegerSplitter: Split size: 2525252; Num splits: 4 from: 1 to: 10101010
20/01/22 15:07:08 INFO mapreduce.JobSubmitter: number of splits:4
20/01/22 15:07:08 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1579704043538_0018
20/01/22 15:10:13 INFO retry.RetryInvocationHandler: java.io.IOException: Failed on local exception: java.io.IOException: Connection reset by peer; Host Details : local host is: “cxln4.c.thelab-240901.internal/10.142.1.4”; destination host is: “cxln2.c.thelab-240901.internal”:8050; , while invoking ApplicationClientProtocolPBClientImpl.getApplicationReport over null. Retrying after sleeping for 15000ms.
20/01/22 15:10:29 INFO ipc.Client: Retrying connect to server: cxln2.c.thelab-240901.internal/10.142.1.2:8050. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=50, sleepTime=1000 MILLISECONDS)
20/01/22 15:10:30 INFO ipc.Client: Retrying connect to server: cxln2.c.thelab-240901.internal/10.142.1.2:8050. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=50, sleepTime=1000 MILLISECONDS)
20/01/22 15:10:31 INFO ipc.Client: Retrying connect to server: cxln2.c.thelab-240901.internal/10.142.1.2:8050. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=50, sleepTime=1000 MILLISECONDS
)

#2

There is a problem with Sqoop import as even for normal import it is throwing the same error.
I’m also facing the same issue since last 2 days.

#3

Same Issue here as well! it’s not being looked upon! No response from Support!

#4

Hi,
Kindly check the updated ip address and Host of Mysql :-
ysql -h ip-10.142.1.2 -u sqoopuser -p
Mysql : NHkkP876rp
Also check the command below to import the tables from SQL to Hive.

sqoop import --connect jdbc:mysql://cxln2.c.thelab-240901.internal/sqoopex --table widgets -m 2 --hive-import --username sqoopuser -P --hive-database sqoop_testing

Also check the tables created in Hive.

All the best!

#5

It’s Working Now! Thanks!

#6

Hi,
I tried what you suggested but got error:

ERROR manager.SqlManager: Error executing statement: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Unknown database ‘sqoopex’

looks like the database “sqoopex” is missing or deleted.

please suggest

#7

Hi, Shruti.

  1. Kindly create the “sqoopex” table (You will be able to create permissions is there).

  2. Using server name connect to Mysql.
    mysql -u sqoopuser -p -h cxln2.c.thelab-240901.internal
    Password : NHkkP876rp

The use the below fro your web-console.

sqoop import --connect jdbc:mysql://cxln2.c.thelab-240901.internal/sqoopex --table widgets -m 2 --hive-import --username sqoopuser -P --hive-database sqoop_testing

Also check the tables created in Hive and if you have imported the same into Mysql.

All the best!