Hi Team,
Is there any maintenance activity going on. As i cannot see f.cloudxlab host anymore and while launching ambari problem is there. I can’t see dashboard screen, its throwing server change error.
please help us.
sqoop jobs and others job are responding very slow. Please check on it.
it seems cluster is getting upgrade, not able to launch saprk at all in yarn mode
@kappuchappu_kappu and @saurabh29may
The lab has been upgraded now. We have only one web console (e.cloudxlab.com) at the moment.
Saurabh, can you please check Spark now?
Hope this helps.
Thanks
Problems:
Major spark version is 2.3.0 but its not getting launch in yarn mode.
Ambari console not working.
Hue 4: mysql db ( not showing db’s )
File local hdfs directory don’t contain files, tho somehow my files got tranferred to mysql db (retail_db)
Working:
hue 4- hive,spark,filetransfer
spark 2.3 in local mode
hive
mysql connection fine.
Rest i will be updating…
sqoop not working
18/08/19 17:20:52 INFO client.RMProxy: Connecting to ResourceManager at ip-172-31-35-141.ec2.internal/172.31.35.141:8050
18/08/19 17:20:52 INFO client.AHSProxy: Connecting to Application History server at ip-172-31-35-141.ec2.internal/172.31.35.141:10200
18/08/19 17:20:54 INFO db.DBInputFormat: Using read commited transaction isolation
18/08/19 17:20:54 INFO mapreduce.JobSubmitter: number of splits:1
18/08/19 17:20:54 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1534581202967_0135
18/08/19 17:20:54 INFO impl.YarnClientImpl: Submitted application application_1534581202967_0135
18/08/19 17:20:54 INFO mapreduce.Job: The url to track the job: http://ip-172-31-35-141.ec2.internal:8088/proxy/application_1534581202967_0135/
18/08/19 17:20:54 INFO mapreduce.Job: Running job: job_1534581202967_0135
18/08/19 17:23:42 INFO retry.RetryInvocationHandler: java.io.EOFException: End of File Exception between local host is: “ip-172-31-38-146.ec2.internal/172.31.38.14
6”; destination host is: “ip-172-31-35-141.ec2.internal”:8050; : java.io.EOFException; For more details see: http://wiki.apache.org/hadoop/EOFException, while inv
oking ApplicationClientProtocolPBClientImpl.getApplicationReport over null. Retrying after sleeping for 15000ms.
18/08/21 17:46:14 INFO mapreduce.ImportJobBase: A jobtracker restart is required for these settings
18/08/21 17:46:14 INFO mapreduce.ImportJobBase: to take effect.
18/08/21 17:46:14 ERROR tool.ImportTool: Error during import: Import job failed!
sqoop import --connect jdbc:mysql://ip-172-31-20-247/retail_db --username sqoopuser --password NHkkP876rp --table customers --warehouse-dir /home/kappuchappu1770 -m 1