Spark Submit Issues - Interacting with HBase

Lab Support
#1

Hi,

Can you please copy hbase-site.xml from /usr/hdp/current/hbase-client/conf/hbase-site.xml to /usr/hdp/current/spark2-client/conf/ folder as I’m having issues running Spark streaming jobs integrated with HBase.

This is in regards to my topic Structured Spark Streaming + HBase Integration

Kindly help.

Thanks,
Venkatesh Raman

1 Like
#2

I have done it. Could you check and let me know.

#3

Hi,

I’m unable to find the hbase-site.xml under “/usr/hdp/current/spark2-client/conf”.

The edge node is f.cloudxlab.com

Am I looking in the wrong location?

Thanks,
Venkatesh Raman

1 Like
#4

Thank you for letting me know. Let me look again. I think I did it on different edge node.

#5

Please check now. I have done it on f.cloudxlab.com. If you have sample code, please post it here. So that we could also check it.

#6

Hi,

Thanks, I was able to get past that step without any issues. However, data is not inserted into hbase. The sample code and the spark-submit command is given in this section

#7

is it throwing some error?

#8

In the spark-console, I can see “Reading offset at partition” . But, the insert is not happening.

#9

Are you able to add data in hbase using hbase shell ?

Structured Spark Streaming + HBase Integration