Kafka usage onto existing provided lab

Saurabh_Sharma · December 11, 2020, 10:35am

Hi,
Please let me know how to use kafka in provided lab server.

sgiri · December 11, 2020, 10:46am

cloudxlab/bigdata/blob/master/spark/examples/streaming/word_count_kafka/word_count_kafka_spark_streaming.md

# Terminal 1 - Create topic in Kafka
<pre>
#Include Kafka binaries in the path. HDP includes the kafka and installs at /usr/hdp/current/kafka-broker
  
  export PATH=$PATH:/usr/hdp/current/kafka-broker/bin
   
#Create the topic
#Replace localhost with the hostname of node where zookeeper server is running. Generally, zk runs on all hosts on the cluster.
#Replace test with your topic name
  
  kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic sandeepgiri9034_test

#Check if topic is created
  
  kafka-topics.sh  --list --zookeeper localhost:2181
</pre>

# Terminal 1 - Produce the results
<pre>
  # Locate the kafka brokers

This file has been truncated. show original