Apache Kafka Issue

Technical Discussions Apache Kafka
#1

Hi Team,
I have been doing kafka hands on. Was able to successfully get single messages across successfully as instructed in the lessons. When I use linux yes command to send lots of message both consumer and producer hangs and it return back saying insufficient memory…Steps that I have followed:

  1. Included kafka binaries
    export PATH=$PATH:/usr/hdp/current/kafka-broker/bin

  2. Created the topic - alokdeosingh1995
    kafka-topics.sh --create --zookeeper ip-172-31-20-247.ec2.internal:2181 --replication-factor 1 --partitions 1 --topic alokdeosingh1995

  3. Checked if topic was created
    kafka-topics.sh --list --zookeeper ip-172-31-20-247.ec2.internal:2181 | grep alokdeosingh1995

  4. Finding the ip address of any broker
    ip-172-31-20-247.ec2.internal:6667

  5. Starting the producer and attaching it to broker
    kafka-console-producer.sh --broker-list ip-172-31-20-247.ec2.internal:6667 --topic alokdeosingh1995

  6. Starting the consumer
    kafka-console-consumer.sh --zookeeper ip-172-31-20-247.ec2.internal:2181 --topic alokdeosingh1995 --from-beginning

This is what happens:

image
image1920×1030 45.3 KB

#2

Shall I take other broker. There are only 2 in the list [1003,1002].

#3

Hi @alokdeosingh1995,

I think chrome is complaining that your system does not have enough memory to open the tab. Please close other tabs as suggested by chrome.

Thanks

#4

Thanks! Let me try this today.