What is the need of zookeeper in kafka Can I use kafka without zookeeper

+1 vote

Hi,

In kafka configuration we have to first configure zookeeper. Is their anyway, so that we can use kafka without zookeeper?

Thank You

Feb 6, 2020 in Apache Kafka by akhtar
• 38,260 points
8,782 views

3 answers to this question.

0 votes

Hi@akhtar,

You can not use kafka without zookeeper. The reasons behind this is given below.

Mainly zookeeper is used to manage all the brokers.  These brokers are responsible for maintaining the leader/follower relationship for all the partitions in kafka cluster. Whenever problem occurs and nodes shut down, it is the controller from the broker that tells other replicas to become partition leaders to replace the partition leaders on the node that is going away. So zookeeper is  used to elect one controller from the brokers.

Zookeeper also manages the status of the brokers, which broker is alive or dead.

Zookeeper also manages all the topics configuration, which topic contains which partitions etc.

Hope this will clear your doubt.

To know more about Kafka, I would recommend you to enroll with Kafka training online today.

Thanks.

answered Feb 6, 2020 by MD
• 95,460 points
0 votes

At present, There is no any alternative for zookeeper in Kafka. Kafka uses ZooKeeper to manage the cluster. ZooKeeper is used to coordinate the brokers/cluster topology. ZooKeeper is a consistent file system for configuration information. ZooKeeper gets used for leadership election for Broker Topic Partition Leaders. 

Finally, I want to say ConfuentInc planning to launch new version Kafka without zookeeper. So hopefully next version will give relax to start many things. 

answered Jun 18, 2020 by PAWAN
• 380 points
0 votes

I just would like to complete the answers. I have read the documentation of Kafka and in the QuickStart section (see: http://kafka.apache.org/documentation/#quickstart) and this is written:

# Start the ZooKeeper service
# Note: Soon, ZooKeeper will no longer be required by Apache Kafka.
$ bin/zookeeper-server-start.sh config/zookeeper.properties 

(Currently latest version is: kafka_2.13-2.6.0)

answered Dec 4, 2020 by Tamás
• 140 points

Related Questions In Apache Kafka

0 votes
1 answer

What is the optimum number of producers to create in Kafka?

In general, a single producer for all ...READ MORE

answered Jul 10, 2018 in Apache Kafka by nitinrawat895
• 11,380 points
8,468 views
0 votes
1 answer

What is the meaning of retries in Kafka Producer API?

Hi@akhtar, It defines how many time the producer ...READ MORE

answered Feb 11, 2020 in Apache Kafka by MD
• 95,460 points
4,418 views
+1 vote
1 answer

What is the importance of Kafka bootstrap.servers?

Hi@akhtar, Bootstrap.servers is a mandatory field in Kafka ...READ MORE

answered Feb 11, 2020 in Apache Kafka by MD
• 95,460 points
17,726 views
+1 vote
14 answers

How can I delete all the messages from a Kafka topic?

To delete all the messages from a Kafka topic.  There are many approach ...READ MORE

answered Jun 19, 2020 in Apache Kafka by PAWAN
• 380 points
229,528 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
11,054 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
2,558 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
108,967 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
4,624 views
0 votes
1 answer

What is the need of serializer in Kafka Producer API?

Hi@akhtar, If we try to use String key ...READ MORE

answered Feb 11, 2020 in Apache Kafka by MD
• 95,460 points
1,259 views
0 votes
1 answer

What is the use of acts configuration in Kafka Producer API?

Hi@akhtar, The acts configuration is used to configure ...READ MORE

answered Feb 11, 2020 in Apache Kafka by MD
• 95,460 points
1,478 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP