What is the need of zookeeper in kafka? Can I use kafka without zookeeper?

+1 vote

Hi,

In kafka configuration we have to first configure zookeeper. Is their anyway, so that we can use kafka without zookeeper?

Thank You

Feb 6 in Apache Kafka by akhtar
• 33,920 points
3,404 views

2 answers to this question.

0 votes

Hi@akhtar,

You can not use kafka without zookeeper. The reasons behind this is given below.

Mainly zookeeper is used to manage all the brokers.  These brokers are responsible for maintaining the leader/follower relationship for all the partitions in kafka cluster. Whenever problem occurs and nodes shut down, it is the controller from the broker that tells other replicas to become partition leaders to replace the partition leaders on the node that is going away. So zookeeper is  used to elect one controller from the brokers.

Zookeeper also manages the status of the brokers, which broker is alive or dead.

Zookeeper also manages all the topics configuration, which topic contains which partitions etc.

Hope this will clear your doubt.

Thank You

answered Feb 6 by MD
• 80,590 points
0 votes

At present, There is no any alternative for zookeeper in Kafka. Kafka uses ZooKeeper to manage the cluster. ZooKeeper is used to coordinate the brokers/cluster topology. ZooKeeper is a consistent file system for configuration information. ZooKeeper gets used for leadership election for Broker Topic Partition Leaders. 

Finally, I want to say ConfuentInc planning to launch new version Kafka without zookeeper. So hopefully next version will give relax to start many things. 

answered Jun 17 by Pawan
• 380 points

Related Questions In Apache Kafka

0 votes
1 answer

What is the optimum number of producers to create in Kafka?

In general, a single producer for all ...READ MORE

answered Jul 10, 2018 in Apache Kafka by nitinrawat895
• 10,950 points
3,936 views
0 votes
1 answer

What is the meaning of retries in Kafka Producer API?

Hi@akhtar, It defines how many time the producer ...READ MORE

answered Feb 11 in Apache Kafka by MD
• 80,590 points
1,194 views
+1 vote
1 answer

What is the importance of Kafka bootstrap.servers?

Hi@akhtar, Bootstrap.servers is a mandatory field in Kafka ...READ MORE

answered Feb 11 in Apache Kafka by MD
• 80,590 points
5,360 views
+1 vote
13 answers

How can I delete all the messages from a Kafka topic?

To delete all the messages from a Kafka topic.  There are many approach ...READ MORE

answered Jun 19 in Apache Kafka by Pawan
• 380 points
129,167 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,950 points
6,397 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,950 points
991 views
+1 vote
11 answers

hadoop fs -put command?

put syntax: put <localSrc> <dest> copy syntax: copyF ...READ MORE

answered Dec 7, 2018 in Big Data Hadoop by Aditya
42,256 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,320 points
2,390 views
0 votes
1 answer

What is the need of serializer in Kafka Producer API?

Hi@akhtar, If we try to use String key ...READ MORE

answered Feb 11 in Apache Kafka by MD
• 80,590 points
177 views
0 votes
1 answer

What is the use of acts configuration in Kafka Producer API?

Hi@akhtar, The acts configuration is used to configure ...READ MORE

answered Feb 11 in Apache Kafka by MD
• 80,590 points
183 views