Most viewed questions in Apache Kafka

+1 vote
14 answers

How can I delete all the messages from a Kafka topic?

To delete all the messages from a Kafka topic.  There are many approach ...READ MORE

Jun 19, 2020 in Apache Kafka by PAWAN
 • 380 points • 233,818 views
+1 vote
2 answers

How to check Kafka version?

Hi@akhtar, Actually, in kafka there is no command ...READ MORE

Feb 10, 2020 in Apache Kafka by MD
 • 95,460 points • 49,191 views
+2 votes
8 answers

Writing the Kafka consumer output to a file

System.out.println(String.valueOf(output.offset()) + ": " + new String(bytes, ...READ MORE

Dec 7, 2018 in Apache Kafka by Harsh
 • 40,152 views
0 votes
2 answers

Not able to start Kafka service

If your service, in this case kafka, ...READ MORE

May 10, 2019 in Apache Kafka by Novice
 • 20,000 views
+1 vote
1 answer

What is the importance of Kafka bootstrap.servers?

Hi@akhtar, Bootstrap.servers is a mandatory field in Kafka ...READ MORE

Feb 11, 2020 in Apache Kafka by MD
 • 95,460 points • 18,344 views
0 votes
1 answer

How to know leader information in kafka?

Hi@akhtar, To know leader information you can use ...READ MORE

Feb 10, 2020 in Apache Kafka by MD
 • 95,460 points • 17,628 views
+1 vote
1 answer

Fatal error during KafkaServer startup. Prepare to shutdown org.I0Itec.zkclient.exception.ZkTimeoutException: Unable to connect to zookeeper server within timeout: 6000

HI@akhtar, You get this error because before stating ...READ MORE

Feb 5, 2020 in Apache Kafka by MD
 • 95,460 points • 15,058 views
+3 votes
1 answer

How to install Kafka on Windows System?

These are the steps to install Kafka ...READ MORE

Feb 25, 2019 in Apache Kafka by Ramya
 • 14,897 views
0 votes
1 answer

How to reset the offset of messages consumed from Kafka?

The reset option only prints the result ...READ MORE

Jul 10, 2018 in Apache Kafka by Shubham
 • 13,490 points • 14,470 views
+1 vote
1 answer

ERROR Unexpected exception, exiting abnormally (org.apache.zookeeper.server.ZooKeeperServerMain) java.net.BindException: Address already in use

Hi@akhtar, Here the zookeeper service is already started ...READ MORE

Feb 5, 2020 in Apache Kafka by MD
 • 95,460 points • 12,981 views
0 votes
1 answer

How to list all Kafka topics?

Hi@akhtar, Kafka uses ZooKeeper, so you need to ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
 • 95,460 points • 12,352 views
0 votes
1 answer

How to check pending messages in KAFKA topic?

kafka-run-class.bat kafka.tools.ConsumerOffsetChecker --broker-info --group test-consumer-group --topic test ...READ MORE

May 29, 2020 in Apache Kafka by chandra
 • 11,677 views
+1 vote
1 answer

Kafka consumer not able to start reading messages from the last uncommitted offsets

Hi@prasant, I am not sure it will work ...READ MORE

Feb 18, 2020 in Apache Kafka by MD
 • 95,460 points • 9,998 views
+1 vote
3 answers

What is the need of zookeeper in kafka? Can I use kafka without zookeeper?

I just would like to complete the ...READ MORE

Dec 4, 2020 in Apache Kafka by Tamás
 • 140 points • 9,420 views
0 votes
1 answer

What is the optimum number of producers to create in Kafka?

In general, a single producer for all ...READ MORE

Jul 10, 2018 in Apache Kafka by nitinrawat895
 • 11,380 points • 9,001 views
0 votes
1 answer

org.apache.kafka.common.config.ConfigException: Missing required configuration "bootstrap.servers" which has no default value.

Hi@akhtar, In your file bootstrap.servers field in missing. ...READ MORE

Feb 10, 2020 in Apache Kafka by MD
 • 95,460 points • 7,867 views
0 votes
2 answers

Kafka service not starting. Shows no output

sudo systemctl status kafka This should at least ...READ MORE

May 9, 2019 in Apache Kafka by Novice
 • 7,307 views
0 votes
1 answer

How to install sbt in Redhat/CentOs??

Hi@akhtar, To install sbt in your RedHat system ...READ MORE

Feb 10, 2020 in Apache Kafka by MD
 • 95,460 points • 5,919 views
0 votes
1 answer

Caused by: org.apache.kafka.connect.errors.DataException: Converting byte[] to Kafka Connect data failed due to serialization error:

Hi@akhtar, To fix the pipeline, you need to resolve ...READ MORE

Apr 3, 2020 in Apache Kafka by MD
 • 95,460 points • 5,877 views
+2 votes
2 answers

Getting error in schema-registry start command

It is working for me with below ...READ MORE

Sep 30, 2019 in Apache Kafka by Brajkishore
 • 220 points • 5,556 views
0 votes
2 answers

Is there any Web UI for kafka?

Yes. There is one Tool Name Called ...READ MORE

Mar 14, 2020 in Apache Kafka by Sagar
 • 5,081 views
0 votes
1 answer

How to read batch messages in confluent-kafka-python?

Hi@akhtar, You have to read the messages normally ...READ MORE

Apr 3, 2020 in Apache Kafka by MD
 • 95,460 points • 4,926 views
0 votes
1 answer

error during KafkaServerStartable startup. Prepare to shutdown (kafka.server.KafkaServerStartable)

Hi@akhtar, This error occurs because zookeeper is running already. So ...READ MORE

Mar 31, 2020 in Apache Kafka by MD
 • 95,460 points • 4,916 views
0 votes
1 answer

What is the meaning of retries in Kafka Producer API?

Hi@akhtar, It defines how many time the producer ...READ MORE

Feb 11, 2020 in Apache Kafka by MD
 • 95,460 points • 4,698 views
0 votes
1 answer

[Mac] Writing the Kafka consumer output to a CSV file

Hi@ I don't know it will work or ...READ MORE

Feb 18, 2020 in Apache Kafka by MD
 • 95,460 points • 4,417 views
0 votes
1 answer

How to consume the consumed message from the kafka topic based on offset ? please provide example in confluent_kafka python

Hi@Amit, You can pass --offset keyword in your ...READ MORE

Aug 10, 2020 in Apache Kafka by MD
 • 95,460 points • 4,327 views
0 votes
1 answer

Error: pass --path /path/to/confluent flag or set environment variable CONFLUENT_HOME

Hi@akhtar, Before starting confluent kafka in your system, ...READ MORE

Apr 3, 2020 in Apache Kafka by MD
 • 95,460 points • 4,301 views
+1 vote
1 answer

Getting Fatal error during KafkaServerStartable startup. Prepare to shutdown (kafka.server.KafkaServerStartable) java.lang.NumberFormatException: For input string: "delete"

Hi@B, There may be a problem with your ...READ MORE

Nov 6, 2020 in Apache Kafka by MD
 • 95,460 points • 4,218 views
0 votes
1 answer

How can I connect aws lambda and kafka ?

Hi@Rishabh, I think to implement this task you ...READ MORE

May 4, 2020 in Apache Kafka by MD
 • 95,460 points • 4,201 views
0 votes
2 answers

How can I create multiple consumers in apache kafka?

First of all, Consumer is not thread ...READ MORE

Jun 18, 2020 in Apache Kafka by PAWAN
 • 380 points • 4,017 views
0 votes
1 answer

How to commit message offsets in Kafka for reliable data pipeline?

You can use auto.commit.enable to allow Kafka ...READ MORE

Jul 10, 2018 in Apache Kafka by Shubham
 • 13,490 points • 3,920 views
0 votes
1 answer

Missing required argument "[zookeeper]"

Hi@akhtar, I guess you are using the old ...READ MORE

Feb 10, 2020 in Apache Kafka by MD
 • 95,460 points • 3,661 views
0 votes
2 answers

How to installed confluent kafka in our system?

Easy Approach is work with Docker. ConfluentInc ...READ MORE

Jun 18, 2020 in Apache Kafka by PAWAN
 • 380 points • 3,517 views
0 votes
1 answer

How to change the data directory in Zookeeper?

Hi@akhtar, You can change the default directory in ...READ MORE

Dec 8, 2020 in Apache Kafka by MD
 • 95,460 points • 3,469 views
0 votes
1 answer

Not able to fetch messages from Kafka cluster

You need to add the hostname in ...READ MORE

Jul 10, 2018 in Apache Kafka by Shubham
 • 13,490 points • 3,449 views
0 votes
1 answer

Kafka topic not being deleted

By default in Kafka version 0.10, delete.topic.enable ...READ MORE

Jul 9, 2018 in Apache Kafka by nitinrawat895
 • 11,380 points • 3,394 views
0 votes
1 answer

Error: kafka/Kafka : Unsupported major.minor version 52.0

Hi@akhtar, As the above error shows that the ...READ MORE

Mar 31, 2020 in Apache Kafka by MD
 • 95,460 points • 3,325 views
0 votes
1 answer

Re-balancing error while reading messages from Kafka.

rebalance.backoff.ms defines the time for which Kafka ...READ MORE

Jul 10, 2018 in Apache Kafka by Shubham
 • 13,490 points • 3,236 views
0 votes
1 answer

How to write Kafka connector to integrate with Facebook API?

If you know the limit of API ...READ MORE

Apr 29, 2019 in Apache Kafka by Kumar
 • 3,153 views
0 votes
1 answer

How to purge Kafka Topic?

For your case what you can do ...READ MORE

Sep 4, 2018 in Apache Kafka by nitinrawat895
 • 11,380 points • 3,010 views
0 votes
1 answer

Not able to download Kafka using curl

The output to download this is in ...READ MORE

Feb 21, 2019 in Apache Kafka by Omkar
 • 69,180 points • 2,909 views
0 votes
1 answer

How to start Zookeeper service?

Hi@akhtar, Before you start the Zookeeper service, you need ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
 • 95,460 points • 2,877 views
0 votes
1 answer

Is there any change in consumer offsets if a new partition(s) is added to a Kafka topic?

Yes, it stays the same. An offset is ...READ MORE

Jul 9, 2018 in Apache Kafka by nitinrawat895
 • 11,380 points • 2,853 views
0 votes
1 answer

Installing Kafka on Ubuntu

I am not sure what you expect ...READ MORE

Feb 21, 2019 in Apache Kafka by Arun
 • 2,557 views
0 votes
0 answers

Kafka SASL/SCRAM

Already that day in a row I ...READ MORE

Jun 4, 2020 in Apache Kafka by progDuck
 • 140 points • 2,423 views
0 votes
1 answer

Kafka Elements

The most important elements of Kafka: Topic – ...READ MORE

Sep 19, 2018 in Apache Kafka by kurt_cobain
 • 9,350 points • 2,401 views
0 votes
1 answer

Kafka SASL/SCRAM

Hi@progDuck, By default it is connecting to localhost:2181, ...READ MORE

Jun 5, 2020 in Apache Kafka by MD
 • 95,460 points • 2,327 views
0 votes
1 answer

How to delete a topic in Kafka 0.8.1.1?

Deleting topic isn't always working in 0.8.1.1 Deletion ...READ MORE

Sep 4, 2018 in Apache Kafka by nitinrawat895
 • 11,380 points • 2,202 views
0 votes
1 answer

How to write output from Kafka to S3 using a Confluent S3 connector?

Hi@akhtar, To do this task you have to ...READ MORE

Apr 3, 2020 in Apache Kafka by MD
 • 95,460 points • 2,189 views
0 votes
1 answer

How to stop zookeeper service?

Hi@akhtar, You can find one script in the ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
 • 95,460 points • 2,167 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.