Trending questions in Apache Kafka

+1 vote
14 answers

How can I delete all the messages from a Kafka topic?

To delete all the messages from a Kafka topic.  There are many approach ...READ MORE

Jun 19, 2020 in Apache Kafka by PAWAN
 • 380 points • 235,678 views
+1 vote
2 answers

How to check Kafka version?

Hi@akhtar, Actually, in kafka there is no command ...READ MORE

Feb 10, 2020 in Apache Kafka by MD
 • 95,460 points • 49,429 views
0 votes
0 answers

Commit cannot be completed since the group has already rebalanced and assigned the partitions to another member.

Hello We designed a notification application which ...READ MORE

Feb 10, 2023 in Apache Kafka by noushin
edited Mar 4 • 296 views
0 votes
0 answers

Consumer is not consuming messages, but service is running, please help me on this

Consumer is suddenly stopped consuming messages but ...READ MORE

Jul 6, 2022 in Apache Kafka by KsP
edited Mar 4 • 234 views
0 votes
0 answers

testing prod

testing prod READ MORE

Jan 21, 2022 in Apache Kafka by anonymous
 • 140 points
edited Mar 4 • 263 views
0 votes
0 answers

Do we have Playbook to confirm preferred leader doesn't mismatch in Kafka after server is rebooted?

I'm working on creating playbook for kafka ...READ MORE

Sep 20, 2021 in Apache Kafka by Sachin
edited Mar 4 • 276 views
0 votes
1 answer

How to list all Kafka topics?

Hi@akhtar, Kafka uses ZooKeeper, so you need to ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
 • 95,460 points • 12,430 views
0 votes
0 answers

saving data from kafkaa consumer into hdfs using pydoop

i have used stock data and send ...READ MORE

Aug 9, 2021 in Apache Kafka by Rikesh
edited Mar 4 • 245 views
0 votes
0 answers

trying to join two streams using inner join and storing the resultant data into a topic, but one of the column is missing in topic schema.

Source Streams: CREATE STREAM one ( ADC_ID ...READ MORE

May 1, 2021 in Apache Kafka by anonymous
edited Mar 4 • 230 views
+2 votes
8 answers

Writing the Kafka consumer output to a file

System.out.println(String.valueOf(output.offset()) + ": " + new String(bytes, ...READ MORE

Dec 7, 2018 in Apache Kafka by Harsh
 • 40,406 views
+1 vote
1 answer

What is the importance of Kafka bootstrap.servers?

Hi@akhtar, Bootstrap.servers is a mandatory field in Kafka ...READ MORE

Feb 11, 2020 in Apache Kafka by MD
 • 95,460 points • 18,437 views
0 votes
0 answers

Consumer not able to elect group coordinator

I have created two brokers having id ...READ MORE

Apr 3, 2021 in Apache Kafka by Edureka
edited Mar 4 • 157 views
0 votes
0 answers

zookeeper service is not started properly

Getting below warning in zookeeper log 2021-02-19 14:20:27,911 ...READ MORE

Feb 19, 2021 in Apache Kafka by anonymous
 • 120 points • 1,930 views
0 votes
1 answer

How to know leader information in kafka?

Hi@akhtar, To know leader information you can use ...READ MORE

Feb 10, 2020 in Apache Kafka by MD
 • 95,460 points • 17,812 views
0 votes
1 answer

How to change the data directory in Zookeeper?

Hi@akhtar, You can change the default directory in ...READ MORE

Dec 8, 2020 in Apache Kafka by MD
 • 95,460 points • 3,541 views
+1 vote
1 answer

Getting Fatal error during KafkaServerStartable startup. Prepare to shutdown (kafka.server.KafkaServerStartable) java.lang.NumberFormatException: For input string: "delete"

Hi@B, There may be a problem with your ...READ MORE

Nov 6, 2020 in Apache Kafka by MD
 • 95,460 points • 4,357 views
+1 vote
3 answers

What is the need of zookeeper in kafka? Can I use kafka without zookeeper?

I just would like to complete the ...READ MORE

Dec 4, 2020 in Apache Kafka by Tamás
 • 140 points • 9,559 views
0 votes
1 answer

How to start Zookeeper service?

Hi@akhtar, Before you start the Zookeeper service, you need ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
 • 95,460 points • 2,946 views
0 votes
1 answer

How to stop zookeeper service?

Hi@akhtar, You can find one script in the ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
 • 95,460 points • 2,272 views
0 votes
1 answer

How to create a Kafka topic in a broker?

Hi@akhtar, To create a Kafka topic, you need ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
 • 95,460 points • 1,973 views
+1 vote
1 answer

Fatal error during KafkaServer startup. Prepare to shutdown org.I0Itec.zkclient.exception.ZkTimeoutException: Unable to connect to zookeeper server within timeout: 6000

HI@akhtar, You get this error because before stating ...READ MORE

Feb 5, 2020 in Apache Kafka by MD
 • 95,460 points • 15,145 views
0 votes
1 answer

What is a broker in Kafka Cluster?

Hi@akhtar, A Kafka broker receives messages from producers and stores ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
 • 95,460 points • 1,934 views
0 votes
0 answers

Kafka to HDFS using kafka-conncet

Hi, Can you please share steps to write ...READ MORE

Jan 7, 2021 in Apache Kafka by Narayana
edited Mar 4 • 160 views
0 votes
1 answer

How to start Kafka server?

Hi@akhtar, You need the start your zookeeper service ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
 • 95,460 points • 1,451 views
0 votes
1 answer

How to configure zookeeper for Kafka?

Hi@akhtar, It is a must to set up ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
 • 95,460 points • 1,420 views
0 votes
1 answer

How to create a Kafka producer?

Hi@MD, Generally, Kafka producer comes from an API. ...READ MORE

Dec 7, 2020 in Apache Kafka by akhtar
 • 38,260 points • 1,089 views
0 votes
1 answer

How to start a consumer in Kafka cluster?

Hi@akhtar, In Kafka, each topic is divided into a ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
 • 95,460 points • 1,068 views
0 votes
1 answer

What is a producer in Kafka Cluster?

Hi@akhtar, The Kafka producer is conceptually much simpler than the ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
 • 95,460 points • 1,062 views
+1 vote
1 answer

ERROR Unexpected exception, exiting abnormally (org.apache.zookeeper.server.ZooKeeperServerMain) java.net.BindException: Address already in use

Hi@akhtar, Here the zookeeper service is already started ...READ MORE

Feb 5, 2020 in Apache Kafka by MD
 • 95,460 points • 13,071 views
0 votes
1 answer

How to consume the consumed message from the kafka topic based on offset ? please provide example in confluent_kafka python

Hi@Amit, You can pass --offset keyword in your ...READ MORE

Aug 10, 2020 in Apache Kafka by MD
 • 95,460 points • 4,410 views
0 votes
1 answer

ERROR tool.BaseSqoopTool: Error parsing arguments for import:ERROR tool.BaseSqoopTool: Unrecognized argument: -topic

Hi@oguzhan, I have checked the Sqoop document, but ...READ MORE

Sep 7, 2020 in Apache Kafka by MD
 • 95,460 points • 1,444 views
+1 vote
1 answer

Kafka consumer not able to start reading messages from the last uncommitted offsets

Hi@prasant, I am not sure it will work ...READ MORE

Feb 18, 2020 in Apache Kafka by MD
 • 95,460 points • 10,088 views
0 votes
2 answers

Is there any Web UI for kafka?

Yes. There is one Tool Name Called ...READ MORE

Mar 14, 2020 in Apache Kafka by Sagar
 • 5,179 views
0 votes
1 answer

Caused by: org.apache.kafka.connect.errors.DataException: Converting byte[] to Kafka Connect data failed due to serialization error:

Hi@akhtar, To fix the pipeline, you need to resolve ...READ MORE

Apr 3, 2020 in Apache Kafka by MD
 • 95,460 points • 5,972 views
0 votes
1 answer

How to check pending messages in KAFKA topic?

kafka-run-class.bat kafka.tools.ConsumerOffsetChecker --broker-info --group test-consumer-group --topic test ...READ MORE

May 29, 2020 in Apache Kafka by chandra
 • 11,782 views
0 votes
1 answer

org.apache.kafka.common.config.ConfigException: Missing required configuration "bootstrap.servers" which has no default value.

Hi@akhtar, In your file bootstrap.servers field in missing. ...READ MORE

Feb 10, 2020 in Apache Kafka by MD
 • 95,460 points • 7,975 views
0 votes
1 answer

How can I connect aws lambda and kafka ?

Hi@Rishabh, I think to implement this task you ...READ MORE

May 4, 2020 in Apache Kafka by MD
 • 95,460 points • 4,281 views
0 votes
2 answers

How to installed confluent kafka in our system?

Easy Approach is work with Docker. ConfluentInc ...READ MORE

Jun 18, 2020 in Apache Kafka by PAWAN
 • 380 points • 3,616 views
0 votes
0 answers

Kafka SASL/SCRAM

Already that day in a row I ...READ MORE

Jun 4, 2020 in Apache Kafka by progDuck
 • 140 points • 2,476 views
0 votes
1 answer

Kafka SASL/SCRAM

Hi@progDuck, By default it is connecting to localhost:2181, ...READ MORE

Jun 5, 2020 in Apache Kafka by MD
 • 95,460 points • 2,411 views
0 votes
1 answer

How to read batch messages in confluent-kafka-python?

Hi@akhtar, You have to read the messages normally ...READ MORE

Apr 3, 2020 in Apache Kafka by MD
 • 95,460 points • 4,990 views
0 votes
1 answer

error during KafkaServerStartable startup. Prepare to shutdown (kafka.server.KafkaServerStartable)

Hi@akhtar, This error occurs because zookeeper is running already. So ...READ MORE

Mar 31, 2020 in Apache Kafka by MD
 • 95,460 points • 5,013 views
0 votes
2 answers

How can I create multiple consumers in apache kafka?

First of all, Consumer is not thread ...READ MORE

Jun 18, 2020 in Apache Kafka by PAWAN
 • 380 points • 4,114 views
0 votes
1 answer

Error: pass --path /path/to/confluent flag or set environment variable CONFLUENT_HOME

Hi@akhtar, Before starting confluent kafka in your system, ...READ MORE

Apr 3, 2020 in Apache Kafka by MD
 • 95,460 points • 4,431 views
0 votes
2 answers

Not able to start Kafka service

If your service, in this case kafka, ...READ MORE

May 10, 2019 in Apache Kafka by Novice
 • 20,155 views
0 votes
1 answer

how can we delete the topic in kafka in kafkatool application ?

Hi@sreeveena, I am not sure but there may be ...READ MORE

May 13, 2020 in Apache Kafka by MD
 • 95,460 points • 2,097 views
0 votes
2 answers

Kafka Consumer is not throwing errors even though if i provide wrong broker details in Java Standalone

Please delete all log files. Reason behind, ...READ MORE

Jun 18, 2020 in Apache Kafka by PAWAN
 • 380 points • 1,108 views
0 votes
1 answer

How to install sbt in Redhat/CentOs??

Hi@akhtar, To install sbt in your RedHat system ...READ MORE

Feb 10, 2020 in Apache Kafka by MD
 • 95,460 points • 6,029 views
+1 vote
0 answers

how to delete the topic in kafka

How to stop Kafka server from crashing ...READ MORE

May 13, 2020 in Apache Kafka by sreeveena
 • 150 points • 1,821 views
0 votes
1 answer

Error: kafka/Kafka : Unsupported major.minor version 52.0

Hi@akhtar, As the above error shows that the ...READ MORE

Mar 31, 2020 in Apache Kafka by MD
 • 95,460 points • 3,410 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.