Latest questions in Apache Kafka

0 votes
0 answers

Commit cannot be completed since the group has already rebalanced and assigned the partitions to another member.

Hello We designed a notification application which ...READ MORE

Feb 10, 2023 in Apache Kafka by noushin

edited Mar 4 287 views
0 votes
0 answers

Consumer is not consuming messages, but service is running, please help me on this

Consumer is suddenly stopped consuming messages but ...READ MORE

Jul 6, 2022 in Apache Kafka by KsP

edited Mar 4 227 views
0 votes
0 answers

testing prod

testing prod READ MORE

Jan 21, 2022 in Apache Kafka by anonymous
• 140 points

edited Mar 4 255 views
0 votes
0 answers

Do we have Playbook to confirm preferred leader doesn't mismatch in Kafka after server is rebooted?

I'm working on creating playbook for kafka ...READ MORE

Sep 20, 2021 in Apache Kafka by Sachin

edited Mar 4 270 views
0 votes
0 answers

saving data from kafkaa consumer into hdfs using pydoop

i have used stock data and send ...READ MORE

Aug 9, 2021 in Apache Kafka by Rikesh

edited Mar 4 239 views
0 votes
0 answers
0 votes
0 answers

Consumer not able to elect group coordinator

I have created two brokers having id ...READ MORE

Apr 3, 2021 in Apache Kafka by Edureka

edited Mar 4 154 views
0 votes
0 answers

zookeeper service is not started properly

Getting below warning in zookeeper log 2021-02-19 14:20:27,911 ...READ MORE

Feb 19, 2021 in Apache Kafka by anonymous
• 120 points
1,920 views
0 votes
0 answers

Kafka to HDFS using kafka-conncet

Hi, Can you please share steps to write ...READ MORE

Jan 7, 2021 in Apache Kafka by Narayana

edited Mar 4 153 views
0 votes
1 answer

How to change the data directory in Zookeeper?

Hi@akhtar, You can change the default directory in ...READ MORE

Dec 8, 2020 in Apache Kafka by MD
• 95,460 points
3,529 views
0 votes
1 answer

How to stop zookeeper service?

Hi@akhtar, You can find one script in the ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
• 95,460 points
2,253 views
0 votes
1 answer

How to configure zookeeper for Kafka?

Hi@akhtar, It is a must to set up ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
• 95,460 points
1,412 views
0 votes
1 answer

How to list all Kafka topics?

Hi@akhtar, Kafka uses ZooKeeper, so you need to ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
• 95,460 points
12,412 views
0 votes
1 answer

What is a broker in Kafka Cluster?

Hi@akhtar, A Kafka broker receives messages from producers and stores ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
• 95,460 points
1,923 views
0 votes
1 answer

What is a producer in Kafka Cluster?

Hi@akhtar, The Kafka producer is conceptually much simpler than the ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
• 95,460 points
1,049 views
0 votes
1 answer

How to start a consumer in Kafka cluster?

Hi@akhtar, In Kafka, each topic is divided into a ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
• 95,460 points
1,056 views
0 votes
1 answer

How to create a Kafka producer?

Hi@MD, Generally, Kafka producer comes from an API. ...READ MORE

Dec 7, 2020 in Apache Kafka by akhtar
• 38,260 points
1,085 views
0 votes
1 answer

How to create a Kafka topic in a broker?

Hi@akhtar, To create a Kafka topic, you need ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
• 95,460 points
1,962 views
0 votes
1 answer

How to start Kafka server?

Hi@akhtar, You need the start your zookeeper service ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
• 95,460 points
1,443 views
0 votes
1 answer

How to start Zookeeper service?

Hi@akhtar, Before you start the Zookeeper service, you need ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
• 95,460 points
2,939 views
0 votes
1 answer

ERROR tool.BaseSqoopTool: Error parsing arguments for import:ERROR tool.BaseSqoopTool: Unrecognized argument: -topic

Hi@oguzhan, I have checked the Sqoop document, but ...READ MORE

Sep 7, 2020 in Apache Kafka by MD
• 95,460 points
1,436 views
0 votes
1 answer

How to consume the consumed message from the kafka topic based on offset ? please provide example in confluent_kafka python

Hi@Amit, You can pass --offset keyword in your ...READ MORE

Aug 10, 2020 in Apache Kafka by MD
• 95,460 points
4,398 views
0 votes
1 answer

Kafka SASL/SCRAM

Hi@progDuck, By default it is connecting to localhost:2181, ...READ MORE

Jun 5, 2020 in Apache Kafka by MD
• 95,460 points
2,394 views
0 votes
0 answers

Kafka SASL/SCRAM

Already that day in a row I ...READ MORE

Jun 4, 2020 in Apache Kafka by progDuck
• 140 points
2,466 views
0 votes
2 answers

Kafka Consumer is not throwing errors even though if i provide wrong broker details in Java Standalone

Please delete all log files. Reason behind, ...READ MORE

Jun 18, 2020 in Apache Kafka by PAWAN
• 380 points
1,088 views
+1 vote
0 answers

how to delete the topic in kafka

How to stop Kafka server from crashing ...READ MORE

May 13, 2020 in Apache Kafka by sreeveena
• 150 points
1,815 views
0 votes
1 answer

how can we delete the topic in kafka in kafkatool application ?

Hi@sreeveena, I am not sure but there may be ...READ MORE

May 13, 2020 in Apache Kafka by MD
• 95,460 points
2,092 views
0 votes
1 answer

How can I connect aws lambda and kafka ?

Hi@Rishabh, I think to implement this task you ...READ MORE

May 4, 2020 in Apache Kafka by MD
• 95,460 points
4,272 views
0 votes
1 answer

How can i connect to an api which gives me weather data to Apache kafka?

Hi, To connect an API in kafka, you ...READ MORE

Apr 13, 2020 in Apache Kafka by MD
• 95,460 points
1,633 views
0 votes
1 answer

Caused by: org.apache.kafka.connect.errors.DataException: Converting byte[] to Kafka Connect data failed due to serialization error:

Hi@akhtar, To fix the pipeline, you need to resolve ...READ MORE

Apr 3, 2020 in Apache Kafka by MD
• 95,460 points
5,963 views
0 votes
1 answer

How to read batch messages in confluent-kafka-python?

Hi@akhtar, You have to read the messages normally ...READ MORE

Apr 3, 2020 in Apache Kafka by MD
• 95,460 points
4,978 views
0 votes
1 answer

How to write output from Kafka to S3 using a Confluent S3 connector?

Hi@akhtar, To do this task you have to ...READ MORE

Apr 3, 2020 in Apache Kafka by MD
• 95,460 points
2,247 views
0 votes
1 answer

Error: pass --path /path/to/confluent flag or set environment variable CONFLUENT_HOME

Hi@akhtar, Before starting confluent kafka in your system, ...READ MORE

Apr 3, 2020 in Apache Kafka by MD
• 95,460 points
4,420 views
0 votes
2 answers

How to installed confluent kafka in our system?

Easy Approach is work with Docker. ConfluentInc ...READ MORE

Jun 18, 2020 in Apache Kafka by PAWAN
• 380 points
3,604 views
0 votes
1 answer

Error: kafka/Kafka : Unsupported major.minor version 52.0

Hi@akhtar, As the above error shows that the ...READ MORE

Mar 31, 2020 in Apache Kafka by MD
• 95,460 points
3,403 views
0 votes
1 answer

error during KafkaServerStartable startup. Prepare to shutdown (kafka.server.KafkaServerStartable)

Hi@akhtar, This error occurs because zookeeper is running already. So ...READ MORE

Mar 31, 2020 in Apache Kafka by MD
• 95,460 points
4,999 views
0 votes
1 answer

I tried to do configration for retation log in kafkA ,BUT kafka broker shuts Down.Is there any solution for that??

Hi@Parth, There are mainly two types of retention ...READ MORE

Feb 18, 2020 in Apache Kafka by MD
• 95,460 points
1,290 views
0 votes
1 answer

[Mac] Writing the Kafka consumer output to a CSV file

Hi@ I don't know it will work or ...READ MORE

Feb 18, 2020 in Apache Kafka by MD
• 95,460 points
4,478 views
0 votes
2 answers

Is there any Web UI for kafka?

Yes. There is one Tool Name Called ...READ MORE

Mar 14, 2020 in Apache Kafka by Sagar
5,169 views
0 votes
1 answer

How to create Kafka consumer API?

Hi@akhtar, If you know the kafka producer API ...READ MORE

Feb 11, 2020 in Apache Kafka by MD
• 95,460 points
1,867 views
0 votes
1 answer

How consumers enter/exit in groups?

Hi@akhtar, Whenever one new consumer comes or leaves ...READ MORE

Feb 11, 2020 in Apache Kafka by MD
• 95,460 points
1,211 views
0 votes
1 answer

How to implement parallel read in a single application?

Hi@akhtar, To read parallel we have to create ...READ MORE

Feb 11, 2020 in Apache Kafka by MD
• 95,460 points
2,080 views
0 votes
1 answer

What is the meaning of retries in Kafka Producer API?

Hi@akhtar, It defines how many time the producer ...READ MORE

Feb 11, 2020 in Apache Kafka by MD
• 95,460 points
4,765 views
0 votes
1 answer

What is the use of acts configuration in Kafka Producer API?

Hi@akhtar, The acts configuration is used to configure ...READ MORE

Feb 11, 2020 in Apache Kafka by MD
• 95,460 points
1,784 views
0 votes
1 answer

What is the need of serializer in Kafka Producer API?

Hi@akhtar, If we try to use String key ...READ MORE

Feb 11, 2020 in Apache Kafka by MD
• 95,460 points
1,651 views
+1 vote
1 answer

What is the importance of Kafka bootstrap.servers?

Hi@akhtar, Bootstrap.servers is a mandatory field in Kafka ...READ MORE

Feb 11, 2020 in Apache Kafka by MD
• 95,460 points
18,425 views
0 votes
1 answer

How to create kafka producer API?

Hi@akhtar, To create kafka producer API, you can ...READ MORE

Feb 11, 2020 in Apache Kafka by MD
• 95,460 points
1,214 views
0 votes
1 answer

Missing required argument "[zookeeper]"

Hi@akhtar, I guess you are using the old ...READ MORE

Feb 10, 2020 in Apache Kafka by MD
• 95,460 points
3,715 views
0 votes
1 answer

How to know leader information in kafka?

Hi@akhtar, To know leader information you can use ...READ MORE

Feb 10, 2020 in Apache Kafka by MD
• 95,460 points
17,786 views