Latest questions in Apache Kafka

0 votes
0 answers

Commit cannot be completed since the group has already rebalanced and assigned the partitions to another member.

Hello We designed a notification application which ...READ MORE

Feb 10, 2023 in Apache Kafka by noushin

edited Mar 4 253 views
0 votes
0 answers

Consumer is not consuming messages, but service is running, please help me on this

Consumer is suddenly stopped consuming messages but ...READ MORE

Jul 6, 2022 in Apache Kafka by KsP

edited Mar 4 199 views
0 votes
0 answers

testing prod

testing prod READ MORE

Jan 21, 2022 in Apache Kafka by anonymous
• 140 points

edited Mar 4 224 views
0 votes
0 answers

Do we have Playbook to confirm preferred leader doesn't mismatch in Kafka after server is rebooted?

I'm working on creating playbook for kafka ...READ MORE

Sep 20, 2021 in Apache Kafka by Sachin

edited Mar 4 238 views
0 votes
0 answers

saving data from kafkaa consumer into hdfs using pydoop

i have used stock data and send ...READ MORE

Aug 9, 2021 in Apache Kafka by Rikesh

edited Mar 4 209 views
0 votes
0 answers
0 votes
0 answers

Consumer not able to elect group coordinator

I have created two brokers having id ...READ MORE

Apr 3, 2021 in Apache Kafka by Edureka

edited Mar 4 123 views
0 votes
0 answers

zookeeper service is not started properly

Getting below warning in zookeeper log 2021-02-19 14:20:27,911 ...READ MORE

Feb 19, 2021 in Apache Kafka by anonymous
• 120 points
1,886 views
0 votes
0 answers

Kafka to HDFS using kafka-conncet

Hi, Can you please share steps to write ...READ MORE

Jan 7, 2021 in Apache Kafka by Narayana

edited Mar 4 122 views
0 votes
1 answer

How to change the data directory in Zookeeper?

Hi@akhtar, You can change the default directory in ...READ MORE

Dec 8, 2020 in Apache Kafka by MD
• 95,460 points
3,470 views
0 votes
1 answer

How to stop zookeeper service?

Hi@akhtar, You can find one script in the ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
• 95,460 points
2,168 views
0 votes
1 answer

How to configure zookeeper for Kafka?

Hi@akhtar, It is a must to set up ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
• 95,460 points
1,348 views
0 votes
1 answer

How to list all Kafka topics?

Hi@akhtar, Kafka uses ZooKeeper, so you need to ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
• 95,460 points
12,353 views
0 votes
1 answer

What is a broker in Kafka Cluster?

Hi@akhtar, A Kafka broker receives messages from producers and stores ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
• 95,460 points
1,871 views
0 votes
1 answer

What is a producer in Kafka Cluster?

Hi@akhtar, The Kafka producer is conceptually much simpler than the ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
• 95,460 points
988 views
0 votes
1 answer

How to start a consumer in Kafka cluster?

Hi@akhtar, In Kafka, each topic is divided into a ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
• 95,460 points
1,000 views
0 votes
1 answer

How to create a Kafka producer?

Hi@MD, Generally, Kafka producer comes from an API. ...READ MORE

Dec 7, 2020 in Apache Kafka by akhtar
• 38,260 points
1,040 views
0 votes
1 answer

How to create a Kafka topic in a broker?

Hi@akhtar, To create a Kafka topic, you need ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
• 95,460 points
1,889 views
0 votes
1 answer

How to start Kafka server?

Hi@akhtar, You need the start your zookeeper service ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
• 95,460 points
1,380 views
0 votes
1 answer

How to start Zookeeper service?

Hi@akhtar, Before you start the Zookeeper service, you need ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
• 95,460 points
2,877 views
0 votes
1 answer

ERROR tool.BaseSqoopTool: Error parsing arguments for import:ERROR tool.BaseSqoopTool: Unrecognized argument: -topic

Hi@oguzhan, I have checked the Sqoop document, but ...READ MORE

Sep 7, 2020 in Apache Kafka by MD
• 95,460 points
1,387 views
0 votes
1 answer

How to consume the consumed message from the kafka topic based on offset ? please provide example in confluent_kafka python

Hi@Amit, You can pass --offset keyword in your ...READ MORE

Aug 10, 2020 in Apache Kafka by MD
• 95,460 points
4,328 views
0 votes
1 answer

Kafka SASL/SCRAM

Hi@progDuck, By default it is connecting to localhost:2181, ...READ MORE

Jun 5, 2020 in Apache Kafka by MD
• 95,460 points
2,327 views
0 votes
0 answers

Kafka SASL/SCRAM

Already that day in a row I ...READ MORE

Jun 4, 2020 in Apache Kafka by progDuck
• 140 points
2,423 views
0 votes
2 answers

Kafka Consumer is not throwing errors even though if i provide wrong broker details in Java Standalone

Please delete all log files. Reason behind, ...READ MORE

Jun 18, 2020 in Apache Kafka by PAWAN
• 380 points
1,031 views
+1 vote
0 answers

how to delete the topic in kafka

How to stop Kafka server from crashing ...READ MORE

May 13, 2020 in Apache Kafka by sreeveena
• 150 points
1,780 views
0 votes
1 answer

how can we delete the topic in kafka in kafkatool application ?

Hi@sreeveena, I am not sure but there may be ...READ MORE

May 13, 2020 in Apache Kafka by MD
• 95,460 points
2,023 views
0 votes
1 answer

How can I connect aws lambda and kafka ?

Hi@Rishabh, I think to implement this task you ...READ MORE

May 4, 2020 in Apache Kafka by MD
• 95,460 points
4,201 views
0 votes
1 answer

How can i connect to an api which gives me weather data to Apache kafka?

Hi, To connect an API in kafka, you ...READ MORE

Apr 13, 2020 in Apache Kafka by MD
• 95,460 points
1,580 views
0 votes
1 answer

Caused by: org.apache.kafka.connect.errors.DataException: Converting byte[] to Kafka Connect data failed due to serialization error:

Hi@akhtar, To fix the pipeline, you need to resolve ...READ MORE

Apr 3, 2020 in Apache Kafka by MD
• 95,460 points
5,877 views
0 votes
1 answer

How to read batch messages in confluent-kafka-python?

Hi@akhtar, You have to read the messages normally ...READ MORE

Apr 3, 2020 in Apache Kafka by MD
• 95,460 points
4,927 views
0 votes
1 answer

How to write output from Kafka to S3 using a Confluent S3 connector?

Hi@akhtar, To do this task you have to ...READ MORE

Apr 3, 2020 in Apache Kafka by MD
• 95,460 points
2,189 views
0 votes
1 answer

Error: pass --path /path/to/confluent flag or set environment variable CONFLUENT_HOME

Hi@akhtar, Before starting confluent kafka in your system, ...READ MORE

Apr 3, 2020 in Apache Kafka by MD
• 95,460 points
4,303 views
0 votes
2 answers

How to installed confluent kafka in our system?

Easy Approach is work with Docker. ConfluentInc ...READ MORE

Jun 18, 2020 in Apache Kafka by PAWAN
• 380 points
3,517 views
0 votes
1 answer

Error: kafka/Kafka : Unsupported major.minor version 52.0

Hi@akhtar, As the above error shows that the ...READ MORE

Mar 31, 2020 in Apache Kafka by MD
• 95,460 points
3,325 views
0 votes
1 answer

error during KafkaServerStartable startup. Prepare to shutdown (kafka.server.KafkaServerStartable)

Hi@akhtar, This error occurs because zookeeper is running already. So ...READ MORE

Mar 31, 2020 in Apache Kafka by MD
• 95,460 points
4,916 views
0 votes
1 answer

I tried to do configration for retation log in kafkA ,BUT kafka broker shuts Down.Is there any solution for that??

Hi@Parth, There are mainly two types of retention ...READ MORE

Feb 18, 2020 in Apache Kafka by MD
• 95,460 points
1,219 views
0 votes
1 answer

[Mac] Writing the Kafka consumer output to a CSV file

Hi@ I don't know it will work or ...READ MORE

Feb 18, 2020 in Apache Kafka by MD
• 95,460 points
4,417 views
0 votes
2 answers

Is there any Web UI for kafka?

Yes. There is one Tool Name Called ...READ MORE

Mar 14, 2020 in Apache Kafka by Sagar
5,081 views
0 votes
1 answer

How to create Kafka consumer API?

Hi@akhtar, If you know the kafka producer API ...READ MORE

Feb 11, 2020 in Apache Kafka by MD
• 95,460 points
1,808 views
0 votes
1 answer

How consumers enter/exit in groups?

Hi@akhtar, Whenever one new consumer comes or leaves ...READ MORE

Feb 11, 2020 in Apache Kafka by MD
• 95,460 points
1,169 views
0 votes
1 answer

How to implement parallel read in a single application?

Hi@akhtar, To read parallel we have to create ...READ MORE

Feb 11, 2020 in Apache Kafka by MD
• 95,460 points
2,017 views
0 votes
1 answer

What is the meaning of retries in Kafka Producer API?

Hi@akhtar, It defines how many time the producer ...READ MORE

Feb 11, 2020 in Apache Kafka by MD
• 95,460 points
4,698 views
0 votes
1 answer

What is the use of acts configuration in Kafka Producer API?

Hi@akhtar, The acts configuration is used to configure ...READ MORE

Feb 11, 2020 in Apache Kafka by MD
• 95,460 points
1,727 views
0 votes
1 answer

What is the need of serializer in Kafka Producer API?

Hi@akhtar, If we try to use String key ...READ MORE

Feb 11, 2020 in Apache Kafka by MD
• 95,460 points
1,609 views
+1 vote
1 answer

What is the importance of Kafka bootstrap.servers?

Hi@akhtar, Bootstrap.servers is a mandatory field in Kafka ...READ MORE

Feb 11, 2020 in Apache Kafka by MD
• 95,460 points
18,344 views
0 votes
1 answer

How to create kafka producer API?

Hi@akhtar, To create kafka producer API, you can ...READ MORE

Feb 11, 2020 in Apache Kafka by MD
• 95,460 points
1,152 views
0 votes
1 answer

Missing required argument "[zookeeper]"

Hi@akhtar, I guess you are using the old ...READ MORE

Feb 10, 2020 in Apache Kafka by MD
• 95,460 points
3,661 views
0 votes
1 answer

How to know leader information in kafka?

Hi@akhtar, To know leader information you can use ...READ MORE

Feb 10, 2020 in Apache Kafka by MD
• 95,460 points
17,630 views