Latest questions in Apache Kafka

0 votes
0 answers

zookeeper service is not started properly

Getting below warning in zookeeper log 2021-02-19 14:20:27,911 ...READ MORE

Feb 19 in Apache Kafka by anonymous
• 120 points
104 views
0 votes
1 answer

How to change the data directory in Zookeeper?

Hi@akhtar, You can change the default directory in ...READ MORE

Dec 8, 2020 in Apache Kafka by MD
• 95,180 points
200 views
0 votes
1 answer

How to stop zookeeper service?

Hi@akhtar, You can find one script in the ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
• 95,180 points
81 views
0 votes
1 answer

How to configure zookeeper for Kafka?

Hi@akhtar, It is a must to set up ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
• 95,180 points
110 views
0 votes
1 answer

How to list all Kafka topics?

Hi@akhtar, Kafka uses ZooKeeper, so you need to ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
• 95,180 points
1,052 views
0 votes
1 answer

What is a broker in Kafka Cluster?

Hi@akhtar, A Kafka broker receives messages from producers and stores ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
• 95,180 points
79 views
0 votes
1 answer

What is a producer in Kafka Cluster?

Hi@akhtar, The Kafka producer is conceptually much simpler than the ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
• 95,180 points
51 views
0 votes
1 answer

How to start a consumer in Kafka cluster?

Hi@akhtar, In Kafka, each topic is divided into a ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
• 95,180 points
67 views
0 votes
1 answer

How to create a Kafka producer?

Hi@MD, Generally, Kafka producer comes from an API. ...READ MORE

Dec 7, 2020 in Apache Kafka by akhtar
• 38,170 points
65 views
0 votes
1 answer

How to create a Kafka topic in a broker?

Hi@akhtar, To create a Kafka topic, you need ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
• 95,180 points
104 views
0 votes
1 answer

How to start Kafka server?

Hi@akhtar, You need the start your zookeeper service ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
• 95,180 points
107 views
0 votes
1 answer

How to start Zookeeper service?

Hi@akhtar, Before you start the Zookeeper service, you need ...READ MORE

Dec 7, 2020 in Apache Kafka by MD
• 95,180 points
99 views
0 votes
1 answer

ERROR tool.BaseSqoopTool: Error parsing arguments for import:ERROR tool.BaseSqoopTool: Unrecognized argument: -topic

Hi@oguzhan, I have checked the Sqoop document, but ...READ MORE

Sep 7, 2020 in Apache Kafka by MD
• 95,180 points
232 views
0 votes
1 answer

How to consume the consumed message from the kafka topic based on offset ? please provide example in confluent_kafka python

Hi@Amit, You can pass --offset keyword in your ...READ MORE

Aug 10, 2020 in Apache Kafka by MD
• 95,180 points
1,602 views
0 votes
1 answer

Kafka SASL/SCRAM

Hi@progDuck, By default it is connecting to localhost:2181, ...READ MORE

Jun 5, 2020 in Apache Kafka by MD
• 95,180 points
728 views
0 votes
1 answer

Kafka SASL/SCRAM

Hi@progDuck, By default it is connecting to localhost:2181, since ...READ MORE

Jun 5, 2020 in Apache Kafka by MD
• 95,180 points
544 views
0 votes
2 answers

Kafka Consumer is not throwing errors even though if i provide wrong broker details in Java Standalone

Please delete all log files. Reason behind, ...READ MORE

Jun 17, 2020 in Apache Kafka by Pawan
• 380 points
155 views
0 votes
0 answers

how to delete the topic in kafka

How to stop Kafka server from crashing ...READ MORE

May 13, 2020 in Apache Kafka by sreeveena
• 140 points
246 views
0 votes
1 answer

how can we delete the topic in kafka in kafkatool application ?

Hi@sreeveena, I am not sure but there may be ...READ MORE

May 13, 2020 in Apache Kafka by MD
• 95,180 points
496 views
0 votes
1 answer

How can I connect aws lambda and kafka ?

Hi@Rishabh, I think to implement this task you ...READ MORE

May 4, 2020 in Apache Kafka by MD
• 95,180 points
1,907 views
0 votes
1 answer

How can i connect to an api which gives me weather data to Apache kafka?

Hi, To connect an API in kafka, you ...READ MORE

Apr 13, 2020 in Apache Kafka by MD
• 95,180 points
336 views
0 votes
1 answer

Caused by: org.apache.kafka.connect.errors.DataException: Converting byte[] to Kafka Connect data failed due to serialization error:

Hi@akhtar, To fix the pipeline, you need to resolve ...READ MORE

Apr 3, 2020 in Apache Kafka by MD
• 95,180 points
1,321 views
0 votes
1 answer

How to read batch messages in confluent-kafka-python?

Hi@akhtar, You have to read the messages normally ...READ MORE

Apr 3, 2020 in Apache Kafka by MD
• 95,180 points
2,087 views
0 votes
1 answer

How to write output from Kafka to S3 using a Confluent S3 connector?

Hi@akhtar, To do this task you have to ...READ MORE

Apr 3, 2020 in Apache Kafka by MD
• 95,180 points
815 views
0 votes
1 answer

Error: pass --path /path/to/confluent flag or set environment variable CONFLUENT_HOME

Hi@akhtar, Before starting confluent kafka in your system, ...READ MORE

Apr 3, 2020 in Apache Kafka by MD
• 95,180 points
1,136 views
0 votes
2 answers

How to installed confluent kafka in our system?

Easy Approach is work with Docker. ConfluentInc ...READ MORE

Jun 17, 2020 in Apache Kafka by Pawan
• 380 points
702 views
0 votes
1 answer

Error: kafka/Kafka : Unsupported major.minor version 52.0

Hi@akhtar, As the above error shows that the ...READ MORE

Mar 31, 2020 in Apache Kafka by MD
• 95,180 points
830 views
0 votes
1 answer

error during KafkaServerStartable startup. Prepare to shutdown (kafka.server.KafkaServerStartable)

Hi@akhtar, This error occurs because zookeeper is running already. So ...READ MORE

Mar 31, 2020 in Apache Kafka by MD
• 95,180 points
767 views
0 votes
1 answer

I tried to do configration for retation log in kafkA ,BUT kafka broker shuts Down.Is there any solution for that??

Hi@Parth, There are mainly two types of retention ...READ MORE

Feb 18, 2020 in Apache Kafka by MD
• 95,180 points
188 views
0 votes
1 answer

[Mac] Writing the Kafka consumer output to a CSV file

Hi@ I don't know it will work or ...READ MORE

Feb 18, 2020 in Apache Kafka by MD
• 95,180 points
1,802 views
0 votes
2 answers

Is there any Web UI for kafka?

Yes. There is one Tool Name Called ...READ MORE

Mar 14, 2020 in Apache Kafka by Sagar
1,498 views
0 votes
1 answer

How to create Kafka consumer API?

Hi@akhtar, If you know the kafka producer API ...READ MORE

Feb 11, 2020 in Apache Kafka by MD
• 95,180 points
417 views
0 votes
1 answer

How consumers enter/exit in groups?

Hi@akhtar, Whenever one new consumer comes or leaves ...READ MORE

Feb 11, 2020 in Apache Kafka by MD
• 95,180 points
136 views
0 votes
1 answer

How to implement parallel read in a single application?

Hi@akhtar, To read parallel we have to create ...READ MORE

Feb 11, 2020 in Apache Kafka by MD
• 95,180 points
451 views
0 votes
1 answer

What is the meaning of retries in Kafka Producer API?

Hi@akhtar, It defines how many time the producer ...READ MORE

Feb 11, 2020 in Apache Kafka by MD
• 95,180 points
1,921 views
0 votes
1 answer

What is the use of acts configuration in Kafka Producer API?

Hi@akhtar, The acts configuration is used to configure ...READ MORE

Feb 11, 2020 in Apache Kafka by MD
• 95,180 points
300 views
0 votes
1 answer

What is the need of serializer in Kafka Producer API?

Hi@akhtar, If we try to use String key ...READ MORE

Feb 11, 2020 in Apache Kafka by MD
• 95,180 points
252 views
+1 vote
1 answer

What is the importance of Kafka bootstrap.servers?

Hi@akhtar, Bootstrap.servers is a mandatory field in Kafka ...READ MORE

Feb 11, 2020 in Apache Kafka by MD
• 95,180 points
8,047 views
0 votes
1 answer

How to create kafka producer API?

Hi@akhtar, To create kafka producer API, you can ...READ MORE

Feb 11, 2020 in Apache Kafka by MD
• 95,180 points
184 views
0 votes
1 answer

Missing required argument "[zookeeper]"

Hi@akhtar, I guess you are using the old ...READ MORE

Feb 10, 2020 in Apache Kafka by MD
• 95,180 points
1,029 views
0 votes
1 answer

How to know leader information in kafka?

Hi@akhtar, To know leader information you can use ...READ MORE

Feb 10, 2020 in Apache Kafka by MD
• 95,180 points
3,892 views
0 votes
1 answer

How to install sbt in Redhat/CentOs??

Hi@akhtar, To install sbt in your RedHat system ...READ MORE

Feb 10, 2020 in Apache Kafka by MD
• 95,180 points
1,835 views
+1 vote
2 answers

How to check Kafka version?

Hi@akhtar, Actually, in kafka there is no command ...READ MORE

Feb 10, 2020 in Apache Kafka by MD
• 95,180 points
19,821 views
0 votes
1 answer

[error] /root/kafka-sbt/file.java:5:1: class SimpleProducer is public, should be declared in a file named SimpleProducer.java

Hi@akhtar, This error is not related to sbt. ...READ MORE

Feb 10, 2020 in Apache Kafka by MD
• 95,180 points
252 views
0 votes
1 answer

org.apache.kafka.common.config.ConfigException: Missing required configuration "bootstrap.servers" which has no default value.

Hi@akhtar, In your file bootstrap.servers field in missing. ...READ MORE

Feb 10, 2020 in Apache Kafka by MD
• 95,180 points
2,230 views
+1 vote
3 answers

What is the need of zookeeper in kafka? Can I use kafka without zookeeper?

I just would like to complete the ...READ MORE

Dec 3, 2020 in Apache Kafka by Tamás
• 140 points
5,195 views
0 votes
1 answer

What are the differences between Apache Kafka and RabbitMQ?

Hi@akhtar, Apache kafka and RabitMQ have their own ...READ MORE

Feb 6, 2020 in Apache Kafka by MD
• 95,180 points
161 views
0 votes
2 answers

How can I create multiple consumers in apache kafka?

First of all, Consumer is not thread ...READ MORE

Jun 17, 2020 in Apache Kafka by Pawan
• 380 points
1,958 views
0 votes
1 answer

How can I create a topic in apache kafka?

Hi@akhtar, To create kafka topic you can use ...READ MORE

Feb 6, 2020 in Apache Kafka by MD
• 95,180 points
207 views