I tried to do configration for retation log in kafkA BUT kafka broker shuts Down Is there any solution for that

0 votes
I applied log.cleaner.enable=true and etc all configration but Kafka Broker stops at time of retation.
Feb 15, 2020 in Apache Kafka by Parth
• 120 points
188 views

1 answer to this question.

0 votes

Hi@Parth,

There are mainly two types of retention in kafka.

1. Time based retention

2. Size based retention

For time based retention you can set the below properties in kafka broker properties file

# Configures retention time in milliseconds
log.retention.ms=100

# Configures retention time in minutes
log.retention.minutes=10

# Used if log.retention.hours is not set
log.retention.hours=10

For size based retention you can set the below property in kafka broker properties file.

log.retention.bytes= 10000

Check your file once and set the above properties. If it is not working, share your kafka broker properties file.

Thank You

answered Feb 18, 2020 by MD
• 95,180 points

Related Questions In Apache Kafka

0 votes
1 answer

Is there any change in consumer offsets if a new partition(s) is added to a Kafka topic?

Yes, it stays the same. An offset is ...READ MORE

answered Jul 9, 2018 in Apache Kafka by nitinrawat895
• 11,380 points
923 views
0 votes
2 answers

Is there any Web UI for kafka?

Yes. There is one Tool Name Called ...READ MORE

answered Mar 14, 2020 in Apache Kafka by Sagar
1,482 views
0 votes
1 answer

How to commit message offsets in Kafka for reliable data pipeline?

You can use auto.commit.enable to allow Kafka ...READ MORE

answered Jul 9, 2018 in Apache Kafka by Shubham
• 13,480 points
1,615 views
0 votes
1 answer

What is the optimum number of producers to create in Kafka?

In general, a single producer for all ...READ MORE

answered Jul 10, 2018 in Apache Kafka by nitinrawat895
• 11,380 points
4,867 views
0 votes
1 answer

What is a broker in Kafka Cluster?

Hi@akhtar, A Kafka broker receives messages from producers and stores ...READ MORE

answered Dec 7, 2020 in Apache Kafka by MD
• 95,180 points
77 views
0 votes
1 answer

How to delete a topic in Kafka 0.8.1.1?

Deleting topic isn't always working in 0.8.1.1 Deletion ...READ MORE

answered Sep 4, 2018 in Apache Kafka by nitinrawat895
• 11,380 points
821 views
0 votes
1 answer

Explain to me the functionality of Kafka in a Big-Data Cluster

Let me explain to you about Apache ...READ MORE

answered Apr 30, 2019 in Apache Kafka by ravikiran
• 4,620 points
370 views
0 votes
1 answer

How to check pending messages in KAFKA topic?

kafka-run-class.bat kafka.tools.ConsumerOffsetChecker --broker-info --group test-consumer-group --topic test ...READ MORE

answered May 29, 2020 in Apache Kafka by chandra
4,733 views
+1 vote
3 answers

What is the need of zookeeper in kafka? Can I use kafka without zookeeper?

I just would like to complete the ...READ MORE

answered Dec 3, 2020 in Apache Kafka by Tamás
• 140 points
5,165 views
0 votes
1 answer

How to create a Kafka topic in a broker?

Hi@akhtar, To create a Kafka topic, you need ...READ MORE

answered Dec 7, 2020 in Apache Kafka by MD
• 95,180 points
104 views