I tried to do configration for retation log in kafkA ,BUT kafka broker shuts Down.Is there any solution for that??

0 votes
I applied log.cleaner.enable=true and etc all configration but Kafka Broker stops at time of retation.
Feb 15 in Apache Kafka by Parth
• 120 points
98 views

1 answer to this question.

0 votes

Hi@Parth,

There are mainly two types of retention in kafka.

1. Time based retention

2. Size based retention

For time based retention you can set the below properties in kafka broker properties file

# Configures retention time in milliseconds
log.retention.ms=100

# Configures retention time in minutes
log.retention.minutes=10

# Used if log.retention.hours is not set
log.retention.hours=10

For size based retention you can set the below property in kafka broker properties file.

log.retention.bytes= 10000

Check your file once and set the above properties. If it is not working, share your kafka broker properties file.

Thank You

answered Feb 18 by MD
• 41,020 points

Related Questions In Apache Kafka

0 votes
1 answer

Is there any change in consumer offsets if a new partition(s) is added to a Kafka topic?

Yes, it stays the same. An offset is ...READ MORE

answered Jul 9, 2018 in Apache Kafka by nitinrawat895
• 10,920 points
647 views
0 votes
1 answer

Is there any Web UI for kafka?

Yes. There is one Tool Name Called ...READ MORE

answered Mar 14 in Apache Kafka by Sagar
167 views
0 votes
1 answer

How to commit message offsets in Kafka for reliable data pipeline?

You can use auto.commit.enable to allow Kafka ...READ MORE

answered Jul 9, 2018 in Apache Kafka by Shubham
• 13,380 points
964 views
0 votes
1 answer

What is the optimum number of producers to create in Kafka?

In general, a single producer for all ...READ MORE

answered Jul 10, 2018 in Apache Kafka by nitinrawat895
• 10,920 points
3,187 views
0 votes
1 answer

How to delete a topic in Kafka 0.8.1.1?

Deleting topic isn't always working in 0.8.1.1 Deletion ...READ MORE

answered Sep 4, 2018 in Apache Kafka by nitinrawat895
• 10,920 points
512 views
0 votes
1 answer

Explain to me the functionality of Kafka in a Big-Data Cluster

Let me explain to you about Apache ...READ MORE

answered Apr 30, 2019 in Apache Kafka by ravikiran
• 4,600 points
262 views
0 votes
1 answer

How to check pending messages in KAFKA topic?

kafka-run-class.bat kafka.tools.ConsumerOffsetChecker --broker-info --group test-consumer-group --topic test ...READ MORE

answered May 29 in Apache Kafka by chandra
2,558 views
0 votes
2 answers
+1 vote
2 answers

What is the need of zookeeper in kafka? Can I use kafka without zookeeper?

At present, There is no any alternative ...READ MORE

answered Jun 17 in Apache Kafka by Pawan
• 380 points
1,957 views
0 votes
1 answer

How can I create a topic in apache kafka?

Hi@akhtar, To create kafka topic you can use ...READ MORE

answered Feb 6 in Apache Kafka by MD
• 41,020 points
87 views