I tried to do configration for retation log in kafkA ,BUT kafka broker shuts Down.Is there any solution for that??

0 votes
I applied log.cleaner.enable=true and etc all configration but Kafka Broker stops at time of retation.
Feb 15 in Apache Kafka by Parth
• 120 points
74 views

1 answer to this question.

0 votes

Hi@Parth,

There are mainly two types of retention in kafka.

1. Time based retention

2. Size based retention

For time based retention you can set the below properties in kafka broker properties file

# Configures retention time in milliseconds
log.retention.ms=100

# Configures retention time in minutes
log.retention.minutes=10

# Used if log.retention.hours is not set
log.retention.hours=10

For size based retention you can set the below property in kafka broker properties file.

log.retention.bytes= 10000

Check your file once and set the above properties. If it is not working, share your kafka broker properties file.

Thank You

answered Feb 18 by MD
• 8,510 points

Related Questions In Apache Kafka

0 votes
1 answer

Is there any change in consumer offsets if a new partition(s) is added to a Kafka topic?

Yes, it stays the same. An offset is ...READ MORE

answered Jul 9, 2018 in Apache Kafka by nitinrawat895
• 10,870 points
520 views
0 votes
1 answer

Is there any Web UI for kafka?

Yes. There is one Tool Name Called ...READ MORE

answered Mar 14 in Apache Kafka by Sagar
49 views
0 votes
1 answer

How to commit message offsets in Kafka for reliable data pipeline?

You can use auto.commit.enable to allow Kafka ...READ MORE

answered Jul 9, 2018 in Apache Kafka by Shubham
• 13,380 points
600 views
0 votes
1 answer

What is the optimum number of producers to create in Kafka?

In general, a single producer for all ...READ MORE

answered Jul 10, 2018 in Apache Kafka by nitinrawat895
• 10,870 points
2,247 views
0 votes
1 answer

How to delete a topic in Kafka 0.8.1.1?

Deleting topic isn't always working in 0.8.1.1 Deletion ...READ MORE

answered Sep 4, 2018 in Apache Kafka by nitinrawat895
• 10,870 points
382 views
0 votes
1 answer

Explain to me the functionality of Kafka in a Big-Data Cluster

Let me explain to you about Apache ...READ MORE

answered Apr 30, 2019 in Apache Kafka by ravikiran
• 4,600 points
198 views
0 votes
0 answers

How to check pending messages in KAFKA topic?

Let say we have first_topic which has kafka_server_brokertopicmetrics_messagesin_total{instance="localhost:1120",job="kafka",topic="first_topic"}  ...READ MORE

May 2, 2019 in Apache Kafka by anonymous
1,534 views
0 votes
1 answer

How can I create multiple consumers in apache kafka?

Hi@akhtar, If you already created multiple producers then ...READ MORE

answered Feb 6 in Apache Kafka by MD
• 8,510 points
92 views
0 votes
1 answer

What is the need of zookeeper in kafka? Can I use kafka without zookeeper?

Hi@akhtar, You can not use kafka without zookeeper. ...READ MORE

answered Feb 6 in Apache Kafka by MD
• 8,510 points
310 views
0 votes
1 answer

How can I create a topic in apache kafka?

Hi@akhtar, To create kafka topic you can use ...READ MORE

answered Feb 6 in Apache Kafka by MD
• 8,510 points
50 views