How to purge Kafka Topic

0 votes

I want to push a message into a kafka topic on my local machine.

But every time I'm trying to do it, I'm getting an error:

kafka.common.InvalidMessageSizeException: invalid message size
Increasing the fetch.size is not ideal here, because I don't actually want to accept messages that big. 

Is there a way to purge the topic in kafka?

Thanks in advance!

Sep 4, 2018 in Apache Kafka by Shubham
• 13,480 points
1,628 views

1 answer to this question.

0 votes

For your case what you can do is, temporarily update the retention time on the topic to one second:

kafka-topics.sh --zookeeper localhost:2081 --alter --topic DemoTopic --config retention.ms=1000
then wait for the purge to take effect (about one minute). Once purged, restore the previous retention.ms value.

Hope this helps!

answered Sep 4, 2018 by nitinrawat895
• 11,380 points

Related Questions In Apache Kafka

0 votes
1 answer

How to check pending messages in KAFKA topic?

kafka-run-class.bat kafka.tools.ConsumerOffsetChecker --broker-info --group test-consumer-group --topic test ...READ MORE

answered May 29, 2020 in Apache Kafka by chandra
4,769 views
0 votes
0 answers

how to delete the topic in kafka

How to stop Kafka server from crashing ...READ MORE

May 13, 2020 in Apache Kafka by sreeveena
• 140 points
246 views
0 votes
1 answer
0 votes
1 answer

How to create a Kafka topic in a broker?

Hi@akhtar, To create a Kafka topic, you need ...READ MORE

answered Dec 7, 2020 in Apache Kafka by MD
• 95,180 points
106 views
0 votes
14 answers

How can I delete all the messages from a Kafka topic?

To delete all the messages from a Kafka topic.  There are many approach ...READ MORE

answered Jun 19, 2020 in Apache Kafka by Pawan
• 380 points
158,377 views
0 votes
1 answer

Kafka Elements

The most important elements of Kafka: Topic – ...READ MORE

answered Sep 18, 2018 in Apache Kafka by kurt_cobain
• 9,390 points
665 views
0 votes
1 answer

Kafka vs Flume

Even though both are used for real-time ...READ MORE

answered Sep 24, 2018 in Big Data Hadoop by Data_Nerd
• 2,390 points
292 views
0 votes
1 answer

Integrating Arduino to Apache Kafka

If you are using Arduino Yun to build your IoT application(s), ...READ MORE

answered Sep 27, 2018 in IoT (Internet of Things) by anonymous2
• 4,280 points
2,078 views
0 votes
1 answer

How to delete a topic in Kafka 0.8.1.1?

Deleting topic isn't always working in 0.8.1.1 Deletion ...READ MORE

answered Sep 4, 2018 in Apache Kafka by nitinrawat895
• 11,380 points
826 views
0 votes
1 answer

Is there any change in consumer offsets if a new partition(s) is added to a Kafka topic?

Yes, it stays the same. An offset is ...READ MORE

answered Jul 9, 2018 in Apache Kafka by nitinrawat895
• 11,380 points
928 views