How to purge Kafka Topic?

0 votes

I want to push a message into a kafka topic on my local machine.

But every time I'm trying to do it, I'm getting an error:

kafka.common.InvalidMessageSizeException: invalid message size
Increasing the fetch.size is not ideal here, because I don't actually want to accept messages that big. 

Is there a way to purge the topic in kafka?

Thanks in advance!

Sep 4, 2018 in Apache Kafka by Shubham
• 13,450 points
1,273 views

1 answer to this question.

0 votes

For your case what you can do is, temporarily update the retention time on the topic to one second:

kafka-topics.sh --zookeeper localhost:2081 --alter --topic DemoTopic --config retention.ms=1000
then wait for the purge to take effect (about one minute). Once purged, restore the previous retention.ms value.

Hope this helps!

answered Sep 4, 2018 by nitinrawat895
• 10,950 points

Related Questions In Apache Kafka

0 votes
1 answer

How to check pending messages in KAFKA topic?

kafka-run-class.bat kafka.tools.ConsumerOffsetChecker --broker-info --group test-consumer-group --topic test ...READ MORE

answered May 29 in Apache Kafka by chandra
3,102 views
0 votes
0 answers

how to delete the topic in kafka

How to stop Kafka server from crashing ...READ MORE

May 13 in Apache Kafka by sreeveena
• 140 points
119 views
0 votes
1 answer
0 votes
1 answer

How to reset the offset of messages consumed from Kafka?

The reset option only prints the result ...READ MORE

answered Jul 9, 2018 in Apache Kafka by Shubham
• 13,450 points
7,862 views
+1 vote
13 answers

How can I delete all the messages from a Kafka topic?

To delete all the messages from a Kafka topic.  There are many approach ...READ MORE

answered Jun 19 in Apache Kafka by Pawan
• 380 points
114,422 views
0 votes
1 answer

Kafka Elements

The most important elements of Kafka: Topic – ...READ MORE

answered Sep 18, 2018 in Apache Kafka by kurt_cobain
• 9,320 points
413 views
0 votes
1 answer

Kafka vs Flume

Even though both are used for real-time ...READ MORE

answered Sep 24, 2018 in Big Data Hadoop by Data_Nerd
• 2,390 points
222 views
0 votes
1 answer

Integrating Arduino to Apache Kafka

If you are using Arduino Yun to build your IoT application(s), ...READ MORE

answered Sep 27, 2018 in IoT (Internet of Things) by anonymous2
• 4,280 points
1,591 views
0 votes
1 answer

How to delete a topic in Kafka 0.8.1.1?

Deleting topic isn't always working in 0.8.1.1 Deletion ...READ MORE

answered Sep 4, 2018 in Apache Kafka by nitinrawat895
• 10,950 points
572 views
0 votes
1 answer

Is there any change in consumer offsets if a new partition(s) is added to a Kafka topic?

Yes, it stays the same. An offset is ...READ MORE

answered Jul 9, 2018 in Apache Kafka by nitinrawat895
• 10,950 points
697 views