How to read batch messages in confluent-kafka-python?

0 votes

Hi Guys,

I installed confluent kafka in my system. How can I read batch messages in confluent kafka?

Thank You

Apr 3 in Apache Kafka by akhtar
• 10,580 points
89 views

1 answer to this question.

0 votes

Hi@akhtar,

You have to read the messages normally and Kafka will batch the messages under the covers automatically. In other words, when the confluent-Kafka-Python client makes a fetch request to the Kafka broker it will often download more than one message (in a batch) and caches it locally on the client side. It will then give them to your consumer in a way that is indistinguishable from non-batched requests.

Hope this will work.

Thank You

answered Apr 3 by MD
• 23,050 points

Related Questions In Apache Kafka

0 votes
1 answer

How to check pending messages in KAFKA topic?

kafka-run-class.bat kafka.tools.ConsumerOffsetChecker --broker-info --group test-consumer-group --topic test ...READ MORE

answered 4 days ago in Apache Kafka by chandra
2,004 views
0 votes
1 answer

How to reset the offset of messages consumed from Kafka?

The reset option only prints the result ...READ MORE

answered Jul 9, 2018 in Apache Kafka by Shubham
• 13,380 points
5,867 views
0 votes
1 answer

How to commit message offsets in Kafka for reliable data pipeline?

You can use auto.commit.enable to allow Kafka ...READ MORE

answered Jul 9, 2018 in Apache Kafka by Shubham
• 13,380 points
787 views
0 votes
1 answer

How to delete a topic in Kafka 0.8.1.1?

Deleting topic isn't always working in 0.8.1.1 Deletion ...READ MORE

answered Sep 4, 2018 in Apache Kafka by nitinrawat895
• 10,920 points
449 views
0 votes
1 answer

Error: pass --path /path/to/confluent flag or set environment variable CONFLUENT_HOME

Hi@akhtar, Before starting confluent kafka in your system, ...READ MORE

answered Apr 3 in Apache Kafka by MD
• 23,050 points
106 views
+1 vote
12 answers

How can I delete all the messages from a Kafka topic?

As of kafka 2.3.0 version, there is ...READ MORE

answered Sep 8, 2019 in Apache Kafka by Brajkishore
• 240 points
87,630 views
0 votes
1 answer

How to purge Kafka Topic?

For your case what you can do ...READ MORE

answered Sep 4, 2018 in Apache Kafka by nitinrawat895
• 10,920 points
967 views
0 votes
1 answer

How to installed confluent kafka in our system?

Hi@akhtar, Confluent is a data streaming platform based on ...READ MORE

answered Apr 3 in Apache Kafka by MD
• 23,050 points
54 views
0 votes
1 answer

How to know leader information in kafka?

Hi@akhtar, To know leader information you can use ...READ MORE

answered Feb 10 in Apache Kafka by MD
• 23,050 points
298 views