How to read batch messages in confluent-kafka-python

0 votes

Hi Guys,

I installed confluent kafka in my system. How can I read batch messages in confluent kafka?

Thank You

Apr 3, 2020 in Apache Kafka by akhtar
• 38,210 points
2,393 views

1 answer to this question.

0 votes

Hi@akhtar,

You have to read the messages normally and Kafka will batch the messages under the covers automatically. In other words, when the confluent-Kafka-Python client makes a fetch request to the Kafka broker it will often download more than one message (in a batch) and caches it locally on the client side. It will then give them to your consumer in a way that is indistinguishable from non-batched requests.

Hope this will work.

Thank You

answered Apr 3, 2020 by MD
• 95,300 points

Related Questions In Apache Kafka

0 votes
1 answer

How to check pending messages in KAFKA topic?

kafka-run-class.bat kafka.tools.ConsumerOffsetChecker --broker-info --group test-consumer-group --topic test ...READ MORE

answered May 29, 2020 in Apache Kafka by chandra
5,643 views
0 votes
1 answer

How to reset the offset of messages consumed from Kafka?

The reset option only prints the result ...READ MORE

answered Jul 9, 2018 in Apache Kafka by Shubham
• 13,480 points
11,709 views
0 votes
1 answer

How to commit message offsets in Kafka for reliable data pipeline?

You can use auto.commit.enable to allow Kafka ...READ MORE

answered Jul 9, 2018 in Apache Kafka by Shubham
• 13,480 points
1,891 views
0 votes
1 answer

How to delete a topic in Kafka 0.8.1.1?

Deleting topic isn't always working in 0.8.1.1 Deletion ...READ MORE

answered Sep 4, 2018 in Apache Kafka by nitinrawat895
• 11,380 points
911 views
0 votes
1 answer

Error: pass --path /path/to/confluent flag or set environment variable CONFLUENT_HOME

Hi@akhtar, Before starting confluent kafka in your system, ...READ MORE

answered Apr 3, 2020 in Apache Kafka by MD
• 95,300 points
1,522 views
0 votes
1 answer
0 votes
14 answers

How can I delete all the messages from a Kafka topic?

To delete all the messages from a Kafka topic.  There are many approach ...READ MORE

answered Jun 19, 2020 in Apache Kafka by Pawan
• 380 points
178,760 views
0 votes
1 answer

How to purge Kafka Topic?

For your case what you can do ...READ MORE

answered Sep 4, 2018 in Apache Kafka by nitinrawat895
• 11,380 points
1,704 views
0 votes
2 answers

How to installed confluent kafka in our system?

Easy Approach is work with Docker. ConfluentInc ...READ MORE

answered Jun 17, 2020 in Apache Kafka by Pawan
• 380 points
884 views
0 votes
1 answer