How to read batch messages in confluent-kafka-python

0 votes

Hi Guys,

I installed confluent kafka in my system. How can I read batch messages in confluent kafka?

Thank You

Apr 3, 2020 in Apache Kafka by akhtar
• 38,230 points
4,172 views

1 answer to this question.

0 votes

Hi@akhtar,

You have to read the messages normally and Kafka will batch the messages under the covers automatically. In other words, when the confluent-Kafka-Python client makes a fetch request to the Kafka broker it will often download more than one message (in a batch) and caches it locally on the client side. It will then give them to your consumer in a way that is indistinguishable from non-batched requests.

Hope this will work.

Join our Kafka course online today to become certified expert.

Thank You

answered Apr 3, 2020 by MD
• 95,440 points

Related Questions In Apache Kafka

0 votes
1 answer

How to check pending messages in KAFKA topic?

kafka-run-class.bat kafka.tools.ConsumerOffsetChecker --broker-info --group test-consumer-group --topic test ...READ MORE

answered May 29, 2020 in Apache Kafka by chandra
10,308 views
0 votes
1 answer

How to reset the offset of messages consumed from Kafka?

The reset option only prints the result ...READ MORE

answered Jul 10, 2018 in Apache Kafka by Shubham
• 13,490 points
13,726 views
0 votes
1 answer

How to commit message offsets in Kafka for reliable data pipeline?

You can use auto.commit.enable to allow Kafka ...READ MORE

answered Jul 10, 2018 in Apache Kafka by Shubham
• 13,490 points
3,340 views
0 votes
1 answer

How to delete a topic in Kafka 0.8.1.1?

Deleting topic isn't always working in 0.8.1.1 Deletion ...READ MORE

answered Sep 4, 2018 in Apache Kafka by nitinrawat895
• 11,380 points
1,548 views
0 votes
1 answer

Error: pass --path /path/to/confluent flag or set environment variable CONFLUENT_HOME

Hi@akhtar, Before starting confluent kafka in your system, ...READ MORE

answered Apr 3, 2020 in Apache Kafka by MD
• 95,440 points
3,475 views
0 votes
1 answer
0 votes
14 answers

How can I delete all the messages from a Kafka topic?

To delete all the messages from a Kafka topic.  There are many approach ...READ MORE

answered Jun 19, 2020 in Apache Kafka by Pawan
• 380 points
226,771 views
0 votes
1 answer

How to purge Kafka Topic?

For your case what you can do ...READ MORE

answered Sep 4, 2018 in Apache Kafka by nitinrawat895
• 11,380 points
2,507 views
0 votes
2 answers

How to installed confluent kafka in our system?

Easy Approach is work with Docker. ConfluentInc ...READ MORE

answered Jun 18, 2020 in Apache Kafka by Pawan
• 380 points
2,688 views
0 votes
1 answer
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP