How to read batch messages in confluent-kafka-python

0 votes

Hi Guys,

I installed confluent kafka in my system. How can I read batch messages in confluent kafka?

Thank You

Apr 3, 2020 in Apache Kafka by akhtar
• 38,120 points
1,523 views

1 answer to this question.

0 votes

Hi@akhtar,

You have to read the messages normally and Kafka will batch the messages under the covers automatically. In other words, when the confluent-Kafka-Python client makes a fetch request to the Kafka broker it will often download more than one message (in a batch) and caches it locally on the client side. It will then give them to your consumer in a way that is indistinguishable from non-batched requests.

Hope this will work.

Thank You

answered Apr 3, 2020 by MD
• 94,990 points

Related Questions In Apache Kafka

0 votes
1 answer

How to check pending messages in KAFKA topic?

kafka-run-class.bat kafka.tools.ConsumerOffsetChecker --broker-info --group test-consumer-group --topic test ...READ MORE

answered May 29, 2020 in Apache Kafka by chandra
4,004 views
0 votes
1 answer

How to reset the offset of messages consumed from Kafka?

The reset option only prints the result ...READ MORE

answered Jul 9, 2018 in Apache Kafka by Shubham
• 13,460 points
9,771 views
0 votes
1 answer

How to commit message offsets in Kafka for reliable data pipeline?

You can use auto.commit.enable to allow Kafka ...READ MORE

answered Jul 9, 2018 in Apache Kafka by Shubham
• 13,460 points
1,379 views
0 votes
1 answer

How to delete a topic in Kafka 0.8.1.1?

Deleting topic isn't always working in 0.8.1.1 Deletion ...READ MORE

answered Sep 4, 2018 in Apache Kafka by nitinrawat895
• 11,380 points
706 views
0 votes
1 answer

Error: pass --path /path/to/confluent flag or set environment variable CONFLUENT_HOME

Hi@akhtar, Before starting confluent kafka in your system, ...READ MORE

answered Apr 3, 2020 in Apache Kafka by MD
• 94,990 points
748 views
0 votes
1 answer
+1 vote
14 answers

How can I delete all the messages from a Kafka topic?

To delete all the messages from a Kafka topic.  There are many approach ...READ MORE

answered Jun 19, 2020 in Apache Kafka by Pawan
• 380 points
137,850 views
0 votes
1 answer

How to purge Kafka Topic?

For your case what you can do ...READ MORE

answered Sep 4, 2018 in Apache Kafka by nitinrawat895
• 11,380 points
1,512 views
0 votes
2 answers

How to installed confluent kafka in our system?

Easy Approach is work with Docker. ConfluentInc ...READ MORE

answered Jun 17, 2020 in Apache Kafka by Pawan
• 380 points
489 views
0 votes
1 answer