What is Kafka what is its importance in Big-Data

0 votes
I have currently setup a cluster. I've used Apache Kafka and zookeeper. But still, I still don't get its usage in the cluster. When are both required and for what requirement?
Apr 11, 2019 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,727 views

1 answer to this question.

0 votes

Apache Kafka is a tool used in Streaming Real-time data.

Kafka consists of:

  • Producer
  • Consumer
  • Broker
  • Zookeeper

Producer generates the topic.

Consumer subscribes to the topic.

The topics published are stored in Kafka Clusters or Brokers.

Zookeeper is the king in Kafka all the memory resource is managed and maintained by Zookeeper.

The image below depicts the working architecture of Zookeeper.

Image result for zookeeper architecture diagram

 You can get a better understanding with the Azure Data Engineering certification.

Hope this helps!

To know more about Kafka, I would recommend you to enroll with Kafka training online today.

Thanks.

answered Apr 11, 2019 by ravikiran
• 4,620 points

Related Questions In Big Data Hadoop

+2 votes
1 answer

Is Kafka and Zookeeper are required in a Big Data Cluster?

Apache Kafka is one of the components ...READ MORE

answered Mar 23, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
2,110 views
0 votes
1 answer

How is kafka used in big-data?

I can brief you the answer here ...READ MORE

answered Mar 26, 2019 in Big Data Hadoop by nitinrawat895
• 11,380 points
887 views
0 votes
1 answer

what is pig in big data?

Pig is a high-level programming language for ...READ MORE

answered Jan 7, 2022 in Big Data Hadoop by Edureka
• 12,690 points
1,059 views
+1 vote
1 answer

Is Hadoop only Framework in Big Data Ecosystem ?

Actually there are many other frameworks, one of ...READ MORE

answered Mar 26, 2018 in Big Data Hadoop by Ashish
• 2,650 points
946 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
11,065 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
109,006 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
4,632 views
0 votes
1 answer
0 votes
1 answer

What is the use of Apache Kafka in a Big Data Cluster?

Kafka is a Distributed Messaging System which ...READ MORE

answered Jun 21, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
955 views
0 votes
1 answer

How does Hadoop process data which is split across multiple boundaries in an HDFS?

I found some comments: from the Hadoop ...READ MORE

answered Jul 1, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
982 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP