How is kafka used in big-data?

0 votes
A Big-Data cluster is set up using Apache Kafka and its storage unit which is Zookeeper. But how does one understand the use of them and in which scenario?
Mar 26 in Big Data Hadoop by nitinrawat895
• 9,030 points
51 views

1 answer to this question.

Your answer

Your name to display (optional):
Privacy: Your email address will only be used for sending these notifications.
0 votes

I can brief you the answer here but in case if you wish to learn more about Kafka, You can read the article linked.

Data accessed from any source such as twitter etc is called as a topic. in a more simpler language, consider a specific TV channel in a collection of channels available. say HBO. then HBO is your topic to stream.

Producer: He/She can be anyone who generates the topic is the producer.

Consumer: Consumer is anyone who requests access for data and also can subscribe to the data.

Broker: The published Topics are then stored in a set of servers called the brokers or Kafka CLuster.

Zookeeper: Zookeeper is the storage system of Apache Kafka. It is a distributed and Hierarchal storage.

Image result for kafka architecture

answered Mar 26 by nitinrawat895
• 9,030 points

Related Questions In Big Data Hadoop

0 votes
1 answer

What is Kafka? what is its importance in Big-Data?

Apache Kafka is a tool used in ...READ MORE

answered Apr 11 in Big Data Hadoop by ravikiran
• 1,460 points
25 views
+1 vote
1 answer

Is Hadoop only Framework in Big Data Ecosystem ?

Actually there are many other frameworks, one of ...READ MORE

answered Mar 26, 2018 in Big Data Hadoop by Ashish
• 2,630 points
36 views
0 votes
1 answer

What is Modeling data in Hadoop and how to do it?

I suggest spending some time with Apache ...READ MORE

answered Sep 19, 2018 in Big Data Hadoop by Frankie
• 9,570 points
36 views
0 votes
1 answer

How data distribution is done in Hadoop?

To understand how or what are the process ...READ MORE

answered Apr 4 in Big Data Hadoop by Gitika
• 6,700 points
26 views
0 votes
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 9,030 points
1,637 views
0 votes
10 answers

hadoop fs -put command?

copy command can be used to copy files ...READ MORE

answered Dec 7, 2018 in Big Data Hadoop by Sujay
7,950 views
0 votes
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
551 views
0 votes
1 answer
0 votes
1 answer

Is Kafka and Zookeeper are required in a Big Data Cluster?

Apache Kafka is one of the components ...READ MORE

answered Mar 22, 2018 in Big Data Hadoop by nitinrawat895
• 9,030 points
251 views
0 votes
1 answer

Which Data Structure is used in case of Map Reduce?

In case of Hadoop, HDFS is used ...READ MORE

answered May 4, 2018 in Big Data Hadoop by nitinrawat895
• 9,030 points
82 views

© 2018 Brain4ce Education Solutions Pvt. Ltd. All rights Reserved.
"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.