flume twitter data file not generated in HDFS

Question

I am using Apache Hadoop on Windows 10. I have installed Flume and trying to generate tweets using Twitter Agent. The twitter agent runs perfectly and the tweets are shown in the command prompt. But I can't see the twitter file generated in HDFS. 

Please help me through this. 

Comments

Did you manage to figure this out?

---

Did you try the below-given solution?

---

I have the same problem and I already have source and sink binding and it is not working. Please help if you know the solution

---

Hi,

Maybe your cluster is in a safe mode. So check this first. But if you get the same output, then paste your complete code here.

Answer 1

Seems like you've missed the source and sink binding. Add these and then try:

TwitterAgent.sources.Twitter.channels = MemChannel
TwitterAgent.sinks.HDFS.channel = MemChannel 

To know more about Big Data, It's recommended to join Data Architect Certification today.

Comments

Hi,

If it is still not working. Then try in the Linux system and see if you get the same error or not.

---

Hi,

thank you but I am working on the Linux system and it is still not working.

---

Hi,

Ok, I will replicate your requirement in my own system and get back to you.

---

Hi,

did you try it?

---

Hi,

I tried to create a table in the hive. It is working fine. In your case, there is nothing wrong with the steps. But I think the problem is with the hive. You just create a simple table and try to import a simple text file from your local system or HDFS.