How to get started with Hadoop and do some development using Eclipse IDE

Question

Hi, I have recently started learning Hadoop and I am followin a couple of tutorials. I am following Hadoop Definitive guide book as well. But, in the couple of tutorials they already have shown various examples that I can download and just execute them. I am more keen on some kind of development. How should I proceed?

Answer 1

Alright, there are couple of things that I assume that you would have already taken care of such as:

• Setting up Hadoop in your local machine. If not check the below link to the blog for step by step process to set up hadoop: https://www.edureka.co/blog/install-hadoop-single-node-hadoop-cluster
• As an alternative you can also go ahead with cloudera quickstart VM which has everything pre-installed in it. It is actually a good way to start. You will also get eclipse already installed in it. 
• Last I think you should be familiar with Hadoop MapReduce framework. I mean how does it work internally. For this you can practice all the examples given in the hadoop definite guide bool. The codes are already there on github. So all you have to do is download the codes into your vm and then import them using eclipse. Here is the github link for the codes(the same has been mentioned in the book as well) - https://github.com/tomwhite/hadoop-book

Let me know in case you are still stuck somewhere for further help!