How do I run Hadoop with Docker for both DEV and PROD environments

0 votes
Can you help me out with the easiest way that works for both DEV and Real-Time environment to run Hadoop with Docker?

That is for local development environment and real environment difference should be only destination machine.
May 30, 2019 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,103 views

1 answer to this question.

0 votes

Your requirements show that you are using Hadoop in fully distributed mode. I'll redirect you to a site which must help you with the image you need.

Here containers can be run as both master and worker.

#docker network create hadoop

#docker run -d -p 50070:50070 -p 8088:8088 \
#    --network hadoop --name hadoop-dotnet-master \
#    sixeyed/hadoop-dotnet master

#docker run -d -p 50075:50075 -p 8142:8042 -p 19888:19888 \
#    --network hadoop 
#    sixeyed/hadoop-dotnet worker

Or if you wish to run a fully distributed cluster with a docker composer file, then I this must be the solution 

answered May 30, 2019 by ravikiran
• 4,620 points

Related Questions In Big Data Hadoop

0 votes
1 answer

Can I run Hadoop with Docker for both DEV and PROD environments?

Hi, Yes, you can run Hadoop with Docker ...READ MORE

answered Jan 24, 2020 in Big Data Hadoop by MD
• 95,460 points
619 views
0 votes
1 answer

How to get started with Hadoop and do some development using Eclipse IDE?

Alright, there are couple of things that ...READ MORE

answered Apr 4, 2018 in Big Data Hadoop by Ashish
• 2,650 points
2,038 views
0 votes
2 answers

How do I integrate Kdb+ and hadoop?

 kdb+ could be installed on every Hadoop ...READ MORE

answered Aug 6, 2018 in Big Data Hadoop by Abhi
• 3,720 points
1,679 views
0 votes
1 answer

How do I get connected to Hadoop and Geo Spatial connector?

There are a number of free and ...READ MORE

answered Aug 14, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,938 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
10,924 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
2,453 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
108,313 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
4,546 views
0 votes
1 answer

Can I run Hadoop with Docker for both DEV and PROD environments?

Hadoop Docker Hub provides Hadoop Images, You ...READ MORE

answered Jun 26, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
585 views
0 votes
1 answer
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP