Is there a way to copy data from one one Hadoop distributed file system(HDFS) to another HDFS?

0 votes

I have two HDFS setup and want to copy (not migrate or move) some data from HDFS1 to HDFS2. How to do I copy data from one HDFS to another HDFS? Is it possible via Sqoop or other command line?

Mar 21, 2018 in Big Data Hadoop by Shubham
• 13,350 points
2,427 views

1 answer to this question.

0 votes

The distributed copy command, distcp, is a utility that allows you to copy large data sets between two DFS cluster. The distcp command submits a regular MapReduce job that performs a file-by-file copy.

Usage:

hadoop distcp <source> <destination>

Example:

hadoop distcp hdfs://namenode1:9820/source_dir hdfs://namenode2:9820/destination_dir
answered Mar 22, 2018 by Ashish
• 2,630 points

Related Questions In Big Data Hadoop

0 votes
1 answer

Is there any way to load data from MySql to HDFS?

The generic command i.e used to import ...READ MORE

answered Apr 10, 2018 in Big Data Hadoop by nitinrawat895
• 10,800 points
724 views
0 votes
2 answers

hadoop copy a local file system folder to HDFS

There's a typo in your command: "hadopp". ...READ MORE

answered Feb 4 in Big Data Hadoop by Lohith
4,286 views
0 votes
1 answer
0 votes
1 answer

Is there any way to pull data from Mainframe to Hadoop?

First of all, COBOL is a programming ...READ MORE

answered May 21, 2018 in Big Data Hadoop by nitinrawat895
• 10,800 points
921 views
0 votes
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,800 points
3,574 views
+1 vote
11 answers

hadoop fs -put command?

put syntax: put <localSrc> <dest> copy syntax: copyFr ...READ MORE

answered Dec 7, 2018 in Big Data Hadoop by Aditya
18,425 views
0 votes
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,280 points
1,333 views
+1 vote
1 answer

Where to set hadoop.tmp.dir? core-site.xml or hdfs-site.xml?

hadoop.tmp.dir (A base for other temporary directories) is ...READ MORE

answered Mar 26, 2018 in Big Data Hadoop by nitinrawat895
• 10,800 points
2,188 views
0 votes
1 answer

Error while copying the file from local to HDFS

Well, the reason you are getting such ...READ MORE

answered May 2, 2018 in Big Data Hadoop by Ashish
• 2,630 points
622 views
+1 vote
1 answer

Is Hadoop only Framework in Big Data Ecosystem ?

Actually there are many other frameworks, one of ...READ MORE

answered Mar 26, 2018 in Big Data Hadoop by Ashish
• 2,630 points
92 views