Sending hdfs file to a non hadoop cluster

0 votes
How do I take an hdfs file information from one cluster and send to non-hadoop cluster where it didn't install Hadoop binaries?
Jul 9, 2019 in Big Data Hadoop by Firoz
148 views

1 answer to this question.

0 votes

There are different ways to do this. I've mentioned a few here:

a) Distcp is one of the best options for data transfer between cluster for HDFS

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.6/bk_Sys_Admin_Guides/content/using_distcp.html

b) Hbase follow below link it has two method.

  • Using Distcp for a full dump
  • SnapShot database for Hbase

c) Hive Metastore, check what type of database using like Mysql, take full export of Mysql database as below.

For full dump, you can use "root" user

mysqldump -u [username]-p [password][dbname]> filename.sql

And if you wish to zip it at the same time:

mysqldump -u [username]-p [password][db]| gzip > filename.sql.gz

You can then move this file between servers with:

scp user@xxx.xxx.xxx.xxx:/path_to_your_dump/filename.sql.gz your_detination_path/

Once copied import the all objects to my sql database and start the hive server 

answered Jul 9, 2019 by Tarun

Related Questions In Big Data Hadoop

0 votes
1 answer
0 votes
2 answers

hadoop copy a local file system folder to HDFS

There's a typo in your command: "hadopp". ...READ MORE

answered Feb 4, 2019 in Big Data Hadoop by Lohith
20,853 views
0 votes
1 answer

How to check the size of a file in Hadoop HDFS?

You can use the  hadoop fs -ls command to ...READ MORE

answered Nov 21, 2018 in Big Data Hadoop by Omkar
• 69,170 points
5,576 views
0 votes
1 answer

How to delete a file from Hadoop hdfs using java?

Try this: FileSystem fs = FileSystem.get(getConf()); fs.delete(new ...READ MORE

answered Nov 28, 2018 in Big Data Hadoop by Omkar
• 69,170 points
3,914 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
7,893 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
1,327 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
62,513 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
2,992 views
0 votes
7 answers

How to run a jar file in hadoop?

I used this command to run my ...READ MORE

answered Dec 10, 2018 in Big Data Hadoop by Dasinto
16,658 views
0 votes
1 answer

How to execute python script in hadoop file system (hdfs)?

If you are simply looking to distribute ...READ MORE

answered Sep 19, 2018 in Big Data Hadoop by digger
• 26,720 points
8,719 views