How to decrease load on HBase while importing Sqoop?

0 votes

Hi. I am trying to import data using sqoop import to a table in HBase. I am using the below command to do this:

$ sqoop import <all parameters you are using> --hbase-table <table name>

The problem is that the process is taking too much time and when I researched the reason for this, I found that it could be because there can be more load on HBase. My question is, how can I decrease this load on HBase?

May 16, 2019 in Big Data Hadoop by Suter
69 views

1 answer to this question.

0 votes

Sqoop by default serializes all the input to HBase. I think the load is due to direct writes being made on HBase. But fortunately, sqoop allows us to handle bulk data while import data to HBase. To decrease the load on HBase, use the following command:

$ sqoop import <all parameters you are using> --hbase-table <table name> --hbase-bulkload
answered May 16, 2019 by Yogi

Related Questions In Big Data Hadoop

0 votes
1 answer

Sqoop import failed while importing mysql table to Hbase

There is a spelling mistake in your ...READ MORE

answered Feb 6, 2019 in Big Data Hadoop by Omkar
• 68,840 points
309 views
0 votes
1 answer

How to load multiple tables in Sqoop?

U can use " import-all-tables " option ...READ MORE

answered Feb 18, 2019 in Big Data Hadoop by Omkar
• 68,840 points
505 views
+1 vote
1 answer

Sqoop: How to load all tables except one?

You can use the import-all-tables option and along with ...READ MORE

answered Feb 18, 2019 in Big Data Hadoop by Omkar
• 68,840 points
1,049 views
0 votes
1 answer

How to install HBase on Linux?

To install Hbase, you first need the ...READ MORE

answered Feb 27, 2019 in Big Data Hadoop by Tanisha
633 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,840 points
3,831 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,840 points
521 views
+1 vote
11 answers

hadoop fs -put command?

put syntax: put <localSrc> <dest> copy syntax: copyFr ...READ MORE

answered Dec 7, 2018 in Big Data Hadoop by Aditya
20,271 views
0 votes
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,290 points
1,432 views
0 votes
3 answers

How to change the delimiter in Sqoop?

--fields-terminated-by <char> READ MORE

answered Jun 25, 2019 in Big Data Hadoop by anonymous
2,367 views
0 votes
2 answers

Hey for all, how to get on large data i want use in hadoop?

Hi, To work with Hadoop you can also ...READ MORE

answered Jul 30, 2019 in Big Data Hadoop by Sunny
63 views