How to decrease load on HBase while importing Sqoop?

0 votes

Hi. I am trying to import data using sqoop import to a table in HBase. I am using the below command to do this:

$ sqoop import <all parameters you are using> --hbase-table <table name>

The problem is that the process is taking too much time and when I researched the reason for this, I found that it could be because there can be more load on HBase. My question is, how can I decrease this load on HBase?

May 16 in Big Data Hadoop by Suter
27 views

1 answer to this question.

0 votes

Sqoop by default serializes all the input to HBase. I think the load is due to direct writes being made on HBase. But fortunately, sqoop allows us to handle bulk data while import data to HBase. To decrease the load on HBase, use the following command:

$ sqoop import <all parameters you are using> --hbase-table <table name> --hbase-bulkload
answered May 16 by Yogi

Related Questions In Big Data Hadoop

0 votes
1 answer

Sqoop import failed while importing mysql table to Hbase

There is a spelling mistake in your ...READ MORE

answered Feb 6 in Big Data Hadoop by Omkar
• 67,290 points
139 views
0 votes
1 answer

How to load multiple tables in Sqoop?

U can use " import-all-tables " option ...READ MORE

answered Feb 18 in Big Data Hadoop by Omkar
• 67,290 points
214 views
0 votes
1 answer

Sqoop: How to load all tables except one?

You can use the import-all-tables option and along with ...READ MORE

answered Feb 18 in Big Data Hadoop by Omkar
• 67,290 points
392 views
0 votes
1 answer

How to install HBase on Linux?

To install Hbase, you first need the ...READ MORE

answered Feb 27 in Big Data Hadoop by Tanisha
207 views
0 votes
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,490 points
2,327 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,490 points
237 views
0 votes
10 answers

hadoop fs -put command?

put syntax: put <localSrc> <dest> copy syntax: copyFr ...READ MORE

answered Dec 7, 2018 in Big Data Hadoop by Aditya
11,974 views
0 votes
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,240 points
882 views
0 votes
3 answers

How to change the delimiter in Sqoop?

--fields-terminated-by <char> READ MORE

answered Jun 25 in Big Data Hadoop by anonymous
1,040 views
0 votes
2 answers

Hey for all, how to get on large data i want use in hadoop?

Hi, To work with Hadoop you can also ...READ MORE

answered Jul 30 in Big Data Hadoop by Sunny
39 views