How to decrease load on HBase while importing Sqoop?

0 votes

Hi. I am trying to import data using sqoop import to a table in HBase. I am using the below command to do this:

$ sqoop import <all parameters you are using> --hbase-table <table name>

The problem is that the process is taking too much time and when I researched the reason for this, I found that it could be because there can be more load on HBase. My question is, how can I decrease this load on HBase?

May 16 in Big Data Hadoop by Suter
24 views

1 answer to this question.

0 votes

Sqoop by default serializes all the input to HBase. I think the load is due to direct writes being made on HBase. But fortunately, sqoop allows us to handle bulk data while import data to HBase. To decrease the load on HBase, use the following command:

$ sqoop import <all parameters you are using> --hbase-table <table name> --hbase-bulkload
answered May 16 by Yogi

Related Questions In Big Data Hadoop

0 votes
1 answer

Sqoop import failed while importing mysql table to Hbase

There is a spelling mistake in your ...READ MORE

answered Feb 6 in Big Data Hadoop by Omkar
• 67,120 points
107 views
0 votes
1 answer

How to load multiple tables in Sqoop?

U can use " import-all-tables " option ...READ MORE

answered Feb 18 in Big Data Hadoop by Omkar
• 67,120 points
157 views
0 votes
1 answer

Sqoop: How to load all tables except one?

You can use the import-all-tables option and along with ...READ MORE

answered Feb 18 in Big Data Hadoop by Omkar
• 67,120 points
261 views
0 votes
1 answer

How to install HBase on Linux?

To install Hbase, you first need the ...READ MORE

answered Feb 27 in Big Data Hadoop by Tanisha
139 views
0 votes
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,070 points
2,040 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,070 points
192 views
0 votes
10 answers

hadoop fs -put command?

copy command can be used to copy files ...READ MORE

answered Dec 7, 2018 in Big Data Hadoop by Sujay
10,407 views
0 votes
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,240 points
762 views
0 votes
1 answer

How to load data from HDFS into pig relation?

Hey, To load data from HDFS to pig ...READ MORE

answered May 7 in Big Data Hadoop by Gitika
• 19,720 points
21 views
0 votes
1 answer

How to check your file is created on HDFS?

Hey,  There is a process or steps you ...READ MORE

answered May 7 in Big Data Hadoop by Gitika
• 19,720 points
19 views