How to decrease load on HBase while importing Sqoop

0 votes

Hi. I am trying to import data using sqoop import to a table in HBase. I am using the below command to do this:

$ sqoop import <all parameters you are using> --hbase-table <table name>

The problem is that the process is taking too much time and when I researched the reason for this, I found that it could be because there can be more load on HBase. My question is, how can I decrease this load on HBase?

May 16, 2019 in Big Data Hadoop by Suter
865 views

1 answer to this question.

0 votes

Sqoop by default serializes all the input to HBase. I think the load is due to direct writes being made on HBase. But fortunately, sqoop allows us to handle bulk data while import data to HBase. To decrease the load on HBase, use the following command:

$ sqoop import <all parameters you are using> --hbase-table <table name> --hbase-bulkload
answered May 16, 2019 by Yogi

Related Questions In Big Data Hadoop

0 votes
1 answer

Sqoop import failed while importing mysql table to Hbase

There is a spelling mistake in your ...READ MORE

answered Feb 7, 2019 in Big Data Hadoop by Omkar
• 69,230 points
1,625 views
0 votes
1 answer

How to load multiple tables in Sqoop?

U can use " import-all-tables " option ...READ MORE

answered Feb 18, 2019 in Big Data Hadoop by Omkar
• 69,230 points
2,110 views
+1 vote
1 answer

Sqoop: How to load all tables except one?

You can use the import-all-tables option and along with ...READ MORE

answered Feb 18, 2019 in Big Data Hadoop by Omkar
• 69,230 points
7,480 views
0 votes
1 answer

How to install HBase on Linux?

To install Hbase, you first need the ...READ MORE

answered Feb 27, 2019 in Big Data Hadoop by Tanisha
4,793 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
10,931 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
2,458 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
108,354 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
4,551 views
0 votes
3 answers

How to change the delimiter in Sqoop?

--fields-terminated-by <char> READ MORE

answered Jun 25, 2019 in Big Data Hadoop by anonymous
10,477 views
0 votes
2 answers

Hey for all, how to get on large data i want use in hadoop?

Hi, To work with Hadoop you can also ...READ MORE

answered Jul 30, 2019 in Big Data Hadoop by Sunny
1,117 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP