Update new sql data in sqoop

0 votes
Hi. I need some help with Sqoop. I had created an Sql table and imported it in Sqoop. Now I updated the MySql table and want to update the data in Sqoop also. But I don't want to use import because it will import the whole database which will take time. How can I update the new data?
Feb 11 in Big Data Hadoop by Jishan
90 views

1 answer to this question.

0 votes

You can use incremental for this. When you incremental import, only the new data or updated data in the Sql table will updated in Sqoop. 

Here's an example command to use incremental import: 

sqoop import --connect jdbc:mysql://localhost/sampl --username root -P --table stu --hbase-table student --column-family details --hbase-row-key id --incremental append --check-column id --last-value 5 -m 1
answered Feb 11 by Omkar
• 67,660 points

Related Questions In Big Data Hadoop

0 votes
1 answer

Synchronizing sqoop imported data in HDFS

Data can be synchronised using incremental parameter ...READ MORE

answered Jul 19, 2018 in Big Data Hadoop by kurt_cobain
• 9,260 points
133 views
+1 vote
1 answer

What is the process to perform an incremental data load in Sqoop?

The process to perform incremental data load ...READ MORE

answered Dec 17, 2018 in Big Data Hadoop by Frankie
• 9,810 points
470 views
0 votes
1 answer

How to import data in sqoop as a Parquet file?

Sqoop allows you to import the file ...READ MORE

answered May 15 in Big Data Hadoop by Nanda
593 views
0 votes
1 answer

How to use data compression in sqoop import?

You can enable data compression from the ...READ MORE

answered May 15 in Big Data Hadoop by Rocky
187 views
0 votes
1 answer

Not able to start MySql service

Hello. "The system never lies :-P".  The service ...READ MORE

answered Dec 26, 2018 in Big Data Hadoop by Omkar
• 67,660 points
48 views
0 votes
1 answer

Sqoop transfer file from MySql to HBase

Sqoop doesn’t permit you to import, all ...READ MORE

answered Feb 11 in Big Data Hadoop by Omkar
• 67,660 points
172 views
0 votes
1 answer

Using Hadoop for Data Analytics.

Yes, your approach is correct - you ...READ MORE

answered Sep 28, 2018 in Big Data Hadoop by Frankie
• 9,810 points
42 views
0 votes
1 answer

Update hdfs data before stroring in MySql

Yes, you can update the data before ...READ MORE

answered Jan 27 in Big Data Hadoop by Omkar
• 67,660 points
35 views
0 votes
1 answer

Hadoop Hive: How to insert data in Hive table?

First, copy data into HDFS. Then create ...READ MORE

answered Nov 12, 2018 in Big Data Hadoop by Omkar
• 67,660 points
1,392 views