Creating testjob in sqoop for incremental load

Question

Hi. Is it possible to create a testjob in sqoop for incremental load? If yes, can someone tell me how to do it?

Answer 1

Yes, it is possible to do so. These are the steps:

1) You need to put the proper hsqldb.jar version in lib directory of sqoop.

Now please download the jar from the link below.

https://drive.google.com/file/d/0B9Cr2tONwth1V3NaZVRoTUpvbkk/view

2) Change the sqoop job command as shown below:

bin/sqoop job --create myjob3 -- import --connect jdbc:mysql://localhost/edureka1 --username root -P --table sqoopjob --incremental append --check-column id --target-dir /sqoopOut26_1 --last-value 1 -m 1

After this, when you execute the sqoop job myjob3, the data will get updated in hdfs.