How to fetch more data from database while using Sqoop import

Question

Hi. I am using sqoop import command to import the data from the database. My database is having over 5000 entries but when I try to import, all the data is not getting imported. I am guessing this has something to do with the configuration because the import is not random but same all the time. Is there a way I can import more entries? Or should I just keep appending the table?

Answer 1

Hey. You guessed it right. The max number of entries set to be imported is 1000 so only 1000 entries are getting imported. If you have 5000 entries and want to import it all at once, then you'll have to override the default limit. To override the limit, you can use the fetch-size switch. Below is the syntax example

$ sqoop import <parameters> --fetch-size=<number of entries>