Doubt regarding sqoop updated data

0 votes

Suppose we have an Employee table in Mysql, we do incremental loading on a daily basis. Now suppose in MySql we have updated salary of few employees, after incremental loading via sqoop how does the data gets updated in the already uploading data?

Feb 14, 2019 in Big Data Hadoop by Nutini
120 views

1 answer to this question.

0 votes
Incremental append or load in sqoop will not actually update the same file infact it will create a new file inside the same table withe the updated data. Like in your case update happens on daily basis so for a month there will be 30 files inside table.

eg part-00000

part-00001

.

.

.

part-00030
answered Feb 14, 2019 by Omkar
• 69,150 points

Related Questions In Big Data Hadoop

0 votes
1 answer

How to transfer data from Netezza to HDFS using Apache Sqoop?

Remove the --direct option. It gives issue ...READ MORE

answered Apr 23, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
956 views
0 votes
1 answer
0 votes
1 answer

Synchronizing sqoop imported data in HDFS

Data can be synchronised using incremental parameter ...READ MORE

answered Jul 19, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
540 views
+1 vote
1 answer

What is the process to perform an incremental data load in Sqoop?

The process to perform incremental data load ...READ MORE

answered Dec 17, 2018 in Big Data Hadoop by Frankie
• 9,810 points
2,697 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
7,804 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
1,298 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
60,808 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
2,940 views
0 votes
1 answer

Doubt regarding --last-value in sqoop while importing.

I think you are a little confused. ...READ MORE

answered Feb 19, 2019 in Big Data Hadoop by Omkar
• 69,150 points
652 views
0 votes
1 answer

How to securely transfer data from rdms to hdfs using sqoop?

Sqoop stores metadata in a repository and ...READ MORE

answered Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,150 points
552 views