Comparing 2 files and keeping the unique entries

0 votes

Can someone help me in creating a Job where I can take data from a database table and an excel file, map them to keep only the records unique to the database table and finally load the resultant data into a delimited file? Also, I don’t want any duplicates in my final data. I have tried many ways of doing it but still no success.

Apr 20, 2018 in Talend by misc.edu04
• 1,440 points
687 views

1 answer to this question.

0 votes

Hi,

To get the unique records from the database table you can try the following data flow:

image

Make sure to keep your database input as main flow and the excel iput as a lookup.

Once you are done setting up the components, go to the tMap Editor and perform the following operations:

image

  1. Click on tMap settings of row2 table.

  2. Set the “Match model” and “Join Model” as “Unique Match” and “Inner Join” respectively.

  3. Click on tMap settings of output table.

  4. Set the “Catch look up inner join reject” as “true”

  5. Map the rows from the database incoming flow to the output table

And there you go.

Execute the job, you will get the required output with all unique records.

answered Apr 20, 2018 by geek.erkami
• 2,680 points

Related Questions In Talend

0 votes
0 answers

How can I use talend to extract data from Oracle and import the data into a MSSQL database?

We currently have around 100 Oracle tables ...READ MORE

Nov 4, 2020 in Talend by umesh
• 150 points
293 views
0 votes
1 answer

Looping through all the schemas in Talend

It is really simple to make tOracleInput ...READ MORE

answered Apr 10, 2018 in Talend by code.reaper12
• 3,500 points
706 views
0 votes
1 answer
0 votes
1 answer

Adding third party libraries into the Talend project

You can add the 3rd party libraries ...READ MORE

answered Apr 9, 2018 in Talend by code.reaper12
• 3,500 points
1,401 views
0 votes
2 answers
0 votes
1 answer

tWaitForFile component insufficiency in Talend

Regarding your first issue, tWaitForFile component provides ...READ MORE

answered Apr 10, 2018 in Talend by geek.erkami
• 2,680 points
976 views
0 votes
1 answer

How to load a set of files into database using Talend

Using tFileList component,  you can read all the files present ...READ MORE

answered Apr 16, 2018 in Talend by code.reaper12
• 3,500 points
2,427 views
0 votes
1 answer