Comparing 2 files and keeping the unique entries

0 votes

Can someone help me in creating a Job where I can take data from a database table and an excel file, map them to keep only the records unique to the database table and finally load the resultant data into a delimited file? Also, I don’t want any duplicates in my final data. I have tried many ways of doing it but still no success.

Apr 20, 2018 in Talend by misc.edu04
• 1,380 points
90 views

1 answer to this question.

0 votes

Hi,

To get the unique records from the database table you can try the following data flow:

image

Make sure to keep your database input as main flow and the excel iput as a lookup.

Once you are done setting up the components, go to the tMap Editor and perform the following operations:

image

  1. Click on tMap settings of row2 table.

  2. Set the “Match model” and “Join Model” as “Unique Match” and “Inner Join” respectively.

  3. Click on tMap settings of output table.

  4. Set the “Catch look up inner join reject” as “true”

  5. Map the rows from the database incoming flow to the output table

And there you go.

Execute the job, you will get the required output with all unique records.

answered Apr 20, 2018 by geek.erkami
• 2,320 points

Related Questions In Talend

0 votes
1 answer

Looping through all the schemas in Talend

It is really simple to make tOracleInput ...READ MORE

answered Apr 10, 2018 in Talend by code.reaper12
• 3,450 points
94 views
0 votes
1 answer
0 votes
1 answer

Adding third party libraries into the Talend project

You can add the 3rd party libraries ...READ MORE

answered Apr 9, 2018 in Talend by code.reaper12
• 3,450 points
334 views
0 votes
1 answer

Downloading files using Talend Studio

As per my understanding, I think first ...READ MORE

answered Apr 11, 2018 in Talend by code.reaper12
• 3,450 points
238 views
0 votes
2 answers
0 votes
1 answer

tWaitForFile component insufficiency in Talend

Regarding your first issue, tWaitForFile component provides ...READ MORE

answered Apr 10, 2018 in Talend by geek.erkami
• 2,320 points
288 views
0 votes
1 answer

How to load a set of files into database using Talend

Using tFileList component,  you can read all the files present ...READ MORE

answered Apr 16, 2018 in Talend by code.reaper12
• 3,450 points
558 views
0 votes
1 answer