How to load a set of files into database using Talend

0 votes

I have a set of delimited files stored in a particular directory. Now I want to read all these files at once and then load them into a database. Does Talend provide any specific component to deal with this or do we need to create any specific job?

 Can anyone suggest me how can I perform this?

Apr 17, 2018 in Talend by anto.trigg4
• 3,440 points
5,669 views

1 answer to this question.

+1 vote

Using tFileList component,  you can read all the files present in the specified directory. In the component tab of tFileList, you can specify the directory name and the file mask using which Talend will browse through the files matching the pattern. To read through each and every file in the directory you need to make use of an “iterate” link and connect it to a tFileInputDelimited component. 

In the component tab of tFileInputDelimited component, specify the file name using the tFileList current file expression. Something like: ((String)globalMap.get("tFileList_1_CURRENT_FILE"))

You can find this expression from the outline window in the Talend Open Studio.

Then from the tFileInputDelimited component take a Row Main link and connect to the database output component in order to load it to the tMysqlOutput component. Since you want all of your data in a single table, you can leave the action as default, which will automatically append all the data.

Hope this helps!

To know more about Talend, join Talend for big data certification training today.

Thanks.

answered Apr 17, 2018 by code.reaper12
• 3,500 points
Hi,

 I have a similar requirement to load to data in different tables. Please help me

Related Questions In Talend

0 votes
0 answers

How can I use talend to extract data from Oracle and import the data into a MSSQL database?

We currently have around 100 Oracle tables ...READ MORE

Nov 4, 2020 in Talend by umesh
• 150 points
2,157 views
0 votes
1 answer

How to generate multiple rows from a single row in Talend?

I think using tJavaFlex, tMap and tFlowToIterate ...READ MORE

answered Apr 18, 2018 in Talend by code.reaper12
• 3,500 points
7,252 views
0 votes
0 answers

how to read .dbf files in talend 2020 ?

hi , i am new in talend ...READ MORE

Dec 2, 2020 in Talend by aminegac
• 570 points
1,426 views
0 votes
1 answer
0 votes
1 answer

tWaitForFile component insufficiency in Talend

Regarding your first issue, tWaitForFile component provides ...READ MORE

answered Apr 11, 2018 in Talend by geek.erkami
• 2,680 points
2,149 views
+1 vote
1 answer
0 votes
2 answers

Closed loop in Talend

Hi, Talend specifies that tUnite cannot be ...READ MORE

answered Aug 23, 2019 in Talend by vinceall
1,867 views
0 votes
1 answer

Connecting tJIRAOutput component using Talend

Your entire configuration is correct apart from ...READ MORE

answered Apr 19, 2018 in Talend by geek.erkami
• 2,680 points
1,028 views
0 votes
1 answer
0 votes
2 answers
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP