How to load a set of files into database using Talend

0 votes

I have a set of delimited files stored in a particular directory. Now I want to read all these files at once and then load them into a database. Does Talend provide any specific component to deal with this or do we need to create any specific job?

 Can anyone suggest me how can I perform this?

Apr 16, 2018 in Talend by anto.trigg4
• 3,420 points
501 views

1 answer to this question.

0 votes

Using tFileList component,  you can read all the files present in the specified directory. In the component tab of tFileList, you can specify the directory name and the file mask using which Talend will browse through the files matching the pattern. To read through each and every file in the directory you need to make use of an “iterate” link and connect it to a tFileInputDelimited component. 

In the component tab of tFileInputDelimited component, specify the file name using the tFileList current file expression. Something like: ((String)globalMap.get("tFileList_1_CURRENT_FILE"))

You can find this expression from the outline window in the Talend Open Studio.

Then from the tFileInputDelimited component take a Row Main link and connect to the database output component in order to load it to the tMysqlOutput component. Since you want all of your data in a single table, you can leave the action as default, which will automatically append all the data.

answered Apr 16, 2018 by code.reaper12
• 3,450 points
Hi,

 I have a similar requirement to load to data in different tables. Please help me

Related Questions In Talend

0 votes
1 answer

How to generate multiple rows from a single row in Talend?

I think using tJavaFlex, tMap and tFlowToIterate ...READ MORE

answered Apr 18, 2018 in Talend by code.reaper12
• 3,450 points
1,087 views
0 votes
1 answer
0 votes
1 answer

Downloading files using Talend Studio

As per my understanding, I think first ...READ MORE

answered Apr 11, 2018 in Talend by code.reaper12
• 3,450 points
215 views
0 votes
1 answer

Using tHiveRow to execute multiple Hive queries in Talend

In order to execute multiple queries, you ...READ MORE

answered Apr 14, 2018 in Talend by misc.edu04
• 1,380 points
652 views
0 votes
1 answer

tWaitForFile component insufficiency in Talend

Regarding your first issue, tWaitForFile component provides ...READ MORE

answered Apr 10, 2018 in Talend by geek.erkami
• 2,320 points
265 views
0 votes
1 answer
0 votes
2 answers

Closed loop in Talend

Hi, Talend specifies that tUnite cannot be ...READ MORE

answered 3 days ago in Talend by vinceall
289 views
0 votes
1 answer

Connecting tJIRAOutput component using Talend

Your entire configuration is correct apart from ...READ MORE

answered Apr 19, 2018 in Talend by geek.erkami
• 2,320 points
129 views
0 votes
1 answer
0 votes
2 answers