How to load a set of files into database using Talend

0 votes

I have a set of delimited files stored in a particular directory. Now I want to read all these files at once and then load them into a database. Does Talend provide any specific component to deal with this or do we need to create any specific job?

 Can anyone suggest me how can I perform this?

Apr 16, 2018 in Talend by anto.trigg4
• 3,420 points
381 views

1 answer to this question.

Your answer

Your name to display (optional):
Privacy: Your email address will only be used for sending these notifications.
0 votes

Using tFileList component,  you can read all the files present in the specified directory. In the component tab of tFileList, you can specify the directory name and the file mask using which Talend will browse through the files matching the pattern. To read through each and every file in the directory you need to make use of an “iterate” link and connect it to a tFileInputDelimited component. 

In the component tab of tFileInputDelimited component, specify the file name using the tFileList current file expression. Something like: ((String)globalMap.get("tFileList_1_CURRENT_FILE"))

You can find this expression from the outline window in the Talend Open Studio.

Then from the tFileInputDelimited component take a Row Main link and connect to the database output component in order to load it to the tMysqlOutput component. Since you want all of your data in a single table, you can leave the action as default, which will automatically append all the data.

answered Apr 16, 2018 by code.reaper12
• 3,450 points
Hi,

 I have a similar requirement to load to data in different tables. Please help me

Related Questions In Talend

0 votes
1 answer

How to generate multiple rows from a single row in Talend?

I think using tJavaFlex, tMap and tFlowToIterate ...READ MORE

answered Apr 18, 2018 in Talend by code.reaper12
• 3,450 points
800 views
0 votes
1 answer
0 votes
1 answer

Downloading files using Talend Studio

As per my understanding, I think first ...READ MORE

answered Apr 11, 2018 in Talend by code.reaper12
• 3,450 points
169 views
0 votes
1 answer

Using tHiveRow to execute multiple Hive queries in Talend

In order to execute multiple queries, you ...READ MORE

answered Apr 14, 2018 in Talend by misc.edu04
• 1,380 points
527 views
0 votes
1 answer

tWaitForFile component insufficiency in Talend

Regarding your first issue, tWaitForFile component provides ...READ MORE

answered Apr 10, 2018 in Talend by geek.erkami
• 2,320 points
193 views
0 votes
1 answer
0 votes
1 answer

Closed loop in Talend

As you might know,  in Talend all ...READ MORE

answered Apr 19, 2018 in Talend by code.reaper12
• 3,450 points
238 views
0 votes
1 answer

Connecting tJIRAOutput component using Talend

Your entire configuration is correct apart from ...READ MORE

answered Apr 19, 2018 in Talend by geek.erkami
• 2,320 points
106 views
0 votes
1 answer
0 votes
2 answers

© 2018 Brain4ce Education Solutions Pvt. Ltd. All rights Reserved.
"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.