Implement Common Logging in Talend

0 votes

I am trying to implement a common logging component which is pluggable to any job for catching logs.

With this use case in mind, I have created two jobs where I am segregating the logs into two files (debug & error).

The first job contains a tRowGenerator component which will generate lines and then forward them to the tMap component. From tMap, I have linked two tWarn components that will generate warnings based on some conditions.  

My second job contains tLogCatcher and tFilterRow components which will help in segregating the input files based on the provided conditions.

I am trying to execute both the jobs in parallel to catch the logs, but it seems like it is not the way it should be done.

Please give me any idea how to perform this? 

Apr 11, 2018 in Talend by misc.edu04
• 1,420 points
164 views

1 answer to this question.

0 votes

Well, you can try using following 2 ways:

1.  Creating Joblet: If you want to stick to your current job, then I think you can try creating a Joblet. But, it's not a good practice to use the same file from multiple jobs as it may lead to errors. This will only work perfectly with a job that produces multiple files.

2.  Using log4j in enterprise version: the enterprise version of Talend studio has built-in log4j. With this, you can set the debugging level inside your tWarn or tDie components itself. Then you can configure the tlog4j to transfer the logs into specified files.

Hope these help.

answered Apr 11, 2018 by geek.erkami
• 2,640 points

Related Questions In Talend

0 votes
1 answer

Parsing JSON in Talend

While working with JSON files, one thing ...READ MORE

answered Apr 2, 2018 in Talend by code.reaper12
• 3,450 points
558 views
0 votes
1 answer
0 votes
2 answers
0 votes
1 answer

Converting Columns into Rows in Talend

Hi, You can try using tNormalize component along ...READ MORE

answered Apr 10, 2018 in Talend by code.reaper12
• 3,450 points

edited Apr 10, 2018 by code.reaper12 795 views
0 votes
1 answer

Looping through all the schemas in Talend

It is really simple to make tOracleInput ...READ MORE

answered Apr 10, 2018 in Talend by code.reaper12
• 3,450 points
127 views
0 votes
1 answer

Adding third party libraries into the Talend project

You can add the 3rd party libraries ...READ MORE

answered Apr 9, 2018 in Talend by code.reaper12
• 3,450 points
416 views
0 votes
1 answer

Downloading files using Talend Studio

As per my understanding, I think first ...READ MORE

answered Apr 11, 2018 in Talend by code.reaper12
• 3,450 points
287 views
0 votes
1 answer

Using tHiveRow to execute multiple Hive queries in Talend

In order to execute multiple queries, you ...READ MORE

answered Apr 14, 2018 in Talend by misc.edu04
• 1,420 points
835 views
0 votes
1 answer

tWaitForFile component insufficiency in Talend

Regarding your first issue, tWaitForFile component provides ...READ MORE

answered Apr 10, 2018 in Talend by geek.erkami
• 2,640 points
347 views
0 votes
1 answer

Using Java Classes in Talend

While working with routines, the very 1st ...READ MORE

answered Apr 14, 2018 in Talend by geek.erkami
• 2,640 points
448 views