Please suggest how can I read the files from a directory which are added dynamically by a producer process using Talend tWaitForFile component. While I was trying to perform this, I was facing following two issues:
1. tWaitForFile component can read the files which are already present in the directory, so the files added dynamically after the job has started, remains invisible to it.
2. There is also a possibility that Talend starts reading the files, even before producer process has finished writing the files. I am not able to confirm it as _wait_release_ parameter of the tWaitForFile is not working on the Linux system.