Re: [Dev] [Siddhi-file-io] Consuming multiple files in a directory with tailing enabled.

2017-07-01 Thread Minudika Malshan
Hi, +1 for introducing *trp:file.name * property. I will add it to the extension. BR On Sat, Jul 1, 2017 at 3:19 PM, Sriskandarajah Suhothayan wrote: > +1, And I also like Dilini's idea of using the transport properties, > So for the behaviour you mentioned, add the trp:file.

Re: [Dev] [Siddhi-file-io] Consuming multiple files in a directory with tailing enabled.

2017-07-01 Thread Sriskandarajah Suhothayan
+1, And I also like Dilini's idea of using the transport properties, So for the behaviour you mentioned, add the trp:file.name property to inform the user what file is currently being read. This will be very useful for non-file tailing scenarios. On Sat, Jul 1, 2017 at 3:12 PM, Minudika Malshan w

Re: [Dev] [Siddhi-file-io] Consuming multiple files in a directory with tailing enabled.

2017-07-01 Thread Minudika Malshan
Hi, For the initial implementation, we have decided to implement it as below, When tailing is enabled, - A single file can be pointed out using the uri and it will be consumed and tailed. - If the uri points out a directory, the first file (when files are sorted in alphabetical asce

Re: [Dev] [Siddhi-file-io] Consuming multiple files in a directory with tailing enabled.

2017-06-28 Thread Dilini Muthumala
Hi, If the user wants to find out which file the event came from (if there is a use case as such), then he can create separate sources for each file. Some problems with above approach would be: - if the user does not know the file names before hand, above is not a solution - when there are many f

[Dev] [Siddhi-file-io] Consuming multiple files in a directory with tailing enabled.

2017-06-28 Thread Minudika Malshan
Hi all, In proposed Sindhi-io-file : source, the user will be providing a uri of a directory mentioning that tailing enabled or not. If tailing is enabled, all the files will be consumed and the connection will be kept alive in order to check whether a new record added to the file later. In this