Re: Fetching two files from FTP at the same time

2012-09-21 Thread Claus Ibsen
On Thu, Sep 20, 2012 at 12:55 PM, Bilgin Ibryam wrote: > We don't know the exact frequency yet, but it is definitely more than 2 > seconds, probably up to minute or two, not sure for now. > > hhhmmm, I see it is hard to lock/open more than one file over ftp. > > Then thinking about some tricks, I

Re: Fetching two files from FTP at the same time

2012-09-20 Thread Bilgin Ibryam
We don't know the exact frequency yet, but it is definitely more than 2 seconds, probably up to minute or two, not sure for now. hhhmmm, I see it is hard to lock/open more than one file over ftp. Then thinking about some tricks, I haven't check it yet, but if ftp consumer supports the LastModifie

Re: Fetching two files from FTP at the same time

2012-09-20 Thread Claus Ibsen
On Thu, Sep 20, 2012 at 12:41 PM, Bilgin Ibryam wrote: > Unfortunately we cannot open more than one connection at time, so it is not > possible to have two consumers reading the two (actually now it is three) > files at the same time. > > IMHO this sounds a bit odd/dangerous way of transferring da

Re: Fetching two files from FTP at the same time

2012-09-20 Thread Bilgin Ibryam
Unfortunately we cannot open more than one connection at time, so it is not possible to have two consumers reading the two (actually now it is three) files at the same time. IMHO this sounds a bit odd/dangerous way of transferring data between > parties. > There is no good way to tell if these 2 f

Re: Fetching two files from FTP at the same time

2012-09-19 Thread Claus Ibsen
On Wed, Sep 19, 2012 at 3:27 PM, Bilgin Ibryam wrote: > Hi all, > > I've to fetch two files from an ftp server at the same time and merge them > into one message for further processing. > The merging part is easy by using an aggregator, but is there a way to > ensure that both files are read from

Re: Fetching two files from FTP at the same time

2012-09-19 Thread Christian Müller
The FTP (and file) component fetch one file after the other. If you can distinguish between both files, you could write two routes where each route only consume one file type and send it to the same aggregator. Would that work for you? Best, Christian On Wed, Sep 19, 2012 at 3:27 PM, Bilgin Ibrya