On 03/09/2012 19:54, Vincent Nonnenmacher wrote:
one way could be to not use idempotent and implement a filter that return true
or false on the modification date of the underlying file and handle a water
mark so you know that any file with such date after the mark is selected.
Yes, maybe, but that means you need to stat the remote file first, not
download it. AFAIK its completely different process to what I'm
currently trying to do.
Maybe it can be made to.
On other could be to implement your own
org.apache.camel.spi.IdempotentRepository object that would delegate to one of
the current Memory or File based one, but overrides the contains(key) to return
false for any given entry that is already present (processed) but which
'modification date' is after your 'water mark'.
Sounds better. The IdempotentRepository would need to handle
modification time and file size as well to do this properly, and the
interface doesn't support this:
http://camel.apache.org/maven/current/camel-core/apidocs/org/apache/camel/spi/IdempotentRepository.html
as it only takes a single param, and that's the file path. How does file
size and modification time get passed?
It seems I'm being really stupid here, but it feels like I'm trying to
re-invent a wheel that's been invented before plenty of times.
Tim
On Mon, Sep 3, 2012 at 6:31 PM, Tim Dudgeon <tdudgeon...@gmail.com> wrote:
Hi, I'm new to Camel, so please excuse my ignorance.
I'm wanting to set up mirroring of files on a FTP server, so that whenever
new files appear, or old files get changed, they get copied to the local
mirror, and maybe some processing performed on them.
I've worked out the basics of how to use the FTP and File components, and am
now wondering how to actually set this up to do what I want. I got the
idempotentRepository working (using a FileIdempotentRepository) to make sure
that files are only processed once, but then realised that this isn't going to
allow updated files to be re-fetched.
Is there an already baked approach to doing this, or do I need to cook my
own?
Tim
--
View this message in context:
http://camel.465427.n5.nabble.com/Advice-on-mirroring-using-FTP2-component-tp5718557.html
Sent from the Camel - Users mailing list archive at Nabble.com.
