Re: ConsumerTemplate for large number of files

2013-05-24 Thread spilled_beverage
I don't actually just move the files from one folder to another - they are consumed from file (via ConsumerTemplate) but then go to a direct route and a whole host of other stuff happens - I just simplified the example in order to be as clear as possible in my post. My consumer either reads from a

Re: ConsumerTemplate for large number of files

2013-05-24 Thread Claus Ibsen
Hi The file component is intende for being used in routes, where it can work on batches of files. The polling consumer API you do is for a single message at a time, and doesnt work as fast when the component is batch based. So if you really want to move files from one dir to another from java co

Re: ConsumerTemplate for large number of files

2013-05-24 Thread spilled_beverage
Hi Claus, Thanks for the reply (and congratulations on the Camel in Action book - very readable and a great intro to Camel). Setting maxMessagesPerPoll=1 works but slows down the run hugely (from 10 seconds to around 10 minutes in my quick test). Setting it to a higher value (e.g. 500) still work

Re: ConsumerTemplate for large number of files

2013-05-23 Thread Claus Ibsen
Hi Use maxMessagesPerPoll=1 when using the consumer template in the way you do. On Thu, May 23, 2013 at 6:03 PM, spilled_beverage wrote: > I'm consuming from a directory which can contain a large number of files > (currently trying with 1500). > When using a basic route all is fine and all files