Re: OOMs with Dropbox Camel module

2016-11-17 Thread Edoardo Causarano
Hi there, I've done some work on this but I'd like to know a couple things now: Should I branch from master and you take care of cherry picking? What language level should I use? Can I go with Java8? Does it need to be 100% backwards compatible with the existing component? Some of the headers in

Re: OOMs with Dropbox Camel module

2016-11-10 Thread Claus Ibsen
Hi Yeah you can take a look at how some of the dataformats does that as they have out of bands streaming support with Camel's stream caching http://camel.apache.org/stream-caching.html We love contributions, so you are very welcome to look into this and provide a PR / patch. And to log a JIRA tic

OOMs with Dropbox Camel module

2016-11-10 Thread Edoardo Causarano
Hi all, just moved code from dev to testing and found that in real-life the DropBox component blows apart in OOMs. Seems that it’s using plain BAOS (sic) to buffer remote data which is not a particularly good idea when you have no idea how big the files will be (or you’re pretty certain they’re