RE: Unzip huge single entry file throws OutOfMemory

2016-11-24 Thread Siano, Stephan
Hi, The ZipFileDataFormat reads the file content into a byte array, I guess your server goes OOM while doing that. Theoretically it might be possible to extend the component to support streaming if a stream caching is enabled on the route, however someone would have to contribute that to Camel

Re: Unzip huge single entry file throws OutOfMemory

2016-11-24 Thread Claus Ibsen
I think the ZipFileDataFormat was recently improved to use stream caching so it spool to disk for big streams. Ticket is: CAMEL-9274 On Thu, Nov 24, 2016 at 9:44 AM, Siano, Stephan wrote: > Hi, > > The ZipFileDataFormat reads the file content into a byte array, I guess your > server goes OOM wh

RE: Unzip huge single entry file throws OutOfMemory

2016-11-24 Thread Siano, Stephan
Hi Claus, Sorry, I looked into the wrong branch. Starting with Camel 2.17 the change is already there, so if you have Camel 2.17 or later and enable stream caching on your route, you should not go OOM (at least not with the zip file unmarshalling, if there is no more space for a 45 MB byte arra

SFTP via quartz2 , after first call returns only 1 file instead of all files again

2016-11-24 Thread kalber
I have a strange behavior with sftp component launching from crontab; sftp defintition : sftp://www.myhost.it/./path? username=myname &noop=true&sortBy=file:name &include=(VC3|M)[0123456789]* &privateKeyFile=/home/myname/.ssh &scheduler=quartz2&scheduler.cron=0 45,46,47 * * * ? result : 1. call

Passing a file through camel route

2016-11-24 Thread Siddharth Patil
I am using camel 2.15.0 . I want to pass the file through the camel routes. I have two endpoints as server endpoint and client endpoint and want to pass the file from server endpoint to client endpoint. Currently I am able to receive the file at server endpoint, but not able to pass it to the clien

AWS S3 Consumer Bug

2016-11-24 Thread Stan Clowes
Hi I've had a search through the issues but I think this is still a bug. When an object is consumed from an AWS S3 endpoint it doesn't retrieve the userMetadata correctly The code here: https://github.com/apache/camel/blob/master/components/camel-aws/src/main/java/org/apache/camel/component/aws/s

Re: Instead of parallel JMS consumption only sequentially processed

2016-11-24 Thread Claus Ibsen
Set a lower prefetch buffer on ActiveMQ as each consumer polls in 1000 messages by default. On Thu, Nov 24, 2016 at 2:54 PM, Oliver Wulff wrote: > Hi there > > > I've deployed a camel route in Karaf 4.0.3 which is configured to consume > JMS messages in parallel (concurrentConsumers=2, maxConcurr

Re: AWS S3 Consumer Bug

2016-11-24 Thread Claus Ibsen
Hi Yeah I dont think we should call that internal API. You are welcome to log a JIRA ticket (issue tracker). http://camel.apache.org/support.html Also maybe there is more of those ObjectMetadata we can store by default as headers than those 10-15 we do today. Contributions is welcome with a patc

R: Passing a file through camel route

2016-11-24 Thread Andrea Cosentino
What have you tried? Il gio, 24 nov, 2016 alle 16:08, Siddharth Patil ha scritto: I am using camel 2.15.0 . I want to pass the file through the camel routes. I have two endpoints as server endpoint and client endpoint and want to pass the file from server endpoint to client endpoint. Curre

Re: SFTP via quartz2 , after first call returns only 1 file instead of all files again

2016-11-24 Thread Klaus Johansen
Hi, When you set noop=true then camel sets idempotent=true (see http://camel.apache.org/file2.html). Since the file names seems to be the same Camel is not supposed to return any files at all on the 2nd and 3rd run. Did M2001 and M2002 change in regard to size or date/time? You could try to set

Re: Multiple schedulers in apache camel

2016-11-24 Thread Klaus Johansen
Hi, I normally use java DSL but I assume the uri format is the same. Check the uri format: shouldn't it be scheduler=quartz2&scheduler.cron ? Try "&" where you used ";" that is. Regards, Klaus -- View this message in context: http://camel.465427.n5.nabble.com/Multiple-schedulers-in-ap

Parsing unstructured Text in Camel

2016-11-24 Thread Jan Bernhardt
Hi Camel Users, is there any component which helps me to parse plain text? Not JSON, XML or CSV. My use case is that I receive an E-Mail with multiple keywords in the Subject as well as in the body. I could not find any component that would help me to parse certain values from my multiline p