TarAggregationStrategy - /tmp directory is full !!

Hello, I'm using TarAggregationStrategy for create tar.gz file. BUT, I found TarAggregationStrategy don't delete /tmp directory files. Is there any way to make sure TarAggregationStrategy delete temp file ?? Or other way to create tar.gz file?

Re: how to hold temporary data to use later.....

Thanks Quinn I didn't know camel support repository. I'll try it. -- View this message in context: http://camel.465427.n5.nabble.com/how-to-hold-temporary-data-to-use-later-tp5781121p5781301.html Sent from the Camel - Users mailing list archive at Nabble.com.

Re: Best Strategy to process a large number of rows in File

Hi, I have different mediations. Each mediation handles an incoming file type (csv, txt delimited or fixed length) during the prorcessing. In same csv and txt file Tokenizer works fine with \n or \r\n or \r. Few minutes ago, I found solution for a txt delimited file adding a charset=iso-8859-1 op

Re: Camel Http Component

I have solved the mentioned issue using http component and Rest @RequestBody, *Route:* ${body} application/json; charset=UTF-8 ${body} *My service will be like,* @RequestMapping(value="/service",consumes="application/json", method = {RequestMethod.POST, RequestMethod.GET}) public @Respons

Loop through the files from FTP server and process

I am very new to Apache Camel. My use case is to process all files on FTP server on a date folder, one file at a time. Could someone give some pointers using Spring XML? ftp://"; />

Re: Best Strategy to process a large number of rows in File

If that doesn't work for you there is another way I use when I have to read complex files that aren't simple one line = one record but it isn't really necessary if you are simply reading in a CSV or fixed width file with only single lines. I don't know what your record format or Beanio looks like

Re: Best Strategy to process a large number of rows in File

The tokenization may require a different line ending - \r or \n or \r\n for example. The file reader has to understand what it is parsing. I take it when you use that splitter it with the tokenization it was reading the whole file in one big slurp and never finding a line ending and you ended up

Re: Camel Large File Processing Issues

Wilson -- That's what I was trying to point out in my rudimentary explanation in the post above yours. I'm wiring the two routes up as we speak. I'm just curious as to why the original FTP route doesn't do the exact same thing? If I specify a localWorkDirectory and streamDownload, shouldn't th

Kafak endpoint, Sending to multiple, configurable topics

Hi, We have the following need, we have an XML DSL (spring) and properties configuration files. We need to send files to different topics depending on their names. This has to be configurable (mapping between a pattern and a topic). The number of patterns as well as the number of topics is unkn

RE: Camel kafka multiple consumer question

Got the issue. Producer posted all data in one partition out of 20 and first consumer when started acquired that partition and other consumer waited for data to come on rest of partitions. -Original Message- From: Vanshul.Chawla [mailto:vanshul.cha...@target.com] Sent: Monday, April 18,

Camel kafka multiple consumer question

Hello All, We have kafka consumers running on multiple servers(4 servers). autoOffsetReset is set as smallest. Issue is only one server picks the data and other 3 remain idle. Has anyone faced the same issue anytime or is there some setting which we need to do so that all consumers get the dat

Multicast and aggregate exception propagation

Hello, I have a route that looks something like this (simplified): from("direct:start") .multicast() .to("direct:route-1", "direct:route-2", "direct:route-3") .end() .to("direct:end"); from("direct:route-1") // Processing .multicast() .to("direct:route-1-1", "direct:route-1-2"); from("direct:ro

Re: Camel Large File Processing Issues

no, the 2 route setup should be more like this. from(ftp_endpoint).to(file://) this will download the file to directory of your choice then another route would be a directory monitor via file component from("file:?delete=true") .process ... this will start the file process when the download

Re: File component: process a file only if a condition is satisfied

On Mon, Apr 18, 2016 at 1:35 PM, Nicolas74 wrote: > Hi Claus, > > Ok, but there is no way to do it with Spring DSL ? > No that is not possible > Best, > Nicolas > > > > -- > View this message in context: > http://camel.465427.n5.nabble.com/File-component-process-a-file-only-if-a-condition-is-s

Re: File component: process a file only if a condition is satisfied

Hi Claus, Ok, but there is no way to do it with Spring DSL ? Best, Nicolas -- View this message in context: http://camel.465427.n5.nabble.com/File-component-process-a-file-only-if-a-condition-is-satisfied-tp5781254p5781256.html Sent from the Camel - Users mailing list archive at Nabble.com.

Re: File component: process a file only if a condition is satisfied

Use the filter option on the file endpoint to let the filter be part of the consumer. See more details in the docs http://camel.apache.org/file2 eg implemenet GenericFileFilter and write your logic, and configure it on the endpoint. On Mon, Apr 18, 2016 at 12:27 PM, Nicolas74 wrote: > Hello guy

File component: process a file only if a condition is satisfied

Hello guys, I would like to consume a file ONLY if a condition is satisfied. If the condition is not yet satisfied, the file is not consumed until the condition is satisfied. I created this route: The problem is, even if my condition is not satisfied, the file seems to be consumed and is moved

Re: Best Strategy to process a large number of rows in File

Hi Brad, first of all thank you very much for the time you dedicate me. Are you getting the entire file in memory? I think so. I thought BeanIO worked in lazy mode... A question, I noticed that in some file Splitter doesn't work with but It required a convertBodyTo type="j

Re: Camel Large File Processing Issues

Yes I read that and understand how to do it. But If I do the FTP with a localWorkingDirectory, once the route ends, doesn't the file get removed? So Shouldn't it be: from(ftp_endpoint).to(local_file) Then Have another route started up from(local_file).split().process().to(kafka_endpoint) Th

Re: Sending Query Parameters under Exchange.HTTP_QUERY & in URI for HTTP4 component

I asked this in stack overflow as well. But no response there as well. http://stackoverflow.com/q/36649702/785523 On Sun, Apr 17, 2016 at 6:23 PM, Debraj Manna wrote: > Hi , > > Can some one please point me to some doc where this is explained? I have > seen the http4

Re: Camel Large File Processing Issues

Use streamDownload with localWorkDirectory to store it to a temporary file. eg read the docs http://camel.apache.org/ftp2 On Mon, Apr 18, 2016 at 9:03 AM, Claus Ibsen wrote: > Use streamDownload for the FTP or maybe split up into 2 routes > > from ftp -> file > from file -> split > > And if usin

Re: Camel Large File Processing Issues

Looks like I'm going to have to split this into two routes. Using streamDownload=true doesn't really change it. So it looks like I'm going to have to: 1.) Get the file from the FTP Endpoint and store it locally (Route 1) 2.) Stream in the local File and split it (Route 2) Question is: How d

Re: How to log a Processor ERROR with stacktrace using DeadLetterChannel?

ok, I got it working now. Thanks. What I did was simply adding an empty inside the tag. It is a bit counter intuitive though that this changes the behaivor, since all I do is add a redeliveryPolicy with no special configuration. Logically thinking, the result should be the same as the defaul

Re: Camel Large File Processing Issues

Use streamDownload for the FTP or maybe split up into 2 routes from ftp -> file from file -> split And if using 2 routes then use done file name or write using temp file name so the file consumer only pickup the file when its fully downloaded from ftp. On Mon, Apr 18, 2016 at 8:36 AM, h0mer wro