Re: Best Strategy to process a large number of rows in File

Hi Michele Reading a CSV with 40k lines using camel in streaming takes a view seconds. As you limit the queue-size to avoid OOM the entire performance depends how fast you can empty the queue. How long does processing of ONE message take in average? To me it looks like approximately 1.6 secs

Re: Best Strategy to process a large number of rows in File

Sorry Ranx, missed your previous post. From our experience: We ran into OOM troubles with CVS files when converting a row to Map for example. Depending on the number of columns (we have aprox 100+) this can quite easily eat up the entire memory (sure you can always provide

Re: Best Strategy to process a large number of rows in File

To me it looks like the entire CSV file is converted to activemq messages which finally causes the OOM. The same problem exists with Camel SEDA queues as the messages need to be kept in memory until handled. I guess you need to set a queue size limit which blocks your csv sending process if no

aggregation and completionPredicate

Hi Camel Users! I am struggling with aggregation in general and hopefully you can give me a hint: Basically my message body contains a MapString, String. Now I need to aggregate messages to ListMapString, String based on a certain map key value. So lets assume we have message 1: map { key

Re: Desktop applications

Hi Jon, maybe you are asking the wrong question? How is Camel related to an UI Implementation? At the very end your data always ends up in a model which is a main concept of swing, too. So lets assume you have some kind of model classes (regardless if the underlying persistence is in-mem

Re: Fastest Data Holder

if you use JMS than your data will be send as ObjectMessage which makes use of JAVA object serialization thus it's converted to byte stream at some point in time. But this serialization only occurs ones when ActiveMQ sends your message to JMS listeners (regardless if same VM or another one). If

Re: How to aggregate all messages into a single message?

Hi we aggragate all messages having the same key like this: .aggregate(new GroovyExpression(exchange.in.body.InstrumentID), new QuoteAggregationStrategy()) and get a List as result (isStoreAsBodyOnCompletion() returns true). The QuoteAggregationStrategy is required to implement

Re: Running a system command with Camel

Hi Philroc! if camel does not support it out of the box I would try to write my own camel processor (internally using java's ProcessBuilder to call a native application). Jens Am 24.11.13 16:06, schrieb Philippe de Rochambeau: Hello, I would like to pass arguments to a C application