Re: Large file processing with Apache Camel

2013-02-28 Thread Christian Müller
", but this code belongs to another line 100% sure. So > I should control the synchronization process by myself, right? > > > > -- > View this message in context: > http://camel.465427.n5.nabble.com/Large-file-processing-with-Apache-Camel-tp5727977p5728292.html > Sent from the Camel - Users mailing list archive at Nabble.com. > --

Re: Large file processing with Apache Camel

2013-02-28 Thread Claus Ibsen
If you run in parallel processing mode, then the lines can be processed out of order and concurrently. Also your custom processor will be invoked concurrently by multiple threads as they process the lines in parallel. So you have to write your code in a thread safe manner, if you want to access shared

Re: Large file processing with Apache Camel

2013-02-28 Thread cristisor
de "1234" but "1235", but this code belongs to another line 100% sure. So I should control the synchronization process by myself, right? -- View this message in context: http://camel.465427.n5.nabble.com/Large-file-processing-with-Apache-Camel-tp5727977p5728292.html Sent from the Camel - Users mailing list archive at Nabble.com.

Re: Large file processing with Apache Camel

2013-02-22 Thread Hadrian Zbarcea
7.n5.nabble.com/Large-file-processing-with-Apache-Camel-tp5727977p5728045.html Sent from the Camel - Users mailing list archive at Nabble.com.

Re: Large file processing with Apache Camel

2013-02-22 Thread cristisor
process Sorry for so many questions but I woke up one day with a very slow application and I have to make it work faster as soon as possible. Thanks again. -- View this message in context: http://camel.465427.n5.nabble.com/Large-file-processing-with-Apache-Camel-tp5727977p5728045.html Sent from

Re: Large file processing with Apache Camel

2013-02-22 Thread Hadrian Zbarcea
batches of hundreds or thousands and I keep using the old mechanism for mapping, one line at a time. Thank you. -- View this message in context: http://camel.465427.n5.nabble.com/Large-file-processing-with-Apache-Camel-tp5727977.html Sent from the Camel - Users mailing list archive at Nabble.com.

Re: Large file processing with Apache Camel

2013-02-22 Thread Claus Ibsen
gt;> one for each read line, to the processor and then to the endpoint. This way >> I read from the file in batches of hundreds or thousands and I keep using >> the old mechanism for mapping, one line at a time. >> >> Thank you. >> >> >> >> -- >

Re: Large file processing with Apache Camel

2013-02-22 Thread Claus Ibsen
, to the processor and then to the endpoint. This way > I read from the file in batches of hundreds or thousands and I keep using > the old mechanism for mapping, one line at a time. > > Thank you. > > > > -- > View this message in context: > http://camel.465427.n5.n

Re: Large file processing with Apache Camel

2013-02-22 Thread Maruan Sahyoun
l" from catify.com where he > raised the number of read lines per second from 200 to 4000 by reading in > batches instead of per line. > > > > -- > View this message in context: > http://camel.465427.n5.nabble.com/Large-file-processing-with-Apache-Camel-tp5727977p5728001.html > Sent from the Camel - Users mailing list archive at Nabble.com.

Re: Large file processing with Apache Camel

2013-02-22 Thread Maruan Sahyoun
l" from catify.com where he > raised the number of read lines per second from 200 to 4000 by reading in > batches instead of per line. > > > > -- > View this message in context: > http://camel.465427.n5.nabble.com/Large-file-processing-with-Apache-Camel-tp5727977p5728001.html > Sent from the Camel - Users mailing list archive at Nabble.com.

Re: Large file processing with Apache Camel

2013-02-22 Thread cristisor
-- View this message in context: http://camel.465427.n5.nabble.com/Large-file-processing-with-Apache-Camel-tp5727977p5728001.html Sent from the Camel - Users mailing list archive at Nabble.com.

Re: Large file processing with Apache Camel

2013-02-21 Thread Maruan Sahyoun
nd send each of time independently or send > 500 lines at once but map each of them to an xml and send the xml alone to > the second stage xml mapper. Do you get my point now? > > Thanks. > > > > -- > View this message in context: > http://camel.465427.n5.

Re: Large file processing with Apache Camel

2013-02-21 Thread Maruan Sahyoun
se I > saw in "Parsing large Files with Apache Camel" from catify.com that he > raised the number of read lines per second from 200 to 4000. > > I will do the tests that you suggested also. > > Thank you for your reply, > Cristian. > > > > -- > V

Re: Large file processing with Apache Camel

2013-02-21 Thread Willem jiang
st I don't think that I'm using, to deal > the XML but I will take a look on this problem also. > > > > -- > View this message in context: > http://camel.465427.n5.nabble.com/Large-file-processing-with-Apache-Camel-tp5727977p5727988.html > Sent from the Camel - Users mailing list archive at Nabble.com > (http://Nabble.com).

Re: Large file processing with Apache Camel

2013-02-21 Thread Maruan Sahyoun
r at least I don't think that I'm using, to deal > the XML but I will take a look on this problem also. > > > > -- > View this message in context: > http://camel.465427.n5.nabble.com/Large-file-processing-with-Apache-Camel-tp5727977p5727988.html > Sent from the Camel - Users mailing list archive at Nabble.com.

Re: Large file processing with Apache Camel

2013-02-21 Thread cristisor
will take a look on this problem also. -- View this message in context: http://camel.465427.n5.nabble.com/Large-file-processing-with-Apache-Camel-tp5727977p5727988.html Sent from the Camel - Users mailing list archive at Nabble.com.

Re: Large file processing with Apache Camel

2013-02-21 Thread Willem jiang
;m not sure if it can help > me. Basically I want to insert a mechanism to send more than one exchange, > one for each read line, to the processor and then to the endpoint. This way > I read from the file in batches of hundreds or thousands and I keep using > the old mechanism for m

Large file processing with Apache Camel

2013-02-21 Thread cristisor
way I read from the file in batches of hundreds or thousands and I keep using the old mechanism for mapping, one line at a time. Thank you. -- View this message in context: http://camel.465427.n5.nabble.com/Large-file-processing-with-Apache-Camel-tp5727977.html Sent from the Camel - Users mailing list archive at Nabble.com.