Simple solution is* Splitter with Collate*
collate(200)
--
View this message in context:
http://camel.465427.n5.nabble.com/Camel-jdbc-select-batch-processing-tp5801682p5801832.html
Sent from the Camel - Users mailing list archive at Nabble.com.
n context:
> http://camel.465427.n5.nabble.com/Camel-jdbc-select-batch-processing-tp5801682.html
> Sent from the Camel - Users mailing list archive at Nabble.com.
message in context:
http://camel.465427.n5.nabble.com/Camel-jdbc-select-batch-processing-tp5801682.html
Sent from the Camel - Users mailing list archive at Nabble.com.
Hello all,
I got into this similar design few times. I am not sure if I can use
camel to cleanly code it.
I get messages from a source at random times. For example document
changed, record inserted .. etc.
Invoking the processing for a single document is costly. For example
indexing in lucene an
for option in CSV
>
> Regards,
>
>
>
> --
> View this message in context:
> http://camel.465427.n5.nabble.com/CSV-and-SQL-Component-for-Batch-Processing-tp5766475.html
> Sent from the Camel - Users mailing list archive at Nabble.com.
>
mns are same, but my CSV has 10
column and Table has 7.
Is there any way to skip last 3 columns from CSV before insertion?
I can use bindy component but i am looking for option in CSV
Regards,
--
View this message in context:
http://camel.465427.n5.nabble.com/CSV-and-SQL-Component-for-Batch-
nent based on ScheduledBatchPollingConsumer is
the way to go, mimicking what the file component does, but catered to my
specific consumer. Any other ideas?
gr
--
View this message in context:
http://camel.465427.n5.nabble.com/Batch-processing-from-end-to-end-tp5743180.html
Sent from the Camel - Users mailing list archive at Nabble.com.
gt; >
> >> >
> >> >
> >> > >> completionSize="50"
> >> > completionTimeout="5000">
> >> >
> >> > transactionGUID
> >> >
gt; >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> > ?
>> >
>> >
>> >
> > > method="updateTransaction" />
> >
> >
> >
> > The questions I have:
> > * are 2 routes with aggregators the best way to handle this use case?
> > * will the first aggregate keep working or will it stop after the first
> > batch of 50?
> > * what should be the correlation and completion paramters for the second
> > aggregation?
> >
> > Thanks in advance,
> > Tom
> >
> >
> >
> >
> > --
> > View this message in context:
> >
> http://camel.465427.n5.nabble.com/Grouping-messages-for-batch-processing-tp5742015.html
> > Sent from the Camel - Users mailing list archive at Nabble.com.
> >
>
>
>
>
> The questions I have:
> * are 2 routes with aggregators the best way to handle this use case?
> * will the first aggregate keep working or will it stop after the first
> batch of 50?
> * what should be the correlation and completion paramters for the sec
call the bean.
Though not sure if you really need 2 aggregators. Maybe one is enough?
> Thanks in advance,
> Tom
>
>
>
>
> --
> View this message in context:
> http://camel.465427.n5.nabble.com/Grouping-messages-for-batch-processing-tp5742015.html
> Sent from the Camel - Users mailing list archive at Nabble.com.
--
Claus Ibsen
-
Red Hat, Inc.
Email: cib...@redhat.com
Twitter: davsclaus
Blog: http://davsclaus.com
Author of Camel in Action: http://www.manning.com/ibsen
?
* what should be the correlation and completion paramters for the second
aggregation?
Thanks in advance,
Tom
--
View this message in context:
http://camel.465427.n5.nabble.com/Grouping-messages-for-batch-processing-tp5742015.html
Sent from the Camel - Users mailing list archive at Nabble.com.
Hi
What kinda of consumer are you using? If you build your custom
consumer, you can just let it pickup N messages and store them as a
List in the message body.
You can use the aggregator EIP to aggregate N Camel messages into a
combined single message.
http://camel.apache.org/aggregator2
Take a
Hi,
I'm pretty new to camel so I may be missing something. I have
discovered I can have a batch consumer, which downloads N items from
the source, but I'd like to have a batch processor and batch producer.
It's not very efficient for me to process an message at a time, so I'm
looking to process a
s not leverage the usage of
>> conversion provided by Bindy - csv text attribute converted automatically to
>> a Date object if attribute is of type Date.
>>
>> Any other option ?
>>
>> Thanks in advance.
>> --
>> View this message in context:
>&g
nfortunatelly, does not leverage the usage of
> conversion provided by Bindy - csv text attribute converted automatically to
> a Date object if attribute is of type Date.
>
> Any other option ?
>
> Thanks in advance.
> --
> View this message in context:
> http://old.nabble
rd---handling-bad-records-on-batch-processing-tp28830072p28830072.html
Sent from the Camel - Users mailing list archive at Nabble.com.
Christian.
Adrian Trenaman-2 wrote:
Hi Christian,
I've got a sample of a batch file/ftp processor in my demo up on
http://fusesource.com/wiki/display/ProdInfo/FUSE+ESB+4+Getting+Started+Tutorial+Downloads
Maybe that might help?
/Ade
On 7 Mar 2009, at 14:31, thabach wrote:
Heya
wou
gt;
> /Ade
>
> On 7 Mar 2009, at 14:31, thabach wrote:
>
>>
>> Heya
>>
>> would you recommend using Camel in a Batch Processing scenario
>> involving the
>> reading of some files at the end of a business day, combining data and
>> pro
Batch Processing scenario
involving the
reading of some files at the end of a business day, combining data and
producing some output file ?
Is there a sample, tutorial or any pointers on how such batch
processing
could be bootstrapped (with reference data for validation,
enhancement
Heya
would you recommend using Camel in a Batch Processing scenario involving the
reading of some files at the end of a business day, combining data and
producing some output file ?
Is there a sample, tutorial or any pointers on how such batch processing
could be bootstrapped (with reference
22 matches
Mail list logo
