[
https://issues.apache.org/activemq/browse/CAMEL-876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=45553#action_45553
]
Gert Vanthienen commented on CAMEL-876:
---------------------------------------
My plan was to use an Iterable instead of a List wherever possible, so the
Splitter could read and send exchanges as it gets them from the splitter
expression. This would allow us to just add an an aggregator in the dsl to do
the batching.
This works fine, but there's only one problem there: the SPLIT_SIZE attribute
requires us to know the amount of items being split and we can't know that yet
until we have handled all the messages with this approach. How about adding a
streaming() flag to the Splitter where people can choose to use the new
approach, but we can warn them in the javadoc that this will also mean we can
not send the split size along?
> splitter() should support batch for processing large files
> ----------------------------------------------------------
>
> Key: CAMEL-876
> URL: https://issues.apache.org/activemq/browse/CAMEL-876
> Project: Apache Camel
> Issue Type: Improvement
> Components: camel-core
> Affects Versions: 1.4.0
> Reporter: Claus Ibsen
> Assignee: Gert Vanthienen
> Fix For: 1.5.0
>
>
> See nabble:
> http://www.nabble.com/Splitter-for-big-files-td19272583s22882.html
> Somekind of batch(size) parameter to the splitter() DSL so we can process the
> exchanges in batches instead of all in one go.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
