Hi,
I have a use case that involves splitting a very large list, then
aggregating it into smaller lists and processing those lists once they
reach a certain size. I'm getting a StackOverflowError (good luck googling
'Camel stackoverflow'), which makes me think I'm doing something wrong.
Here's a route that reproduces the issue:
from("direct:aggregateTest")
.setBody(() -> IntStream.rangeClosed(0, 50000)
.boxed().collect(Collectors.toList()))
.split().body().stopOnException()
.aggregate(constant(true), new AggregationStrategy() {
@Override
public Exchange aggregate(Exchange oldExchange, Exchange
newExchange) {
if (oldExchange == null) {
newExchange.getIn().setBody(new ArrayList<>(List.of(
newExchange.getIn().getBody(Integer.class))));
return newExchange;
}
((List<Integer>) oldExchange.getIn().getBody())
.add(newExchange.getIn().getBody(Integer.class));
return oldExchange;
}
}).completion(exchange ->
exchange.getIn().getBody(List.class).size() == 10)
.log("aggregated") // doing something more interesting than
logging here
.end() // end aggregate
.end(); // end split
After about 680 aggregations, I get a StackOverflowError and one helluva
stack trace. One other wrinkle is that I'm not simply splitting a big list
into smaller lists. There's some processing and conditional logic that
means that many elements from the big list don't ever make it into a
smaller list, thus the need for some interesting aggregation logic. Yet
another wrinkle is that the smaller lists have to be no bigger than 25
elements, so I can't just use the composed message processor pattern.
Thanks for any help!
Jeremy
