Re: Beanio stream...

2016-04-08 Thread Brad Johnson
Fantastic. Thank you very much. Brad On Fri, Apr 8, 2016 at 11:06 AM, Claus Ibsen wrote: > Hi > > I logged a ticket > https://issues.apache.org/jira/browse/CAMEL-9843 > > And did a quick first implementation, a few things to irony out > > https://github.com/apache/camel/commit/18f3e27d847abe2f

Re: Beanio stream...

2016-04-08 Thread Claus Ibsen
Hi I logged a ticket https://issues.apache.org/jira/browse/CAMEL-9843 And did a quick first implementation, a few things to irony out https://github.com/apache/camel/commit/18f3e27d847abe2fc39cc66cc4edd230cbecfc83 But it shows how you can setup it in a splitter with streaming mode. On Fri, A

Re: Beanio stream...

2016-04-07 Thread Ranx
Claus, Please forgive all the @ in here as that was the only way I could post this to get around the spam filter. Just to get this working for me so I can start refactoring my code to accept and process individual items from the unmarshaling of the multi-line beanio beans I hacked this bit of code

Re: Beanio stream...

2016-04-05 Thread Brad Johnson
Thanks. I'll take a look at the custom BeanioIterator implementation. On the current project it's a nice to have but the next one will likely require. We read in 10k to 50k records which we can handle in memory. In the next project that will be more like 500k records (each mutli-line) and at th

Re: Beanio stream...

2016-04-04 Thread mailingl...@j-b-s.de
Hi Brad! To read and split a file you need a combination of streaming unmarshalling and splitter components. Is tmxPaymentTechIn something you wrote? You can try to read the file by camel as xml, splitting groups by xpath and unmarshall just the group from xml to a bean model... Unfortunately

Re: Beanio stream...

2016-04-04 Thread Claus Ibsen
You would need to create a BeanioIterator implementation and use the splitter eip with it. Would be a good addition to get into camel-beanio with such an iterator. There is an iterator example in camel-mail, and I think also in camel-zipfile etc. On Tue, Apr 5, 2016 at 12:54 AM, Brad Johnson wr