Darius, I would let the splitter split the rows (end-of-lines) and let your aggregator group them based on that key. You typically specify that key to the aggregator so it can create your groups for you. I believe that is exactly what the aggregator is intended for.
Also, you would be surprised how well Camel works with large CSV files. I am up to 500MB. Thanks! On Sat, Apr 20, 2019 at 6:39 AM Darius Cooper <dariuscoo...@gmail.com> wrote: > My Requirement: > - Large mainframe file, with end-of-line fore each record > - But, need to split into groups of records, based on the value in a > certain range of bytes (it is the key that connects records) > - Groups of such related records are always contiguous > > So, > - I assume one has to write a custom splitter for this? part of the > requirement is not to read the whole file into memory. > - Or, can a mix of out-of-box splitter (using end-of-line), and > aggregator...looking for matching keys... do the job > > If a custom splitter would work best, is there a good example in Camel > code, or Camel Example code, that could be a good starting point? > > < > https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail&utm_term=icon > > > Virus-free. > www.avast.com > < > https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail&utm_term=link > > > <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2> > -- Sincerely, Michael Joyner
