> Geoffrey Greene
>
> Associate Technical Fellow/Senior Software Ninjaneer
>
> (703) 414 2421
>
> The Boeing Company
>
>
>
> *From:* Mark Payne [mailto:marka...@hotmail.com]
> *Sent:* Wednesday, February 24, 2021 5:20 PM
> *To:* users@nifi.apache.org
> *
json. (There are more steps after
that.
Geoffrey Greene
Associate Technical Fellow/Senior Software Ninjaneer
(703) 414 2421
The Boeing Company
From: Mark Payne [mailto:marka...@hotmail.com]
Sent: Wednesday, February 24, 2021 5:20 PM
To: users@nifi.apache.org
Subject: [EXTERNAL] Re: some questions
Geoffrey,
At a high level, if you’re splitting multiple times and then trying to
re-assemble everything, then yes I think your thought process is correct. But
you’ve no doubt seen how complex and cumbersome this approach can be. It can
also result in extremely poor performance. So much so that
Im having some trouble with multiple splits/merges. Here's the idea:
Big data -> split 1->Save all the fragment.*attributes into variables -> split
2-> save all the fragment.* attributes
|
Split 1
|
Save fragment.* attributes into split1.fragment.*
|
Split 2
|
Save fragment.* attributes
