I have a processor that reads in a large FlowFile and outputs multiple FlowFiles from its contents (similar to SplitText). Is there any good way for me to periodically transfer and commit batches of transferred FlowFiles while continuing to read and process the original input FlowFile?
At the moment, the session commit throws an exception based on the transactionality of the session that recognizes that the original FlowFile hasn't been removed or transferred. My goal for this is speed of getting data out of the FlowFile and sending it on to the rest of our flow as quickly as possible, instead of processing the whole thing (and handling any errors along the way) before transferring. Thanks, -- Brian Ghigiarelli
