Paresh Is it feasible to read the large object I to the flow and then split as needed? It sounds like you are reading from the orig file in place and making flowfiles from it.
Perhaps you can share a screenshot of the flow? Thanks Joe On Dec 13, 2015 1:49 PM, "Paresh Shah" <[email protected]> wrote: > We have the following use case: > On a scheduled basis, reading of a large no of records from an external > system and moving the records through the NIFI pipeline. > > What we see is that the flowFiles are not moved to the relationship until > the session is committed. And once the session is committed we are not able > to transfer anything else on that session. > > We see that in GetFileTransfer where the entire file contents are moved > using the “importFrom” api on the session. But since we need to handle the > individual records in the pipeline it does not work for our use case. > > Is there a different mechanism to do what we want. Any insights will be > appreciated. > > Thanks > Paresh > ________________________________ > The information contained in this transmission may contain privileged and > confidential information. It is intended only for the use of the person(s) > named above. If you are not the intended recipient, you are hereby notified > that any review, dissemination, distribution or duplication of this > communication is strictly prohibited. If you are not the intended > recipient, please contact the sender by reply email and destroy all copies > of the original message. > ________________________________ >
