Hi, Esteemed NiFi Developers: We are creating processors for ingesting and exporting out of MarkLogic – See Jira ticket<https://issues.apache.org/jira/browse/NIFI-5102>. We are new to NiFi community and we have been catching up on the code.
Can we accumulate the FlowFiles we get in batches and transfer the FlowFiles to the relationship sometime at a later point in time? We use a utility we built to write data to MarkLogic in batches. We won’t know if the batch succeeded or failed until the batch (of FlowFiles) is full and sent to MarkLogic for processing. I am not able to defer the transfer of flow file to a relationship to a later point in time. I am getting an exception saying that the flow file is not transferred to a relationship or Flowfile is not known to the ProcessSession. Is onTrigger method synchronous? i.e. we need to determine the relationship for each FlowFile in that method itself or can it be done sometime asynchronously? If it can be done, then do we need to store the mapping for the ProcessSession and the FlowFile to transfer? Thanks in advance! Regards, Vivek
