[ 
https://issues.apache.org/jira/browse/NIFI-1577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15174009#comment-15174009
 ] 

ASF subversion and git services commented on NIFI-1577:
-------------------------------------------------------

Commit 6776060ac80e4b47d0fadede3c7a5873fd9e374f in nifi's branch 
refs/heads/master from [~markap14]
[ https://git-wip-us.apache.org/repos/asf?p=nifi.git;h=6776060 ]

NIFI-1577: Close any streams that are left open for 'append' when the session 
is checkpointed, rather than waiting for it to be committed


> NiFi holds open too many files when using a Run Duration > 0 ms and calling 
> session.append
> ------------------------------------------------------------------------------------------
>
>                 Key: NIFI-1577
>                 URL: https://issues.apache.org/jira/browse/NIFI-1577
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Core Framework
>            Reporter: Mark Payne
>            Assignee: Mark Payne
>             Fix For: 0.6.0
>
>         Attachments: 
> 0001-NIFI-1577-Close-any-streams-that-are-left-open-for-a.patch
>
>
> If a Processor calls ProcessSession.append() and has a Run Duration scheduled 
> > 0 ms, we quickly end up with "Too many open files" exceptions.
> This appears to be due to the fact that calling append() holds the content 
> repository's stream open so that the session can keep appending to it, but on 
> checkpoint() the session does not close these streams. It should close these 
> streams on checkpoint, since the Processor is no longer allowed to reference 
> these FlowFiles anyway at that point.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to