[ 
https://issues.apache.org/jira/browse/NIFI-3977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Matt Gilman updated NIFI-3977:
------------------------------
    Description: 
When dropping the contents of a queue, if some of the data is swapped out and 
the swap file cannot be completely read we want to attempt to drop what is 
readable. However, because of IncompleteSwapFileException exception that is 
being thrown the drop method is never called [1]. Subsequently, that swap file 
is removed from the current drop locations without actually dropping the flow 
files [2]. It appears that the swap location will be restored upon next restart 
though I'm not sure that is the desired behavior given this was a drop attempt.

[1] 
https://github.com/apache/nifi/blob/rel/nifi-1.2.0/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-framework-core/src/main/java/org/apache/nifi/controller/StandardFlowFileQueue.java#L1154
[2] 
https://github.com/apache/nifi/blob/rel/nifi-1.2.0/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-framework-core/src/main/java/org/apache/nifi/controller/StandardFlowFileQueue.java#L1186

  was:
When dropping the contents of a queue, if some of the data is swapped out and 
the swap file cannot be completely read we want to attempt to drop what is 
readable. However, because of IncompleteSwapFileException exception that is 
being thrown the drop method is never called [1]. Subsequently, that swap file 
is removed from the current drop locations without actually dropping the flow 
files [2]. The swap location should be restored the next time the swap files 
are recovered.

[1] 
https://github.com/apache/nifi/blob/rel/nifi-1.2.0/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-framework-core/src/main/java/org/apache/nifi/controller/StandardFlowFileQueue.java#L1154
[2] 
https://github.com/apache/nifi/blob/rel/nifi-1.2.0/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-framework-core/src/main/java/org/apache/nifi/controller/StandardFlowFileQueue.java#L1186


> Empty queue issue when swap file is incomplete/corrupt
> ------------------------------------------------------
>
>                 Key: NIFI-3977
>                 URL: https://issues.apache.org/jira/browse/NIFI-3977
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Core Framework
>            Reporter: Matt Gilman
>            Priority: Minor
>
> When dropping the contents of a queue, if some of the data is swapped out and 
> the swap file cannot be completely read we want to attempt to drop what is 
> readable. However, because of IncompleteSwapFileException exception that is 
> being thrown the drop method is never called [1]. Subsequently, that swap 
> file is removed from the current drop locations without actually dropping the 
> flow files [2]. It appears that the swap location will be restored upon next 
> restart though I'm not sure that is the desired behavior given this was a 
> drop attempt.
> [1] 
> https://github.com/apache/nifi/blob/rel/nifi-1.2.0/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-framework-core/src/main/java/org/apache/nifi/controller/StandardFlowFileQueue.java#L1154
> [2] 
> https://github.com/apache/nifi/blob/rel/nifi-1.2.0/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-framework-core/src/main/java/org/apache/nifi/controller/StandardFlowFileQueue.java#L1186



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Reply via email to