[ 
https://issues.apache.org/jira/browse/NIFI-697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Joseph Witt updated NIFI-697:
-----------------------------
    Fix Version/s: 0.4.0

> MergeContent and queue swapping
> -------------------------------
>
>                 Key: NIFI-697
>                 URL: https://issues.apache.org/jira/browse/NIFI-697
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Core Framework
>    Affects Versions: 0.1.0
>            Reporter: Michael Moser
>            Priority: Minor
>             Fix For: 0.4.0
>
>
> MergeContent will not place more files into bins than the nifi.properties 
> nifi.queue.swap.threshold (default 20,000).  This is probably worth a 
> documentation note.  Perhaps in the Maximum Number of Entries description in 
> BinFiles.  It says "The maximum number of files to include in a bundle. If 
> not specified, there is no maximum."  The maximum seems to be = 
> nifi.queue.swap.threshold.
> Test Case: GenerateFlowFile and put about 81,000 files into a queue to 
> MergeContent.  Wait for most of them to be swapped out.  Set Minimum Number 
> of Entries to 25000.  Set Max Bin Age to 1 min.  When you start MergeContent, 
> it will wait the Max Bin Age duration, then it will merge 20,000 files (the 
> nifi.queue.swap.threshold).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to