[ 
https://issues.apache.org/jira/browse/FLUME-1966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13622684#comment-13622684
 ] 

Brock Noland commented on FLUME-1966:
-------------------------------------

Thanks Roshan.
                
> FileChannel should intelligently decide on default minimumRequiredSpace
> -----------------------------------------------------------------------
>
>                 Key: FLUME-1966
>                 URL: https://issues.apache.org/jira/browse/FLUME-1966
>             Project: Flume
>          Issue Type: Bug
>          Components: File Channel
>            Reporter: Brock Noland
>
> Right now the default minimumRequiredSpace is set to 500MB. As opposed to 
> having a fixed number, I think we should have some kind of algorithm that 
> finds a proper default based on the disk in question. This assumes the user 
> has not set minimumRequiredSpace, in which case the default calcuated below 
> will be ignored.
> The issue is we would like a large minimumRequiredSpace so we can be sure to 
> stop writing before a disk fills up in production, where disks are generally 
> going to be quite large. However, we don't want it so large that the file 
> channel doesn't work out of the box when testing it on VMs or laptops.
> Something like this might work:
> default = max(min(10% disk capacity, 5GB), 500MB)
> Basically we always set the default to a minimum of 500MB. In production, 
> typically we have 500GB or larger disks we'll set it to 5GB. On VM/laptop 
> machines with smaller disks, we'll set it to 10% the disk or 500MB whichever 
> is larger.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to