[ 
https://issues.apache.org/jira/browse/KAFKA-5582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

huxihx resolved KAFKA-5582.
---------------------------
    Resolution: Duplicate

> Log compaction with preallocation enabled does not trim segments
> ----------------------------------------------------------------
>
>                 Key: KAFKA-5582
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5582
>             Project: Kafka
>          Issue Type: Bug
>    Affects Versions: 0.10.1.1
>         Environment: Linux, Windows
>            Reporter: Jason Aliyetti
>
> Unexpected behavior occurs when a topic is configured to preallocate files 
> and has a retention policy of compact.
> When log compaction runs, the cleaner attempts to gather groups of segments 
> to consolidate based on the max segment size.  
> When preallocation is enabled all segments are that size and thus each 
> individual segment is considered for compaction.
> When compaction does occur, the resulting cleaned file is sized based on that 
> same configuration.  This means that you can have very large files on disk 
> that contain little or no data which partly defeats the point of compacting. 
> The log cleaner should trim these segments to free up disk space.  That way 
> they would free up disk space and be able to be further compacted on 
> subsequent runs.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to