[
https://issues.apache.org/jira/browse/KAFKA-5201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16002885#comment-16002885
]
Edoardo Comar commented on KAFKA-5201:
--------------------------------------
Thanks [~mihbor]
Sure there is no concept of legitimate vs abusive client !
Quotas affect throughput rather than storage, so I can't see them to be
directly applicable.
Thinking again, though a practical approach could be to have the delete cleanup
policy based on size only, not on time
then if the topic ACL limits it to trusted producers,
only an application error would cause the deletion
topics not protected by ACL could not be trusted to have the latest value for a
given key
but that would be acceptable.
I'm closing this JIRA for now.
> Compacted topic could be misused to fill up a disk but deletion policy can't
> retain legitimate keys
> ----------------------------------------------------------------------------------------------------
>
> Key: KAFKA-5201
> URL: https://issues.apache.org/jira/browse/KAFKA-5201
> Project: Kafka
> Issue Type: Improvement
> Reporter: Edoardo Comar
>
> Misuse of a topic with cleanup policy = compact
> could lead to a disk being filled if a misbehaving producer keeps producing
> messages with unique keys.
> The mixed cleanup policy compact,delete could be adopted, but would not
> guarantee that the latest "legitimate" keys will be kept.
> It would be desirable to have a cleanup policy that attempts to preserve
> messages with 'legitimate' keys
> This issue needs a KIP but I have no proposed solution yet at the time of
> writing.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
