[ 
https://issues.apache.org/jira/browse/KAFKA-1448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15859803#comment-15859803
 ] 

Mileta Cekovic commented on KAFKA-1448:
---------------------------------------

Any filtering on server side should be able to understand the message and 
should be in a code executable on server side, so it is hard to implement.
Alternative is providing API for publishing additional message attributes 
(key-value pairs) alongside the message body, and then the filter could be 
simple Boolean algebra expression based on the additional key/value pairs for 
message attributes. This would suffice for most use cases. 


> Filter-plugins for messages
> ---------------------------
>
>                 Key: KAFKA-1448
>                 URL: https://issues.apache.org/jira/browse/KAFKA-1448
>             Project: Kafka
>          Issue Type: Wish
>          Components: consumer
>            Reporter: Moritz Möller
>            Assignee: Neha Narkhede
>
> Hi,
> we use Kafka to transmit different events that occur on different products, 
> and would like to be able to subscribe only to a certain set of events for 
> certain products.
> Using one topic for each event * product combination would yield around 2000 
> topics, which seems to be not what kafka is designed for.
> What we would need is a way to add a consumer filter plugin to kafka (a 
> simple class that can accept or reject a message) and to pass a parameter 
> from the consumer to that filter class.
> Is there a better way to do this already, or if not, would you accept a patch 
> upstream that adds such a mechanism?
> Thanks,
> Mo



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Reply via email to