[
https://issues.apache.org/jira/browse/KAFKA-1448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13999324#comment-13999324
]
Moritz Möller commented on KAFKA-1448:
--------------------------------------
Hi Neha,
our idea was to add this filter on the kafka server-side to reduce the network
load.
It's probably slightly complicated due to the non-extensible network protocol.
would you say using several thousand topics (with auto-create) is a good
solution instead?
Thank you,
Moritz
> Filter-plugins for messages
> ---------------------------
>
> Key: KAFKA-1448
> URL: https://issues.apache.org/jira/browse/KAFKA-1448
> Project: Kafka
> Issue Type: Wish
> Components: consumer
> Reporter: Moritz Möller
> Assignee: Neha Narkhede
>
> Hi,
> we use Kafka to transmit different events that occur on different products,
> and would like to be able to subscribe only to a certain set of events for
> certain products.
> Using one topic for each event * product combination would yield around 2000
> topics, which seems to be not what kafka is designed for.
> What we would need is a way to add a consumer filter plugin to kafka (a
> simple class that can accept or reject a message) and to pass a parameter
> from the consumer to that filter class.
> Is there a better way to do this already, or if not, would you accept a patch
> upstream that adds such a mechanism?
> Thanks,
> Mo
--
This message was sent by Atlassian JIRA
(v6.2#6252)
