Guozhang Wang created KAFKA-6034:
------------------------------------

             Summary: Streams DSL to Processor Topology Translation Improvements
                 Key: KAFKA-6034
                 URL: https://issues.apache.org/jira/browse/KAFKA-6034
             Project: Kafka
          Issue Type: Improvement
          Components: streams
            Reporter: Guozhang Wang


Today our DSL to topology translation mechanism is operator-by-operator, and 
hence is sub-optimal in the resulted topology. Some known issues:

1. The repartition topics for aggregations and joins may be duplicated, i.e. 
containing exactly the same data as other topics.
2. state store's changelog topics are duplicates of other repartition / to / 
through topics.

We'd better have improve our DSL translation with a global optimization goal 
for the number of internal topics as well as state stores, i.e. "logical plan 
optimization".



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to