Guozhang Wang created KAFKA-6034:
------------------------------------
Summary: Streams DSL to Processor Topology Translation Improvements
Key: KAFKA-6034
URL: https://issues.apache.org/jira/browse/KAFKA-6034
Project: Kafka
Issue Type: Improvement
Components: streams
Reporter: Guozhang Wang
Today our DSL to topology translation mechanism is operator-by-operator, and
hence is sub-optimal in the resulted topology. Some known issues:
1. The repartition topics for aggregations and joins may be duplicated, i.e.
containing exactly the same data as other topics.
2. state store's changelog topics are duplicates of other repartition / to /
through topics.
We'd better have improve our DSL translation with a global optimization goal
for the number of internal topics as well as state stores, i.e. "logical plan
optimization".
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)