Tim Van Laer created KAFKA-7803:
-----------------------------------

             Summary: Streams internal topics config is not updated when the 
code is changed
                 Key: KAFKA-7803
                 URL: https://issues.apache.org/jira/browse/KAFKA-7803
             Project: Kafka
          Issue Type: Improvement
          Components: streams
            Reporter: Tim Van Laer


Considering the following state store definition:
{code:java}
ImmutableMap<String, String> changelogTopicConfig = new 
ImmutableMap.Builder<String, String>()
    .put(TopicConfig.SEGMENT_BYTES_CONFIG, String.valueOf(100 * 1024 * 1024))
    .build();

builder.addStateStore(
    
Stores.keyValueStoreBuilder(Stores.persistentKeyValueStore("store-example"), 
Serdes.String(), Serdes.String())
        .withLoggingEnabled(changelogTopicConfig)
);{code}
The configuration for a changelog topic (segment size, max message size...) is 
used when Kafka Streams create the internal topic (See 
[InternalTopicManager|https://github.com/apache/kafka/blob/trunk/streams/src/main/java/org/apache/kafka/streams/processor/internals/InternalTopicManager.java]).
 If I later decide to increase the segment size, I would update the value in 
the code. However Kafka Streams currently won't apply this code change to the 
internal topic config. This causes a confusing state where the code is 
different from the actual runtime.  

It would be convenient if Kafka Streams could reflect those changes to the 
internal topic by updating the topic configuration. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to