Joe Wreschnig created KAFKA-15190:
-------------------------------------

             Summary: Allow configuring a streams process ID
                 Key: KAFKA-15190
                 URL: https://issues.apache.org/jira/browse/KAFKA-15190
             Project: Kafka
          Issue Type: Wish
          Components: streams
            Reporter: Joe Wreschnig


We run our Kafka Streams applications in containers with no persistent storage, 
and therefore the mitigation of persisting process ID the state directly in 
KAFKA-10716 does not help us avoid shuffling lots of tasks during restarts.

However, we do have a persistent container ID (from a Kubernetes StatefulSet). 
Would it be possible to expose a configuration option to let us set the streams 
process ID ourselves?

We are already using this ID as our group.instance.id - would it make sense to 
have the process ID be automatically derived from this (plus application/client 
IDs) if it's set? The two IDs seem to have overlapping goals of identifying 
"this consumer" across restarts.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to