[ https://issues.apache.org/jira/browse/KAFKA-10199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Guozhang Wang updated KAFKA-10199: ---------------------------------- Labels: (was: new-streams-runtime-should-fix) > Separate state restoration into separate threads > ------------------------------------------------ > > Key: KAFKA-10199 > URL: https://issues.apache.org/jira/browse/KAFKA-10199 > Project: Kafka > Issue Type: Improvement > Components: streams > Reporter: Guozhang Wang > Assignee: Bruno Cadonna > Priority: Major > > As part of the restoration optimization effort, we would like to move the > restoration process to separate threads such that: > 1. Stream threads would not be restricted by the main consumer `poll` > frequency to keep as part of the group. > 2. We can allow larger batches of data to be written into the restoration. > Besides this, we'd also like to fix the known issues that for piggy-backed > source topics as changelog topics, the serde exception / extra processing > logic would be skipped. > We would also cleanup the global update tasks as part of this effort to > consolidate to the separate restoration threads, and would also gear them up > with corresponding monitoring metrics (KIPs in progress). -- This message was sent by Atlassian Jira (v8.20.7#820007)