[ 
https://issues.apache.org/jira/browse/KAFKA-10079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sophie Blee-Goldman updated KAFKA-10079:
----------------------------------------
    Description: 
Now that KAFKA-9501 is fixed, we should make sure that KIP-441 will work with 
in-memory stores.

Since we don't handoff stores between threads, any in-memory state will be 
wiped out if assigned to a different thread

  was:
Now that KAFKA-9501 is fixed, we should make sure that KIP-441 will work with 
in-memory stores.

Our current technique for reporting offsets, locking all task directories and 
searching for offsets in the written checkpoint file, only works for persistent 
stores. We should make sure to compute offset sums for in-memory stores as 
well, for which we don't write a checkpoint file.

We should also improve the thread-level stickiness of stateful tasks, since we 
don't handoff stores between threads and thus any in-memory state will be wiped 
out if transferred between threads.


> Improve thread-level stickiness of stateful tasks
> -------------------------------------------------
>
>                 Key: KAFKA-10079
>                 URL: https://issues.apache.org/jira/browse/KAFKA-10079
>             Project: Kafka
>          Issue Type: Bug
>          Components: streams
>            Reporter: Sophie Blee-Goldman
>            Assignee: Sophie Blee-Goldman
>            Priority: Major
>             Fix For: 2.6.0
>
>
> Now that KAFKA-9501 is fixed, we should make sure that KIP-441 will work with 
> in-memory stores.
> Since we don't handoff stores between threads, any in-memory state will be 
> wiped out if assigned to a different thread



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to