[jira] [Commented] (KAFKA-7967) Kafka Streams: some values in statestore rollback to old value

2019-03-04 Thread Ziming Dong (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784080#comment-16784080 ] Ziming Dong commented on KAFKA-7967: we created a replica statestore and found inconsistence between

[jira] [Comment Edited] (KAFKA-7967) Kafka Streams: some values in statestore rollback to old value

2019-02-27 Thread Ziming Dong (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16777571#comment-16777571 ] Ziming Dong edited comment on KAFKA-7967 at 2/27/19 10:07 AM: -- [~guozhang],

[jira] [Commented] (KAFKA-7967) Kafka Streams: some values in statestore rollback to old value

2019-02-26 Thread Ziming Dong (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1614#comment-1614 ] Ziming Dong commented on KAFKA-7967: we implemented an in memory store, let's see if it's rocksdb

[jira] [Comment Edited] (KAFKA-7967) Kafka Streams: some values in statestore rollback to old value

2019-02-25 Thread Ziming Dong (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16777571#comment-16777571 ] Ziming Dong edited comment on KAFKA-7967 at 2/26/19 4:34 AM: - [~guozhang],

[jira] [Comment Edited] (KAFKA-7967) Kafka Streams: some values in statestore rollback to old value

2019-02-25 Thread Ziming Dong (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16777571#comment-16777571 ] Ziming Dong edited comment on KAFKA-7967 at 2/26/19 4:31 AM: - [~guozhang],

[jira] [Commented] (KAFKA-7967) Kafka Streams: some values in statestore rollback to old value

2019-02-25 Thread Ziming Dong (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16777571#comment-16777571 ] Ziming Dong commented on KAFKA-7967: [~guozhang], since the value rollback to an old value which is

[jira] [Commented] (KAFKA-7967) Kafka Streams: some values in statestore rollback to old value

2019-02-24 Thread Ziming Dong (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16776528#comment-16776528 ] Ziming Dong commented on KAFKA-7967: still trying to config the logging level since it's not so

[jira] [Commented] (KAFKA-7967) Kafka Streams: some values in statestore rollback to old value

2019-02-20 Thread Ziming Dong (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773757#comment-16773757 ] Ziming Dong commented on KAFKA-7967: I'll try to enable DEBUG logging. > Kafka Streams: some values

[jira] [Commented] (KAFKA-7967) Kafka Streams: some values in statestore rollback to old value

2019-02-20 Thread Ziming Dong (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773752#comment-16773752 ] Ziming Dong commented on KAFKA-7967: {code:java} final StreamsBuilder builder = new StreamsBuilder();

[jira] [Created] (KAFKA-7967) Kafka Streams: some values in statestore rollback to old value

2019-02-20 Thread Ziming Dong (JIRA)
Ziming Dong created KAFKA-7967: -- Summary: Kafka Streams: some values in statestore rollback to old value Key: KAFKA-7967 URL: https://issues.apache.org/jira/browse/KAFKA-7967 Project: Kafka

[jira] [Updated] (KAFKA-7967) Kafka Streams: some values in statestore rollback to old value

2019-02-20 Thread Ziming Dong (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ziming Dong updated KAFKA-7967: --- Description: We are using kafka streams 2.1.0, we use both persistentKeyValueStore statestore and 

[jira] [Updated] (KAFKA-7967) Kafka Streams: some values in statestore rollback to old value

2019-02-20 Thread Ziming Dong (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ziming Dong updated KAFKA-7967: --- Description: We are using kafka streams 2.1.0, we use both persistentKeyValueStore statestore and 

[jira] [Comment Edited] (KAFKA-7672) The local state not fully restored after KafkaStream rebalanced, resulting in data loss

2019-02-06 Thread Ziming Dong (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762318#comment-16762318 ] Ziming Dong edited comment on KAFKA-7672 at 2/7/19 4:58 AM: [~linyli], I see,

[jira] [Comment Edited] (KAFKA-7672) The local state not fully restored after KafkaStream rebalanced, resulting in data loss

2019-02-06 Thread Ziming Dong (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762318#comment-16762318 ] Ziming Dong edited comment on KAFKA-7672 at 2/7/19 4:54 AM: [~linyli], I see,

[jira] [Commented] (KAFKA-7672) The local state not fully restored after KafkaStream rebalanced, resulting in data loss

2019-02-06 Thread Ziming Dong (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762318#comment-16762318 ] Ziming Dong commented on KAFKA-7672: [~linyli], I see, each time `restore` function only `poll` once.

[jira] [Issue Comment Deleted] (KAFKA-7672) The local state not fully restored after KafkaStream rebalanced, resulting in data loss

2019-02-06 Thread Ziming Dong (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ziming Dong updated KAFKA-7672: --- Comment: was deleted (was: [~linyli], I see, there is a `runLoop` in `StreamThread`, and the second

[jira] [Commented] (KAFKA-7672) The local state not fully restored after KafkaStream rebalanced, resulting in data loss

2019-02-06 Thread Ziming Dong (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762298#comment-16762298 ] Ziming Dong commented on KAFKA-7672: [~linyli], I see, there is a `runLoop` in `StreamThread`, and

[jira] [Commented] (KAFKA-7672) The local state not fully restored after KafkaStream rebalanced, resulting in data loss

2019-02-06 Thread Ziming Dong (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761686#comment-16761686 ] Ziming Dong commented on KAFKA-7672: [~linyli], I also met this issue, but I find that if the program