Re: Kafka Streams - Custom processor "init" method called before state store has data restored into it

2017-11-13 Thread Rainer Guessner
Hi Bill,   I was on 0.10.2.1. Thank you Rainer Sent: Monday, November 13, 2017 at 4:02 PM From: "Bill Bejeck" To: users@kafka.apache.org Subject: Re: Kafka Streams - Custom processor "init" method called before state store has data restored into it Rainer, Thanks for the

Re: Kafka Streams - Custom processor "init" method called before state store has data restored into it

2017-11-13 Thread Bill Bejeck
.init > 19:04:36,690 INFO [KStreamsTester$MyStateStore] .onRestoreStart > 19:04:36,706 INFO [KStreamsTester$MyStateStore] .restore > 19:04:36,706 INFO [KStreamsTester$MyStateStore] .restore > 19:04:36,706 INFO [KStreamsTester$MyStateStore] .restore > 19:04:36,706 INFO [KStreamsT

Re: Kafka Streams - Custom processor "init" method called before state store has data restored into it

2017-11-12 Thread Rainer Guessner
40c6-84c7-fb1f7fbd1b24-StreamThread-1] State transition from PARTITIONS_ASSIGNED to RUNNING 19:04:36,706 INFO [KafkaStreams] stream-client [sampleapp-07ac897b-7bfe-40c6-84c7-fb1f7fbd1b24]State transition from REBALANCING to RUNNING 19:04:36,706 INFO [KStreamsTester$MyStateStore] .flush  

Re: Kafka Streams - Custom processor "init" method called before state store has data restored into it

2017-11-12 Thread Bill Bejeck
NS_ASSIGNED to RUNNING > > ====== > Sent: Thursday, November 09, 2017 at 1:43 PM > From: "Bill Bejeck" > To: users@kafka.apache.org > Subject: Re: Kafka Streams - Custom processor "init" method called before > state store has data restored int

Kafka Streams - Custom processor "init" method called before state store has data restored into it

2017-11-09 Thread Rainer Guessner
I have a custom processor that implements AbstractProcessor and a custom store that implements StateStore. Before Kafka 1.0.0 the processors "init" method gets called after the state store is restored from changelog and that is good. With Kafka 1.0.0 the processors "init" method is called BEFOR

Re: Kafka Streams - Custom processor "init" method called before state store has data restored into it

2017-11-09 Thread Rainer Guessner
: Thursday, November 09, 2017 at 1:43 PM From: "Bill Bejeck" To: users@kafka.apache.org Subject: Re: Kafka Streams - Custom processor "init" method called before state store has data restored into it Hi Rainer, Thanks for reporting this issue. Do you have any log data you can share? I

Re: Kafka Streams - Custom processor "init" method called before state store has data restored into it

2017-11-09 Thread Bill Bejeck
Hi Rainer, Thanks for reporting this issue. Do you have any log data you can share? In the meantime, I'll look into the issue. Thanks, Bill On Thu, Nov 9, 2017 at 1:23 PM, Rainer Guessner wrote: > I have a custom processor that implements AbstractProcessor and a custom > store that implement

Kafka Streams - Custom processor "init" method called before state store has data restored into it

2017-11-09 Thread Rainer Guessner
I have a custom processor that implements AbstractProcessor and a custom store that implements StateStore. Before Kafka 1.0.0 the processors "init" method gets called after the state store is restored from changelog and that is good. With Kafka 1.0.0 the processors "init" method is called BEFORE