Re: IllegalStateException when putting to state store in Transformer implementation

2017-06-19 Thread Matthias J. Sax
- but it is clear on the Javadoc. > > Thanks for the assistance > Adrian > > -Original Message- > From: Guozhang Wang [mailto:wangg...@gmail.com] > Sent: 16 June 2017 20:35 > To: users@kafka.apache.org > Subject: Re: IllegalStateException when putting to state st

RE: IllegalStateException when putting to state store in Transformer implementation

2017-06-16 Thread Adrian McCague
for the assistance Adrian -Original Message- From: Guozhang Wang [mailto:wangg...@gmail.com] Sent: 16 June 2017 20:35 To: users@kafka.apache.org Subject: Re: IllegalStateException when putting to state store in Transformer implementation Adrian, I see. That would explain what you see, i.e. all

Re: IllegalStateException when putting to state store in Transformer implementation

2017-06-16 Thread Guozhang Wang
.build(); > > builder.addStateStore(storeSupplier); > > > > I can confirm though that all stack traces we have clearly originate > > from `put()` being called from `transform()` > > > > Thanks > > Adrian > > > > -Original Message-

Re: IllegalStateException when putting to state store in Transformer implementation

2017-06-16 Thread Matthias J. Sax
ssage- > From: Adrian McCague [mailto:adrian.mcca...@zopa.com] > Sent: 16 June 2017 10:30 > To: users@kafka.apache.org > Subject: RE: IllegalStateException when putting to state store in Transformer > implementation > > Hi Guozhang > > It's just occurred to me that

RE: IllegalStateException when putting to state store in Transformer implementation

2017-06-16 Thread Adrian McCague
June 2017 10:30 To: users@kafka.apache.org Subject: RE: IllegalStateException when putting to state store in Transformer implementation Hi Guozhang It's just occurred to me that the transformer is added to the topology like this: PhaseTransformer<S, E> transformer = new PhaseTransfor

RE: IllegalStateException when putting to state store in Transformer implementation

2017-06-16 Thread Adrian McCague
16 June 2017 02:54 To: users@kafka.apache.org Subject: Re: IllegalStateException when putting to state store in Transformer implementation Adrian, I looked though the 0.10.2.1 code but I cannot nail down to any obvious places where the processor context is set to null, which could trigger your e

Re: IllegalStateException when putting to state store in Transformer implementation

2017-06-15 Thread Guozhang Wang
(storeSupplier); > > I can confirm though that all stack traces we have clearly originate from > `put()` being called from `transform()` > > Thanks > Adrian > > -Original Message- > From: Guozhang Wang [mailto:wangg...@gmail.com] > Sent: 14 June 2017 21:18 &

RE: IllegalStateException when putting to state store in Transformer implementation

2017-06-15 Thread Adrian McCague
: IllegalStateException when putting to state store in Transformer implementation Hello Adrian, When you call "put()" on the windowed state store that does not specify a timestamp, then the `timestamp()` is retrieved to use as the default timestamp. -- public synchronized void put(f

Re: IllegalStateException when putting to state store in Transformer implementation

2017-06-14 Thread Guozhang Wang
Hello Adrian, When you call "put()" on the windowed state store that does not specify a timestamp, then the `timestamp()` is retrieved to use as the default timestamp. -- public synchronized void put(final K key, final V value) { put(key, value, context.timestamp()); }

IllegalStateException when putting to state store in Transformer implementation

2017-06-14 Thread Adrian McCague
Hi All We have a transformer implementation in our Kafka Streams application that raises this exception, sometimes, when starting. "java.lang.IllegalStateException: This should not happen as timestamp() should only be called while a record is processed" This happens when 'put' is called on a