Re: Streams - State store directory created automatically

2018-01-05 Thread Kristopher Kane
Thanks! On Fri, Jan 5, 2018 at 3:13 PM, Matthias J. Sax wrote: > We always create task directories -- this helps to cleanly hand over > tasks and detect reassignment issues (via the .lock) > > The checkpoint file will be empty if you don't use any state. > > -Matthias > > On 1/4/18 7:15 PM, Ted

Re: Streams - State store directory created automatically

2018-01-05 Thread Matthias J. Sax
We always create task directories -- this helps to cleanly hand over tasks and detect reassignment issues (via the .lock) The checkpoint file will be empty if you don't use any state. -Matthias On 1/4/18 7:15 PM, Ted Yu wrote: > Looks like the .checkpoint file was generated from this code in > P

Re: Streams - State store directory created automatically

2018-01-04 Thread Ted Yu
Looks like the .checkpoint file was generated from this code in ProcessorStateManager : // write the checkpoint file before closing, to indicate clean shutdown try { if (checkpoint == null) { checkpoint = new OffsetCheckpoint(new File(baseDir, CHECKPO

Streams - State store directory created automatically

2018-01-04 Thread Kristopher Kane
I just noticed /tmp/kafka-streams//0_[0,1]/{.checkpoint,.lock] (there are two partitions on the incoming topic) being automatically created during an integration test. My Streams app doesn't use a state store and only contains mapValues and a .to termination operation. Anyone know what this is fo