I am not sure, but this might be related with your state directory. You use default directory that is located in /tmp -- could it be, that /tmp gets clean up and thus you loose files/directories?
Try to reconfigure your state directory via StreamsConfig: http://docs.confluent.io/current/streams/developer-guide.html#optional-configuration-parameters -Matthias On 12/11/16 1:28 AM, Jon Yeargers wrote: > Seeing this appearing somewhat frequently - > > org.apache.kafka.streams.errors.ProcessorStateException: Error opening > store minute_agg_stream-201612100812 at location > /tmp/kafka-streams/MinuteAgg/1_9/minute_agg_stream/minute_agg_stream-201612100812 > > at > org.apache.kafka.streams.state.internals.RocksDBStore.openDB(RocksDBStore.java:196) > > at > org.apache.kafka.streams.state.internals.RocksDBStore.openDB(RocksDBStore.java:158) > > at > org.apache.kafka.streams.state.internals.RocksDBWindowStore$Segment.openDB(RocksDBWindowStore.java:72) > > at > org.apache.kafka.streams.state.internals.RocksDBWindowStore.getOrCreateSegment(RocksDBWindowStore.java:402) > > at > org.apache.kafka.streams.state.internals.RocksDBWindowStore.putInternal(RocksDBWindowStore.java:333) > > at > org.apache.kafka.streams.state.internals.RocksDBWindowStore.access$100(RocksDBWindowStore.java:51) > > at > org.apache.kafka.streams.state.internals.RocksDBWindowStore$2.restore(RocksDBWindowStore.java:212) > > at > org.apache.kafka.streams.processor.internals.ProcessorStateManager.restoreActiveState(ProcessorStateManager.java:235) > > at > org.apache.kafka.streams.processor.internals.ProcessorStateManager.register(ProcessorStateManager.java:198) > > at > org.apache.kafka.streams.processor.internals.ProcessorContextImpl.register(ProcessorContextImpl.java:123) > > at > org.apache.kafka.streams.state.internals.RocksDBWindowStore.init(RocksDBWindowStore.java:206) > > at > org.apache.kafka.streams.state.internals.MeteredWindowStore.init(MeteredWindowStore.java:66) > > at > org.apache.kafka.streams.state.internals.CachingWindowStore.init(CachingWindowStore.java:64) > > at > org.apache.kafka.streams.processor.internals.AbstractTask.initializeStateStores(AbstractTask.java:81) > > at > org.apache.kafka.streams.processor.internals.StreamTask.<init>(StreamTask.java:120) > > at > org.apache.kafka.streams.processor.internals.StreamThread.createStreamTask(StreamThread.java:633) > > at > org.apache.kafka.streams.processor.internals.StreamThread.addStreamTasks(StreamThread.java:660) > > at > org.apache.kafka.streams.processor.internals.StreamThread.access$100(StreamThread.java:69) > > at > org.apache.kafka.streams.processor.internals.StreamThread$1.onPartitionsAssigned(StreamThread.java:124) > > at > org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:228) > > at > org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:313) > > at > org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:277) > > at > org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:259) > > at > org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1013) > > at > org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:979) > > at > org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:407) > > at > org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:242) > > Caused by: org.rocksdb.RocksDBException: IO error: lock > /tmp/kafka-streams/MinuteAgg/1_9/minute_agg_stream/minute_agg_stream-201612100812/LOCK: > No locks available > > at org.rocksdb.RocksDB.open(Native Method) > > at org.rocksdb.RocksDB.open(RocksDB.java:184) > > at > org.apache.kafka.streams.state.internals.RocksDBStore.openDB(RocksDBStore.java:189) > > ... 26 common frames omitted >
signature.asc
Description: OpenPGP digital signature
