You might hit a RockDB issues as reported here: https://issues.apache.org/jira/browse/KAFKA-6327
-Matthias On 8/6/18 11:07 PM, Siva Ram wrote: > Hi, > > We switched to a virtual machine (from physical node) and we are observing > the following exception occurs and all our the stream application instances > fails. Can you please advise what causes this exception? > > > 2018-08-07 01:31:14 ERROR MetaStream380 - Unknown Exception occurred > org.apache.kafka.streams.errors.ProcessorStateException: task [2_3] Failed > to flush state store kvshourly1 > at > org.apache.kafka.streams.processor.internals.ProcessorStateManager.flush(ProcessorStateManager.java:245) > at > org.apache.kafka.streams.processor.internals.AbstractTask.flushState(AbstractTask.java:196) > at > org.apache.kafka.streams.processor.internals.StreamTask.flushState(StreamTask.java:324) > at > org.apache.kafka.streams.processor.internals.StreamTask$1.run(StreamTask.java:304) > at > org.apache.kafka.streams.processor.internals.StreamsMetricsImpl.measureLatencyNs(StreamsMetricsImpl.java:208) > at > org.apache.kafka.streams.processor.internals.StreamTask.commit(StreamTask.java:299) > at > org.apache.kafka.streams.processor.internals.StreamTask.commit(StreamTask.java:289) > at > org.apache.kafka.streams.processor.internals.AssignedTasks$2.apply(AssignedTasks.java:87) > at > org.apache.kafka.streams.processor.internals.AssignedTasks.applyToRunningTasks(AssignedTasks.java:451) > at > org.apache.kafka.streams.processor.internals.AssignedTasks.commit(AssignedTasks.java:380) > at > org.apache.kafka.streams.processor.internals.TaskManager.commitAll(TaskManager.java:309) > at > org.apache.kafka.streams.processor.internals.StreamThread.maybeCommit(StreamThread.java:1018) > at > org.apache.kafka.streams.processor.internals.StreamThread.runOnce(StreamThread.java:835) > at > org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:774) > at > org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:744) > Caused by: java.lang.IllegalArgumentException: Illegal value provided for > SubCode. > at org.rocksdb.Status$SubCode.getSubCode(Status.java:109) > at org.rocksdb.Status.<init>(Status.java:30) > at org.rocksdb.RocksDB.put(Native Method) > at org.rocksdb.RocksDB.put(RocksDB.java:488) > at > org.apache.kafka.streams.state.internals.RocksDBStore.putInternal(RocksDBStore.java:330) > at > org.apache.kafka.streams.state.internals.RocksDBStore.put(RocksDBStore.java:292) > at > org.apache.kafka.streams.state.internals.ChangeLoggingKeyValueBytesStore.put(ChangeLoggingKeyValueBytesStore.java:57) > at > org.apache.kafka.streams.state.internals.ChangeLoggingKeyValueBytesStore.put(ChangeLoggingKeyValueBytesStore.java:29) > at > org.apache.kafka.streams.state.internals.CachingKeyValueStore.putAndMaybeForward(CachingKeyValueStore.java:97) > at > org.apache.kafka.streams.state.internals.CachingKeyValueStore.access$000(CachingKeyValueStore.java:35) > at > org.apache.kafka.streams.state.internals.CachingKeyValueStore$1.apply(CachingKeyValueStore.java:79) > at > org.apache.kafka.streams.state.internals.NamedCache.flush(NamedCache.java:141) > at > org.apache.kafka.streams.state.internals.NamedCache.flush(NamedCache.java:99) > at > org.apache.kafka.streams.state.internals.ThreadCache.flush(ThreadCache.java:127) > at > org.apache.kafka.streams.state.internals.CachingKeyValueStore.flush(CachingKeyValueStore.java:112) > at > org.apache.kafka.streams.state.internals.InnerMeteredKeyValueStore.flush(InnerMeteredKeyValueStore.java:268) > at > org.apache.kafka.streams.state.internals.MeteredKeyValueBytesStore.flush(MeteredKeyValueBytesStore.java:153) > at > org.apache.kafka.streams.processor.internals.ProcessorStateManager.flush(ProcessorStateManager.java:242) > > Thanks, > Siva >
signature.asc
Description: OpenPGP digital signature
