Hi
I'm working on a topology with Storm 0.9.1-incubating and version 0.4.0 of
the net.wurstmeister.storm TransactionalTridentKafkaSpout and I'm
periodically getting an error which repeatedly takes down the worker
running the spout and persists when I kill and resubmit the topology.
Specifically, I see the following exception:
java.lang.RuntimeException: java.lang.RuntimeException: Error when
re-emitting batch. overshot the end offset
at
backtype.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:90)
~[storm-core-0.9.0.1.jar:na]
at
backtype.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:61)
~[storm-core-0.9.0.1.jar:na]
at
backtype.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:62)
~[storm-core-0.9.0.1.jar:na]
at
backtype.storm.daemon.executor$fn__3498$fn__3510$fn__3557.invoke(executor.clj:730)
~[storm-core-0.9.0.1.jar:na]
at backtype.storm.util$async_loop$fn__444.invoke(util.clj:403)
~[storm-core-0.9.0.1.jar:na]
at clojure.lang.AFn.run(AFn.java:24) [clojure-1.4.0.jar:na]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_60]
Caused by: java.lang.RuntimeException: Error when re-emitting batch.
overshot the end offset
at
storm.kafka.trident.TridentKafkaEmitter.reEmitPartitionBatch(TridentKafkaEmitter.java:149)
~[stormjar.jar:na]
at
storm.kafka.trident.TridentKafkaEmitter.access$500(TridentKafkaEmitter.java:34)
~[stormjar.jar:na]
at
storm.kafka.trident.TridentKafkaEmitter$2.emitPartitionBatch(TridentKafkaEmitter.java:230)
~[stormjar.jar:na]
at
storm.kafka.trident.TridentKafkaEmitter$2.emitPartitionBatch(TridentKafkaEmitter.java:213)
~[stormjar.jar:na]
at
storm.trident.spout.PartitionedTridentSpoutExecutor$Emitter.emitBatch(PartitionedTridentSpoutExecutor.java:116)
~[storm-core-0.9.0.1.jar:na]
at
storm.trident.spout.TridentSpoutExecutor.execute(TridentSpoutExecutor.java:65)
~[storm-core-0.9.0.1.jar:na]
at
storm.trident.topology.TridentBoltExecutor.execute(TridentBoltExecutor.java:352)
~[storm-core-0.9.0.1.jar:na]
at
backtype.storm.daemon.executor$fn__3498$tuple_action_fn__3500.invoke(executor.clj:615)
~[storm-core-0.9.0.1.jar:na]
at
backtype.storm.daemon.executor$mk_task_receiver$fn__3421.invoke(executor.clj:383)
~[storm-core-0.9.0.1.jar:na]
at
backtype.storm.disruptor$clojure_handler$reify__2962.onEvent(disruptor.clj:43)
~[storm-core-0.9.0.1.jar:na]
at
backtype.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:87)
~[storm-core-0.9.0.1.jar:na]
... 6 common frames omitted
and I've been unable to track down the cause. Does anyone know what might
be causing this exception, and how I can fix or prevent it? Any assistance
would be greatly appreciated.
Thanks,
Evan Sparks
