Hi,
I found a problem that says Memory records is not writable in MirrorMaker
when producer sending out messages:
[2016-01-08 18:52:30,729] FATAL [mirrormaker-thread-32] Mirror maker thread
failure due to (kafka.tools.MirrorMaker$MirrorMakerThread)
java.lang.IllegalStateException: Memory records is not writable
at
org.apache.kafka.common.record.MemoryRecords.append(MemoryRecords.java:93)
at
org.apache.kafka.clients.producer.internals.RecordBatch.tryAppend(RecordBatch.java:69)
at
org.apache.kafka.clients.producer.internals.RecordAccumulator.append(RecordAccumulator.java:168)
at
org.apache.kafka.clients.producer.KafkaProducer.send(KafkaProducer.java:439)
at
kafka.tools.MirrorMaker$MirrorMakerProducer.send(MirrorMaker.scala:593)
at
kafka.tools.MirrorMaker$MirrorMakerThread$$anonfun$run$3.apply(MirrorMaker.scala:398)
at
kafka.tools.MirrorMaker$MirrorMakerThread$$anonfun$run$3.apply(MirrorMaker.scala:398)
at scala.collection.Iterator$class.foreach(Iterator.scala:742)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1194)
at
scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
The above message repeated several times and at last the MirrorMaker is
shutdown:
[2016-01-08 18:52:31,256] FATAL [mirrormaker-thread-59] Mirror maker thread
exited abnormally, stopping the whole mirror maker.
(kafka.tools.MirrorMaker$MirrorMakerThread)
MirrorMaker was shutdown around 30 minutes right after every time I started
it, it is using plain text protocol(No SSL), and the mirrormaker has
options of "--abort.on.send.failure false" and "--num.streams 100" . And it
is running with kafka 0.9 release. Does anybody know how to solve this
problem?
Thanks!
Samuel