Re: Kafka throw InvalidMessageException and lost data

2013-03-20 Thread Yang Zhou
; > at > > > > > > > > > > > > > > > > > > > > > > > > > > > kafka.server.KafkaRequestHandlers.handleMultiProducerRequest(KafkaRequestHandlers.scala:59) > > > > > > > > > > > > Or this: > > > > > > > > > > > > 1830146 [kafka-processor-0] ERROR kafka.network.Processor - > > Closing > > > > > socket > > > > > > for /10.0.2.140 because of error > > > > > > java.lang.IllegalArgumentException > > > > > > at java.nio.Buffer.limit(Buffer.java:266) > > > > > > at > > kafka.api.ProducerRequest$.readFrom(ProducerRequest.scala:33) > > > > > > at > > > > > > > > > > > > > > > > > > > > > > > > > > > kafka.api.MultiProducerRequest$$anonfun$readFrom$1.apply$mcVI$sp(MultiProducerRequest.scala:28) > > > > > > at > > > > > > > > > > > > > > > > > > > > > > > > > > > scala.collection.immutable.Range$ByOne$class.foreach$mVc$sp(Range.scala:282) > > > > > > at > > > > > > > > > > > > scala.collection.immutable.Range$$anon$2.foreach$mVc$sp(Range.scala:265) > > > > > > at > > > > > > > > > kafka.api.MultiProducerRequest$.readFrom(MultiProducerRequest.scala:27) > > > > > > at > > > > > > > > > > > > > > > > > > > > > > > > > > > kafka.server.KafkaRequestHandlers.handleMultiProducerRequest(KafkaRequestHandlers.scala:59) > > > > > > at > > > > > > > > > > > > > > > > > > > > > > > > > > > kafka.server.KafkaRequestHandlers$$anonfun$handlerFor$4.apply(KafkaRequestHandlers.scala:41) > > > > > > at > > > > > > > > > > > > > > > > > > > > > > > > > > > kafka.server.KafkaRequestHandlers$$anonfun$handlerFor$4.apply(KafkaRequestHandlers.scala:41) > > > > > > at kafka.network.Processor.handle(SocketServer.scala:296) > > > > > > at kafka.network.Processor.read(SocketServer.scala:319) > > > > > > at kafka.network.Processor.run(SocketServer.scala:214) > > > > > > at java.lang.Thread.run(Thread.java:636) > > > > > > > > > > > > It bothers us for a few days, and at first we thought it might be > > > some > > > > > > wrong configuration settings, and we changed to the wiki's > > > recommended > > > > > > configuration, but unfortunately the exceptions still came out. > > > > > > > > > > > > In what situation can these exceptions be thrown out ? What can > we > > > do > > > > to > > > > > > avoid these exceptions ? > > > > > > > > > > > > THANKS > > > > > > > > > > > > -- > > > > > > *Best Regards > > > > > > > > > > > > Xiang Helin* > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > *Best Regards > > > > > > > > 向河林* > > > > > > > > > > > > > > > -- > > Guodong Wang > > 王国栋 > > > -- Yang Zhou(周阳) Department of Computer Science and Engineering Shanghai Jiao Tong University

Re: Kafka throw InvalidMessageException and lost data

2013-03-20 Thread Yang Zhou
ala.collection.immutable.Range$$anon$2.foreach$mVc$sp(Range.scala:265) > > > > > > at > > > > > > > > > kafka.api.MultiProducerRequest$.readFrom(MultiProducerRequest.scala:27) > > > > > > at > > > > > > > > > >