Hi folks, I wanted to post this error out here in case it looks familiar.
I'm been struggling a bit trying to make Kafka snappy compressor work under
Jetty6.
I'm getting:
Caused by: java.lang.UnsatisfiedLinkError:
org.xerial.snappy.SnappyNative.maxCompressedLength(I)I
at org.xerial.snappy.SnappyNative.maxCompressedLength(Native Method)
at org.xerial.snappy.Snappy.maxCompressedLength(Snappy.java:316)
at
org.xerial.snappy.SnappyOutputStream.<init>(SnappyOutputStream.java:79)
at
org.xerial.snappy.SnappyOutputStream.<init>(SnappyOutputStream.java:66)
at kafka.message.SnappyCompression.<init>(CompressionUtils.scala:61)
at
kafka.message.CompressionFactory$.apply(CompressionUtils.scala:82)
at
kafka.message.CompressionUtils$.compress(CompressionUtils.scala:109)
at kafka.message.MessageSet$.createByteBuffer(MessageSet.scala:71)
at
kafka.message.ByteBufferMessageSet.<init>(ByteBufferMessageSet.scala:44)
at
kafka.producer.ProducerPool$$anonfun$send$1$$anonfun$3.apply(ProducerPool.scala:106)
at
kafka.producer.ProducerPool$$anonfun$send$1$$anonfun$3.apply(ProducerPool.scala:105)
at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
at
scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:57)
at
scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:43)
at
scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
at scala.collection.mutable.ArrayBuffer.map(ArrayBuffer.scala:43)
at
kafka.producer.ProducerPool$$anonfun$send$1.apply$mcVI$sp(ProducerPool.scala:105)
at
kafka.producer.ProducerPool$$anonfun$send$1.apply(ProducerPool.scala:100)
at
kafka.producer.ProducerPool$$anonfun$send$1.apply(ProducerPool.scala:100)
at
scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:57)
at
scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:43)
at kafka.producer.ProducerPool.send(ProducerPool.scala:100)
at kafka.producer.Producer.zkSend(Producer.scala:137)
at kafka.producer.Producer.send(Producer.scala:99)
at kafka.javaapi.producer.Producer.send(Producer.scala:103)
at
com.lucid.dao.queue.impl.kafka.KafkaProducer.send(KafkaProducer.java:70)
at
com.lucid.dao.RemoteDataSourceController.refreshDataSource(RemoteDataSourceController.java:506)
AFAIK the error above occurs when Snappy is initialized multiple times:
http://code.google.com/p/snappy-java/issues/detail?id=21
I also tried to declare Snappy as "provided" scope in my maven project and
placing the jar manually in jetty/lib directory. But this throws a
ClassNotFoundError.
Does anyone have any advice on what else to try ?
Thanks in advance.
Patricio
