[
https://issues.apache.org/jira/browse/KAFKA-1456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14017931#comment-14017931
]
Joel Koshy commented on KAFKA-1456:
-----------------------------------
Actually I think there is a run-time dependency.
* {{rm -f ./core/build/dependant-libs-2.8.0/lz4-1.2.0.jars}}
* Start your kafka broker and zookeeper
* {{./bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test
--compression-codec gzip}}
{code}
[2014-06-04 10:41:27,722] ERROR Failed to send messages
(kafka.producer.async.DefaultEventHandler)
java.lang.NoClassDefFoundError: net/jpountz/lz4/LZ4BlockInputStream
at
kafka.message.ByteBufferMessageSet$.kafka$message$ByteBufferMessageSet$$create(ByteBufferMessageSet.scala:41)
at
kafka.message.ByteBufferMessageSet.<init>(ByteBufferMessageSet.scala:102)
at
kafka.producer.async.DefaultEventHandler$$anonfun$7.apply(DefaultEventHandler.scala:313)
at
kafka.producer.async.DefaultEventHandler$$anonfun$7.apply(DefaultEventHandler.scala:301)
at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
at
scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:80)
at
scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:80)
at scala.collection.Iterator$class.foreach(Iterator.scala:631)
at
scala.collection.mutable.HashTable$$anon$1.foreach(HashTable.scala:161)
at
scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:194)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:39)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:80)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
at scala.collection.mutable.HashMap.map(HashMap.scala:39)
at
kafka.producer.async.DefaultEventHandler.kafka$producer$async$DefaultEventHandler$$groupMessagesToSet(DefaultEventHandler.scala:301)
at
kafka.producer.async.DefaultEventHandler$$anonfun$dispatchSerializedData$1.apply(DefaultEventHandler.scala:104)
at
kafka.producer.async.DefaultEventHandler$$anonfun$dispatchSerializedData$1.apply(DefaultEventHandler.scala:100)
at
scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:80)
at
scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:80)
at scala.collection.Iterator$class.foreach(Iterator.scala:631)
at
scala.collection.mutable.HashTable$$anon$1.foreach(HashTable.scala:161)
at
scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:194)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:39)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:80)
at
kafka.producer.async.DefaultEventHandler.dispatchSerializedData(DefaultEventHandler.scala:100)
at
kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.scala:72)
at
kafka.producer.async.ProducerSendThread.tryToHandle(ProducerSendThread.scala:104)
at
kafka.producer.async.ProducerSendThread$$anonfun$processEvents$3.apply(ProducerSendThread.scala:87)
at
kafka.producer.async.ProducerSendThread$$anonfun$processEvents$3.apply(ProducerSendThread.scala:67)
at scala.collection.immutable.Stream.foreach(Stream.scala:254)
at
kafka.producer.async.ProducerSendThread.processEvents(ProducerSendThread.scala:66)
at
kafka.producer.async.ProducerSendThread.run(ProducerSendThread.scala:44)
Caused by: java.lang.ClassNotFoundException: net.jpountz.lz4.LZ4BlockInputStream
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
... 33 more
{code}
However, this applies to snappy as well.
> Add LZ4 and LZ4C as a compression codec
> ---------------------------------------
>
> Key: KAFKA-1456
> URL: https://issues.apache.org/jira/browse/KAFKA-1456
> Project: Kafka
> Issue Type: Improvement
> Reporter: Joe Stein
> Labels: newbie
> Fix For: 0.8.2
>
> Attachments: KAFKA-1456.patch, KAFKA-1456_2014-05-19_15:01:10.patch,
> KAFKA-1456_2014-05-19_16:39:01.patch, KAFKA-1456_2014-05-19_18:19:32.patch,
> KAFKA-1456_2014-05-19_23:24:27.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.2#6252)
