There are overloaded changes. You don't have to use them (e.g. key is now used in compaction with partKey for the partition key https://github.com/apache/kafka/commit/d285e263bf403f3db27f5d138594c395643a2284#diff-9df10051217ceff96ecce28d087cf0bb for new compaction feature https://cwiki.apache.org/confluence/display/KAFKA/Log+Compaction). If you can keep on the latest stable release you will get the most support options from the community.
We also have downloads for the 0.8.0 release so you do not have to build. That might be an option for now and migrate later? https://kafka.apache.org/downloads.html - Release Notes <https://archive.apache.org/dist/kafka/0.8.0/RELEASE_NOTES.html> - Source download: kafka-0.8.0-src.tgz <https://archive.apache.org/dist/kafka/0.8.0/kafka-0.8.0-src.tgz> (asc <https://archive.apache.org/dist/kafka/0.8.0/kafka-0.8.0-src.tgz.asc>, md5 <https://archive.apache.org/dist/kafka/0.8.0/0.8.0/kafka-0.8.0-src.tgz.md5> ) - Binary download: kafka_2.8.0-0.8.0.tar.gz <https://archive.apache.org/dist/kafka/0.8.0/kafka_2.8.0-0.8.0.tar.gz> ( asc <https://archive.apache.org/dist/kafka/0.8.0/kafka_2.8.0-0.8.0.tar.gz.asc> , md5 <https://archive.apache.org/dist/kafka/0.8.0/kafka_2.8.0-0.8.0.tar.gz.md5> ) You can also look at the release process for 0.8.0 and below https://cwiki.apache.org/confluence/display/KAFKA/Release+Process with sbt maybe there is a step you missed or incorrect something or another. /******************************************* Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://www.stealth.ly Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop> ********************************************/ On Thu, Jun 5, 2014 at 8:16 AM, Abhishek Bhattacharjee < abhishek.bhattacharje...@gmail.com> wrote: > I have a project running on kafka.0.8.0. Are there any changes in the > Producer and consumer APIs in the new version ? > Thanks. > On Jun 5, 2014 3:53 PM, "Joe Stein" <joe.st...@stealth.ly> wrote: > > > Can you try the latest stable branch, please? > > > > We moved to gradle https://github.com/apache/kafka/blob/0.8.1/README.md > > and > > also distribute binaries as artifacts for download > > https://kafka.apache.org/downloads.html > > > > /******************************************* > > Joe Stein > > Founder, Principal Consultant > > Big Data Open Source Security LLC > > http://www.stealth.ly > > Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop> > > ********************************************/ > > > > > > On Thu, Jun 5, 2014 at 4:25 AM, Abhishek Bhattacharjee < > > abhishek.bhattacharje...@gmail.com> wrote: > > > > > Thanks for the reply. I re built kafka. And now when I am running > server > > it > > > is stopping saying it cannot find the class Kafka.Kafka. > > > I don't know what went most probably it's an sbt problem. > > > Any help is welcome. > > > Thanks :-) > > > On Jun 5, 2014 6:05 AM, "Joe Stein" <joe.st...@stealth.ly> wrote: > > > > > > > The build looks fine your error seems valid maybe like your broker(s) > > > > is(are) not up. > > > > > > > > /******************************************* > > > > Joe Stein > > > > Founder, Principal Consultant > > > > Big Data Open Source Security LLC > > > > http://www.stealth.ly > > > > Twitter: @allthingshadoop > > > > ********************************************/ > > > > > > > > > > > > > On Jun 4, 2014, at 8:07 PM, Abhishek Bhattacharjee < > > > > abhishek.bhattacharje...@gmail.com> wrote: > > > > > > > > > > I followed the readme for kafka-0.8.0. > > > > > After I am getting the following warnings > > > > > > > > > >>> ./sbt assembly-package-dependency > > > > > > > > > > [info] Loading project definition from > > > > > /home/abhishek/Project/kafka-0.8.0-src/project > > > > > [warn] Multiple resolvers having different access mechanism > > configured > > > > with > > > > > same name 'sbt-plugin-releases'. To avoid conflict, Remove > duplicate > > > > > project resolvers (`resolvers`) or rename publishing resolver > > > > (`publishTo`). > > > > > [info] Set current project to Kafka (in build > > > > > file:/home/abhishek/Project/kafka-0.8.0-src/) > > > > > [warn] Credentials file /home/abhishek/.m2/.credentials does not > > exist > > > > > [info] Compiling 213 Scala sources and 2 Java sources to > > > > > > > > > /home/abhishek/Project/kafka-0.8.0-src/core/target/scala-2.8.0/classes... > > > > > [warn] > > > > > > > > > > > > > > > /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/api/LeaderAndIsrResponse.scala:66: > > > > > non variable type-argument String in type pattern (String, Int) is > > > > > unchecked since it is eliminated by erasure > > > > > [warn] for ((key:(String, Int), value) <- responseMap) { > > > > > [warn] ^ > > > > > [warn] > > > > > > > > > > > > > > > /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/api/StopReplicaResponse.scala:67: > > > > > non variable type-argument String in type pattern (String, Int) is > > > > > unchecked since it is eliminated by erasure > > > > > [warn] for ((key:(String, Int), value) <- responseMap){ > > > > > [warn] ^ > > > > > [warn] > > > > > > > > > > > > > > > /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/utils/Utils.scala:383: > > > > > non variable type-argument V in type pattern List[V] is unchecked > > since > > > > it > > > > > is eliminated by erasure > > > > > [warn] case Some(l: List[V]) => m.put(k, v :: l) > > > > > [warn] ^ > > > > > [warn] three warnings found > > > > > [warn] warning: [options] bootstrap class path not set in > conjunction > > > > with > > > > > -source 1.5 > > > > > [warn] > > > > > > > > > > > > > > > /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:261: > > > > > warning: [unchecked] unchecked conversion > > > > > [warn] ProducerThread producerThread = new > > > > > ProducerThread(producerDataChannel, producer, i); > > > > > [warn] > > > > > ^ > > > > > [warn] required: Producer<byte[],byte[]> > > > > > [warn] found: Producer > > > > > [warn] > > > > > > > > > > > > > > > /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:338: > > > > > warning: [unchecked] unchecked call to KeyedMessage(String,K,V) as > a > > > > member > > > > > of the raw type KeyedMessage > > > > > [warn] KeyedMessage<byte[], byte[]> producerData = new > > > > > KeyedMessage((String)topic, null, bytes); > > > > > [warn] ^ > > > > > [warn] where K,V are type-variables: > > > > > [warn] K extends Object declared in class KeyedMessage > > > > > [warn] V extends Object declared in class KeyedMessage > > > > > [warn] > > > > > > > > > > > > > > > /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:338: > > > > > warning: [unchecked] unchecked conversion > > > > > [warn] KeyedMessage<byte[], byte[]> producerData = new > > > > > KeyedMessage((String)topic, null, bytes); > > > > > [warn] ^ > > > > > [warn] required: KeyedMessage<byte[],byte[]> > > > > > [warn] found: KeyedMessage > > > > > [warn] > > > > > > > > > > > > > > > /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:371: > > > > > warning: [unchecked] unchecked call to KeyedMessage(String,K,V) as > a > > > > member > > > > > of the raw type KeyedMessage > > > > > [warn] private KeyedMessage<byte[], byte[]> shutdownMessage = > new > > > > > KeyedMessage("shutdown", null, null); > > > > > [warn] ^ > > > > > [warn] where K,V are type-variables: > > > > > [warn] K extends Object declared in class KeyedMessage > > > > > [warn] V extends Object declared in class KeyedMessage > > > > > [warn] > > > > > > > > > > > > > > > /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:371: > > > > > warning: [unchecked] unchecked conversion > > > > > [warn] private KeyedMessage<byte[], byte[]> shutdownMessage = > new > > > > > KeyedMessage("shutdown", null, null); > > > > > [warn] ^ > > > > > [warn] required: KeyedMessage<byte[],byte[]> > > > > > [warn] found: KeyedMessage > > > > > [warn] 6 warnings > > > > > [info] Including zkclient-0.3.jar > > > > > [info] Including snappy-java-1.0.4.1.jar > > > > > [info] Including zookeeper-3.3.4.jar > > > > > [info] Including metrics-core-2.2.0.jar > > > > > [info] Including metrics-annotation-2.2.0.jar > > > > > [info] Including log4j-1.2.15.jar > > > > > [info] Including scala-compiler.jar > > > > > [info] Including jopt-simple-3.2.jar > > > > > [info] Including slf4j-api-1.7.2.jar > > > > > [info] Including slf4j-simple-1.6.4.jar > > > > > [info] Including scala-library.jar > > > > > [warn] Merging 'META-INF/NOTICE' with strategy 'rename' > > > > > [warn] Merging 'org/xerial/snappy/native/README' with strategy > > 'rename' > > > > > [warn] Merging > 'META-INF/maven/org.xerial.snappy/snappy-java/LICENSE' > > > > with > > > > > strategy 'rename' > > > > > [warn] Merging 'LICENSE.txt' with strategy 'rename' > > > > > [warn] Merging 'META-INF/LICENSE' with strategy 'rename' > > > > > [warn] Merging 'META-INF/MANIFEST.MF' with strategy 'discard' > > > > > [warn] Strategy 'discard' was applied to a file > > > > > [warn] Strategy 'rename' was applied to 5 files > > > > > [info] Packaging > > > > > > > > > > > > > > > /home/abhishek/Project/kafka-0.8.0-src/core/target/scala-2.8.0/kafka-assembly-0.8.0-deps.jar > > > > > ... > > > > > [info] Done packaging. > > > > > [success] Total time: 67 s, completed 5 Jun, 2014 5:31:28 AM > > > > > > > > > > I am not able run my Producer to insert into kafka. > > > > > The server runs but data doesn't go in. LeaderNotAvailableException > > is > > > > > raised. > > > > > > > > > > Thanks > > > > > -- > > > > > *Abhishek Bhattacharjee* > > > > > *Pune Institute of Computer Technology* > > > > > > > > > >
