Re: programmatically get number of items in topic/partition

The other method is via command line bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --group *groupName* --zkconnect *zkServer:2181* Refer : https://cwiki.apache.org/confluence/display/KAFKA/System+Tools#SystemTools-ConsumerOffsetChecker https://apache.googlesource.com/kafka/+/0.8.0-bet

Re: Announcing Confluent

Congrats Jay, Neha and Jun. Look forward to it. On Thu, Nov 6, 2014 at 10:28 AM, Jay Kreps wrote: > Hey all, > > I’m happy to announce that Jun Rao, Neha Narkhede and I are creating a > company around Kafka called Confluent. We are planning on productizing the > kind of Kafka-based real-time dat

Re: S3 Consumer

Noticed this s3 based consumer project on github https://github.com/razvan/kafka-s3-consumer On Dec 27, 2012, at 7:08 AM, David Arthur wrote: > I don't think anything exists like this in Kafka (or contrib), but it would > be a useful addition! Personally, I have written this exact thing at p

Kafka distribution on public Maven repo

Hey Jay This question might have been posed a million times, but thought I might pose it again. Why has kafka not been published to a public Maven repo? Chetan

Re: 0.8.0-beta1 is now available in public maven

Excellent What about the resolver ? sonatype, typeafe. maven artifactory ? Any plans for a 2.10+ compile as well On Sun, Jul 14, 2013 at 6:37 PM, Dima Gutzeit wrote: > What about the "newer" (not so new anymore) scala version 2.10.0 and up ? > When will it be supported officially ? > > > Regar

Re: 0.8.0-beta1 is now available in public maven

I stumbled on a few issues when I was attempting to create a Scala based Client (Producer/Consumer) project. Finally worked after revisions: Here's the snippet of by build.sbt ~~ /* scala versions and options */ scalaVersion := "2.9.2" libraryDependencies += "org.apache.kafka" %

Re: Loadbalancing producers

As Benjamin indicated, you wouldn't get much out of an LB in front of brokers, especially if the producers are configured in async mode (which you would want to in order to increase throughput). On Thu, Aug 29, 2013 at 8:54 AM, Mark wrote: > Can you explain why not? > > On Aug 29, 2013, at 8:4

Re: Producer not distributing across all partitions

I am using kafka 0.8.0-beta1 .. Seems like messages are being delivered only to one partition (since installation) Should I upgrade or apply a patch to mitigate this issue. Please advice On Thu, Sep 12, 2013 at 8:44 PM, Jun Rao wrote: > Which revision of 0.8 are you using? In a recent change

Re: Producer not distributing across all partitions

Prashant I recall you mentioning that you are on the 0.8 branch .. If so, can you check your producer to verify if you are using DefaultParitioner, SimplePartitioner or null (which defaults to RandomParitioner)? *kafkaProps.put("partitioner.class", "kafka.producer.DefaultPartitioner") * Also ,

Re: Producer not distributing across all partitions

Swapnil What do you mean by "I did a local test today that showed that choosing DefaultPartitioner with null key in the messages appended data to multiple partitions"? Are messages being duplicated across partitions? -Chetan On Sat, Sep 14, 2013 at 9:02 PM, Swapnil Ghike wrote: > Hi Joe, Dre

Re: Plan for Scala 2.10+ support

Are there any public maven repos hosting 0.8 with 2.10+ support.? Sent from my iPhone > On Oct 29, 2013, at 8:32 PM, Aniket Bhatnagar > wrote: > > The latest 0.8 branch has support for scala 2.10. We use it in our > projects. Once 0.8 is released, I believe you should be able to see 2.10 > ar

Re: Plan for Scala 2.10+ support

*/ > > > On Tue, Oct 29, 2013 at 11:43 PM, Aniket Bhatnagar < > aniket.bhatna...@gmail.com> wrote: > >> I haven't been able to find one which we why had to build Kafka 0.8 from >> source. It's not super hard though to build Kafka. >> >>

Re: Using Kafka 0.8 from Scala and Akka

I am in the process of releasing out Scala and RxJava consumer(s) on github. Will be releasing it soon. Keep an eye out. On Thu, Oct 31, 2013 at 3:49 PM, Richard Rodseth wrote: > So I have the 0.8. Beta 1 consumer Java example running now. > > Is there a Scala API documented somewhere? What abo

Re: Adding Kafka dependencies in Play Framework

Add the following to a Play Project with Scala 2.9.2 scalaVersion := "2.9.2" libraryDependencies ++= Seq( "joda-time" % "joda-time" % "2.2", "org.joda" % "joda-convert" % "1.3.1", "ch.qos.logback" % "logback-classic" % "1.0.13", "org.mashupbots.socko" % "socko-webserver_2.9.2" % "0.2

Re: Anyone working on a Kafka book?

Hey Guys Yes, Ben Lorica (Oreilly) and I are planning to pen a "Beginning Kafka" book. We only finalized this late October are hoping to start this mid-month Chetan On Tue, Dec 10, 2013 at 8:45 AM, Steve Morin wrote: > I'll let chetan comment if he's up for it. > -Steve > > > > On Tue, Dec 10

Re: kafka monitoring system

Try SemaText : a fully managed monitoring SaaS : http://sematext.com/ ... On Mon, Dec 22, 2014 at 7:46 PM, Rajasekar Elango wrote: > Hi Sa Li, > > You can also try jmxtrans + graphite (for charting). jmxtrans has graphite > output adapter out of the box. > > Regards, > Raja. > > On Mon, Dec 22,