Re: LeaderNotAvailableException: reventing the running of kafka-console-producer.bat

This can happen on the first message in a new topic. Do you see the exception on posting every message? Also, run kafka-console-consumer to see if you can see the message. Thanks, Jun On Thu, Apr 4, 2013 at 1:37 PM, Withers, Robert wrote: > I am brand new to exploration into kafka, for work.

Re: trouble loading kafka into eclipse

See if this thread help. Thanks, Jun On Thu, Apr 4, 2013 at 10:34 AM, Withers, Robert wrote: > I am struggling to load kafka into eclipse to get started. I have tried > to follow the instructions here: > https://cwiki.apache.org/KAFKA/developer-setup.html, but I cannot connect > to the SVN re

Re: How do you handle server down in producer

Not much you can do, right? Either buffer the Events in memory (for as much memory as you have) or drop it. IMHO if Kafka is a critical piece of your Infrastructure, it's hard to solve the issue of what to do when it goes down. Instead, engineer your system so your Producers and Kafka Brokers are

How do you handle server down in producer

What is the best way to handle kafka server going down during a message send by a producer? We have seen our producer stuck waiting until kafka server comes back. Is there ways the producer can catch a timeout or ways to test if Kafka server is up so to send the message. Having the producer hang

LeaderNotAvailableException: reventing the running of kafka-console-producer.bat

I am brand new to exploration into kafka, for work. Any help is much appreciated. A co-worker built and updated a package for us to use on windows. I have no idea what version it is. We cannot update through our firewall. :( I am able to start the zookeeper and a kafka server, but when I

Re: pushing delete topic feature out of 0.8

Since you need to learn about the leader for a topic in order to do anything, you kind of already have "auto-create" since getting metadata for a topic will create it if it doesn't exist. As for auto-delete, log files will be deleted over time (per the usual policy). There will be residual stu

Re: pushing delete topic feature out of 0.8

Ok, This is a feature I've been hoping for, so I added an upvote to Kafka-330. But I will defer to you in terms of not wanting to delay 0.8 unnecessarily. Will we still have a backhanded way to remove a topic if need be? Ultimately, I'd like to see the feature where a topic automatically is cr

Re: public maven repository for Kafka

Awesome! On Thu, Apr 4, 2013 at 10:18 AM, Neha Narkhede wrote: > Maven integration will be available for beta release once we resolve > the dependencies. > > Thanks, > Neha > > On Thu, Apr 4, 2013 at 10:14 AM, Jason Rosenberg wrote: > > Jun, > > > > Can you clarify, will the maven integration b

pushing delete topic feature out of 0.8

Hi, We started the work on deleting topics in 0.8 (kafka-330). We realized that it touches quite a few critical components such as controller, replica manager, and log, and it will take some time to stabilize this. In order not to delay the 0.8 release too much, I propose that we push this feature

trouble loading kafka into eclipse

I am struggling to load kafka into eclipse to get started. I have tried to follow the instructions here: https://cwiki.apache.org/KAFKA/developer-setup.html, but I cannot connect to the SVN repo to check-out. A co-worked pulled from github, but I seem to be missing a lot of jars. This post m

Re: public maven repository for Kafka

Maven integration will be available for beta release once we resolve the dependencies. Thanks, Neha On Thu, Apr 4, 2013 at 10:14 AM, Jason Rosenberg wrote: > Jun, > > Can you clarify, will the maven integration be available for the 0.8 beta > release, or only the final release? > > Jason > > > O

Re: public maven repository for Kafka

Jun, Can you clarify, will the maven integration be available for the 0.8 beta release, or only the final release? Jason On Thu, Apr 4, 2013 at 7:26 AM, Jun Rao wrote: > Not yet, but will be for the 0.8 release. > > Thanks, > > Jun > > > On Thu, Apr 4, 2013 at 5:29 AM, Oleg Ruchovets > wrote

Re: public maven repository for Kafka

We can answer that question better in a month or so, after the 0.8 beta is released and see how it works in prod. Thanks, Jun On Thu, Apr 4, 2013 at 8:33 AM, Oleg Ruchovets wrote: > Ok , So Let's say I have to release in a 6 month. What version of Kafka > should I use? What is the latest stab

Re: Got exception executing Kafka Producer.

You need to reference the version of Yammer shipping with Kafka. It is under \core\lib\metrics-* On Thu, Apr 4, 2013 at 11:41 AM, Oleg Ruchovets wrote: > I am executing a simple code like this: > > public class FirstKafkaTester { > public Producer initProducer(){ > Properties props =

Got exception executing Kafka Producer.

I am executing a simple code like this: public class FirstKafkaTester { public Producer initProducer(){ Properties props = new Properties(); props.put("zk.connect", "127.0.0.1:2181"); props.put("broker.list", "localhost:9092"); props.put("serializer.class", "kaf

Re: public maven repository for Kafka

Ok , So Let's say I have to release in a 6 month. What version of Kafka should I use? What is the latest stable version and is it good Idea to use 0.8? Thanks Oleg. On Thu, Apr 4, 2013 at 6:15 PM, Neha Narkhede wrote: > 0.8 beta will be released as soon as we can fix the JIRA dependencies. > We

Re: public maven repository for Kafka

0.8 beta will be released as soon as we can fix the JIRA dependencies. Website and docs will be updated as part of that. https://issues.apache.org/jira/browse/KAFKA-833 Thanks, Neha On Thu, Apr 4, 2013 at 7:45 AM, Oleg Ruchovets wrote: > Thanks Jun , When does 0.8 have to be released? Also I di

Re: public maven repository for Kafka

Thanks Jun , When does 0.8 have to be released? Also I didn't find API for 0.8 version? Is there a link to it? Thanks Oleg. On Thu, Apr 4, 2013 at 5:26 PM, Jun Rao wrote: > Not yet, but will be for the 0.8 release. > > Thanks, > > Jun > > > On Thu, Apr 4, 2013 at 5:29 AM, Oleg Ruchovets > wrot

Re: public maven repository for Kafka

Not yet, but will be for the 0.8 release. Thanks, Jun On Thu, Apr 4, 2013 at 5:29 AM, Oleg Ruchovets wrote: > Hi , Is there public repository for Kafka distribution? > > Thanks > Oleg. >

Re: .net (c#) kafka client

You can certainly use different clients for producers and consumers. E.g., you could have a Python producer, a C producer, and a Scala consumer; or any combination thereof. If you want your consumers to participate in a consumer group, you'll need to use the Java or Scala client (or a 3rd part

Re: kafka 0.8 release schedule?

Thanks!! On Thu, Apr 4, 2013 at 12:25 AM, Jun Rao wrote: > Soby, > > We plan to release 0.8 beta in Apr. Our build tool supports building on > different versions of scala and the default one is 2.8. > > Thanks, > > Jun > > > On Wed, Apr 3, 2013 at 4:02 PM, Soby Chacko wrote: > > > Hello, > > >

public maven repository for Kafka

Hi , Is there public repository for Kafka distribution? Thanks Oleg.

Re: .net (c#) kafka client

By the way. Should producer and consumer have to be the same client? I mean is it possible that producer will be C or Python and consumer will be java? Thanks Oleg. On Thu, Apr 4, 2013 at 12:24 AM, Matthew Rathbone wrote: > Maybe you could write a C# client. I don't think it would be super hard