Re: [VOTE] 0.8.2.0 Candidate 1

2015-01-18 Thread Jun Rao
There seems to be an issue with the pom file for kafka_2.11-0.8.2 jar. It references scala-library 2.11, which doesn't exist in maven central (2.11.1, etc do exist). This seems to be an issue in the 0.8.2 beta as well. I tried to reference kafka_2.11-0.8.2 beta in a project and the build failed

Re: [VOTE] 0.8.2.0 Candidate 1

2015-01-16 Thread svante karlsson
I upgrade two small test cluster and I had two small issues but I'm, not clear yet as to if those were an issue due to us using ansible to configure and deploy the cluster. The first issue could be us doing something bad when distributing the update (I updated, not reinstalled) but it should be

Re: [VOTE] 0.8.2.0 Candidate 1

2015-01-16 Thread Jun Rao
Svante, I tested this out locally and the mbeans for those metrics do show up on startup. Can you reproduce the issue reliably? Also, is what you saw an issue with the mbean itself or graphite? Thanks, Jun On Fri, Jan 16, 2015 at 4:38 AM, svante karlsson s...@csi.se wrote: I upgrade two

Re: [VOTE] 0.8.2.0 Candidate 1

2015-01-16 Thread svante karlsson
Jun, I don't know if it was an issue with graphite or the mbean but I have not seen it since - and we have tried of several cases of failover and this problem has only been seen once. That said, I have the feeling that it was a kafka issue and I'm a bit suspicious about the new mbeans. I attach

Re: [VOTE] 0.8.2.0 Candidate 1

2015-01-16 Thread svante karlsson
Disregard the previous message, it was send accidently.. Jun, I don't know if it was an issue with graphite or the mbean and have not seen it since - and we have tried of several cases of failover. That said, I have the feeling that it was a kafka issue and I'm a bit suspicious about the new

Re: [VOTE] 0.8.2.0 Candidate 1

2015-01-16 Thread Jun Rao
Apache mailing list doesn't allow attachments. Could you file a jira and attach the graph and the description there? Thanks, Jun On Fri, Jan 16, 2015 at 12:09 PM, svante karlsson s...@csi.se wrote: Disregard the previous message, it was send accidently.. Jun, I don't know if it was an

Re: [VOTE] 0.8.2.0 Candidate 1

2015-01-16 Thread Jun Rao
I did some quick tests and the mbean values look reasonable. On the producer side, produce msg/sec is actually for all brokers. Thanks, Jun On Fri, Jan 16, 2015 at 12:09 PM, svante karlsson s...@csi.se wrote: Disregard the previous message, it was send accidently.. Jun, I don't know if it

Re: [VOTE] 0.8.2.0 Candidate 1

2015-01-16 Thread Jun Rao
Perhaps you can see if you can reproduce this issue and then file a jira. Thanks, Jun On Fri, Jan 16, 2015 at 4:39 PM, svante karlsson s...@csi.se wrote: Hmm, produce msg/sec in rate seems to be per broker and produce msg/per sec should also be per broker and thus be related. The problem is

Re: [VOTE] 0.8.2.0 Candidate 1

2015-01-15 Thread Jay Kreps
Yeah, good call on removing it. -Jay On Thu, Jan 15, 2015 at 6:39 AM, scott@heroku sc...@heroku.com wrote: That opt has been the default for a long while now iirc, maybe it can be removed? Sent from my iPhone On Jan 15, 2015, at 5:21 AM, Jaikiran Pai jai.forums2...@gmail.com wrote:

Re: [VOTE] 0.8.2.0 Candidate 1

2015-01-15 Thread scott@heroku
That opt has been the default for a long while now iirc, maybe it can be removed? Sent from my iPhone On Jan 15, 2015, at 5:21 AM, Jaikiran Pai jai.forums2...@gmail.com wrote: I just downloaded the Kafka binary and am trying this on my 32 bit JVM (Java 7)? Trying to start Zookeeper or

Re: [VOTE] 0.8.2.0 Candidate 1

2015-01-15 Thread Jun Rao
Thanks for reporting this. I will remove that option in RC2. Jun On Thu, Jan 15, 2015 at 5:21 AM, Jaikiran Pai jai.forums2...@gmail.com wrote: I just downloaded the Kafka binary and am trying this on my 32 bit JVM (Java 7)? Trying to start Zookeeper or Kafka server keeps failing with

Re: [VOTE] 0.8.2.0 Candidate 1

2015-01-15 Thread Jun Rao
Yes, I agree it's probably better not to enable delete.topic.enable by default. Thanks, Jun On Thu, Jan 15, 2015 at 6:29 PM, Joe Stein joe.st...@stealth.ly wrote: I think that is a change of behavior that organizations may get burned on. Right now there is no delete data feature. If an

Re: [VOTE] 0.8.2.0 Candidate 1

2015-01-15 Thread Gwen Shapira
Would make sense to enable it after we have authorization feature and admins can control who can delete what. On Thu, Jan 15, 2015 at 6:32 PM, Jun Rao j...@confluent.io wrote: Yes, I agree it's probably better not to enable delete.topic.enable by default. Thanks, Jun On Thu, Jan 15, 2015

Re: [VOTE] 0.8.2.0 Candidate 1

2015-01-15 Thread Manikumar Reddy
Also can we remove delete.topic.enable config property and enable topic deletion by default? On Jan 15, 2015 10:07 PM, Jun Rao j...@confluent.io wrote: Thanks for reporting this. I will remove that option in RC2. Jun On Thu, Jan 15, 2015 at 5:21 AM, Jaikiran Pai jai.forums2...@gmail.com

Re: [VOTE] 0.8.2.0 Candidate 1

2015-01-15 Thread Jaikiran Pai
I just downloaded the Kafka binary and am trying this on my 32 bit JVM (Java 7)? Trying to start Zookeeper or Kafka server keeps failing with Unrecognized VM option 'UseCompressedOops': ./zookeeper-server-start.sh ../config/zookeeper.properties Unrecognized VM option 'UseCompressedOops' Error:

Re: [VOTE] 0.8.2.0 Candidate 1

2015-01-15 Thread Joe Stein
I think that is a change of behavior that organizations may get burned on. Right now there is no delete data feature. If an operations teams upgrades to 0.8.2 and someone decides to delete a topic then there will be data loss. The organization may not have wanted that to happen. I would argue to

Re: [VOTE] 0.8.2.0 Candidate 1

2015-01-14 Thread Jun Rao
+ users mailing list. It would be great if people can test this out and report any blocker issues. Thanks, Jun On Tue, Jan 13, 2015 at 7:16 PM, Jun Rao j...@confluent.io wrote: This is the first candidate for release of Apache Kafka 0.8.2.0. There has been some changes since the 0.8.2 beta