Re: 0.9.0.0 RC4

+1 (binding). 1. Ran unit tests 2. Ran SSL & SASL tests using vagrant cluster. Thanks, Harsha On Mon, Nov 23, 2015, at 09:34 AM, Neha Narkhede wrote: > +1 (binding). > > Verified source and binary artifacts, ran unit tests. > > On Mon, Nov 23, 2015 at 9:32 AM, Jun Rao

[jira] [Commented] (KAFKA-2082) Kafka Replication ends up in a bad state

[ https://issues.apache.org/jira/browse/KAFKA-2082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022662#comment-15022662 ] Drew Zagieboylo commented on KAFKA-2082: I have also experience this behavior on 0.8.2.1 What is

[jira] [Created] (KAFKA-2874) zookeeper-server-stop.sh may fail to shutdown ZK and/or may stop unrelated processes

Michael Noll created KAFKA-2874: --- Summary: zookeeper-server-stop.sh may fail to shutdown ZK and/or may stop unrelated processes Key: KAFKA-2874 URL: https://issues.apache.org/jira/browse/KAFKA-2874

[GitHub] kafka pull request: MINOR: Introduce `installAll` and accept major...

GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/574 MINOR: Introduce `installAll` and accept major instead of full Scala version We can take advantage of the fact that major Scala versions are binary compatible (since 2.10) to make the build a little

[GitHub] kafka pull request: KAFKA-2874: shutdown ZK process reliably

GitHub user miguno opened a pull request: https://github.com/apache/kafka/pull/573 KAFKA-2874: shutdown ZK process reliably You can merge this pull request into a Git repository by running: $ git pull https://github.com/miguno/kafka KAFKA-2874 Alternatively you can review

[jira] [Commented] (KAFKA-2874) zookeeper-server-stop.sh may fail to shutdown ZK and/or may stop unrelated processes

[ https://issues.apache.org/jira/browse/KAFKA-2874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021804#comment-15021804 ] ASF GitHub Bot commented on KAFKA-2874: --- GitHub user miguno opened a pull request:

[GitHub] kafka pull request: MINOR: Bump version to 0.9.1.0-SNAPSHOT

GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/575 MINOR: Bump version to 0.9.1.0-SNAPSHOT Since we created the 0.9.0 branch a while back. You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka

[jira] [Commented] (KAFKA-2334) Prevent HW from going back during leader failover

[ https://issues.apache.org/jira/browse/KAFKA-2334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022117#comment-15022117 ] jin xing commented on KAFKA-2334: - after receiving LeaderAndIsrRequest, Broker B2 will finally call "

[jira] [Created] (KAFKA-2879) Make MiniKDC test service slightly more generic

Gwen Shapira created KAFKA-2879: --- Summary: Make MiniKDC test service slightly more generic Key: KAFKA-2879 URL: https://issues.apache.org/jira/browse/KAFKA-2879 Project: Kafka Issue Type:

[jira] [Resolved] (KAFKA-2873) o.a.k.connect.util.KafkaBasedLogTest failure in 0.9 RC4

[ https://issues.apache.org/jira/browse/KAFKA-2873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved KAFKA-2873. - Resolution: Duplicate Duplicate for KAFKA-2667 > o.a.k.connect.util.KafkaBasedLogTest failure in

Re: All brokers are running but some partitions' leader is -1

Loop another guy from our team. On Mon, Nov 23, 2015 at 2:26 PM, Qi Xu wrote: > Hi folks, > We have a 10 node cluster and have several topics. Each topic has about > 256 partitions with 3 replica factor. Now we run into an issue that in some > topic, a few partition (< 10)'s

[jira] [Commented] (KAFKA-2873) o.a.k.connect.util.KafkaBasedLogTest failure in 0.9 RC4

[ https://issues.apache.org/jira/browse/KAFKA-2873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15023188#comment-15023188 ] Jiangjie Qin commented on KAFKA-2873: - Cool, that works. Thanks. I'll close this ticket as duplicate.

[jira] [Created] (KAFKA-2878) Kafka broker throws OutOfMemory exception with invalid join group request

Rajini Sivaram created KAFKA-2878: - Summary: Kafka broker throws OutOfMemory exception with invalid join group request Key: KAFKA-2878 URL: https://issues.apache.org/jira/browse/KAFKA-2878 Project:

All brokers are running but some partitions' leader is -1

Hi folks, We have a 10 node cluster and have several topics. Each topic has about 256 partitions with 3 replica factor. Now we run into an issue that in some topic, a few partition (< 10)'s leader is -1 and all of them has only one synced partition. >From the Kafka manager, here's the snapshot:

[GitHub] kafka pull request: KAFKA-2878: Guard against OutOfMemory in Kafka...

GitHub user rajinisivaram opened a pull request: https://github.com/apache/kafka/pull/577 KAFKA-2878: Guard against OutOfMemory in Kafka broker Sanity check array size in requests before allocation You can merge this pull request into a Git repository by running: $ git pull

[jira] [Commented] (KAFKA-2878) Kafka broker throws OutOfMemory exception with invalid join group request

[ https://issues.apache.org/jira/browse/KAFKA-2878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15023264#comment-15023264 ] ASF GitHub Bot commented on KAFKA-2878: --- GitHub user rajinisivaram opened a pull request:

Re: All brokers are running but some partitions' leader is -1

Forgot to mention is that the Kafka version we're using is from Aug's Trunk branch---which has the SSL support. Thanks again, Qi On Mon, Nov 23, 2015 at 2:29 PM, Qi Xu wrote: > Loop another guy from our team. > > On Mon, Nov 23, 2015 at 2:26 PM, Qi Xu

Re: 0.9.0.0 RC4

+1 (non-binding). Built it, ran tests, ran the rat tool separately, checked license and notice, checked digests, ran a few local smoke tests including zk auth. Looks good! -Flavio > On 23 Nov 2015, at 19:11, Harsha wrote: > > +1 (binding). > > 1. Ran unit tests > 2. Ran SSL

[jira] [Reopened] (KAFKA-2842) BrokerEndPoint regex does't support hostname with _

[ https://issues.apache.org/jira/browse/KAFKA-2842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sachin Pasalkar reopened KAFKA-2842: I just saw the console-consumer & simpleConsumer works with '_' in hostname? Shouldn't this be

Re: 0.9.0.0 RC4

+1 Thanks, Jun On Fri, Nov 20, 2015 at 5:21 PM, Jun Rao wrote: > This is the fourth candidate for release of Apache Kafka 0.9.0.0. This a > major release that includes (1) authentication (through SSL and SASL) and > authorization, (2) a new java consumer, (3) a Kafka

[jira] [Commented] (KAFKA-2880) Fetcher.getTopicMetadata NullPointerException when broker cannot be reached

[ https://issues.apache.org/jira/browse/KAFKA-2880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15023766#comment-15023766 ] Ewen Cheslack-Postava commented on KAFKA-2880: -- [~hachikuji] Agreed, makes sense to round out

Re: 0.9.0.0 RC4

Thanks everyone for voting. The following are the results of the votes. +1 binding = 4 votes (Neha Narkhede, Sriharsha Chintalapani, Guozhang Wang, Jun Rao) +1 non-binding = 3 votes -1 = 0 votes 0 = 0 votes The vote passes. I will release artifacts to maven central, update the dist svn and

[jira] [Issue Comment Deleted] (KAFKA-2842) BrokerEndPoint regex does't support hostname with _

[ https://issues.apache.org/jira/browse/KAFKA-2842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sachin Pasalkar updated KAFKA-2842: --- Comment: was deleted (was: I just saw the console-consumer & simpleConsumer works with '_' in

[jira] [Commented] (KAFKA-2879) Make MiniKDC test service slightly more generic

[ https://issues.apache.org/jira/browse/KAFKA-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15023327#comment-15023327 ] ASF GitHub Bot commented on KAFKA-2879: --- GitHub user gwenshap opened a pull request:

[GitHub] kafka pull request: KAFKA-2879: Make MiniKDC test service slightly...

GitHub user gwenshap opened a pull request: https://github.com/apache/kafka/pull/578 KAFKA-2879: Make MiniKDC test service slightly more generic You can merge this pull request into a Git repository by running: $ git pull https://github.com/gwenshap/kafka KAFKA-2879

[jira] [Assigned] (KAFKA-2692) Add ducktape tests for SASL/Kerberos

[ https://issues.apache.org/jira/browse/KAFKA-2692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma reassigned KAFKA-2692: -- Assignee: Ismael Juma > Add ducktape tests for SASL/Kerberos >

[jira] [Resolved] (KAFKA-2879) Make MiniKDC test service slightly more generic

[ https://issues.apache.org/jira/browse/KAFKA-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-2879. -- Resolution: Fixed Fix Version/s: 0.9.1.0 Issue resolved by pull request 578

[jira] [Commented] (KAFKA-2879) Make MiniKDC test service slightly more generic

[ https://issues.apache.org/jira/browse/KAFKA-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15023444#comment-15023444 ] ASF GitHub Bot commented on KAFKA-2879: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request: KAFKA-2879: Make MiniKDC test service slightly...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/578 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: 0.9.0.0 RC4

+1 non-binding. Built in a fresh VM, ran some smoke tests for both the brokers and Kafka Connect. -Ewen On Mon, Nov 23, 2015 at 3:11 PM, Flavio Junqueira wrote: > +1 (non-binding). Built it, ran tests, ran the rat tool separately, > checked license and notice, checked digests,

[jira] [Updated] (KAFKA-2879) Make MiniKDC test service slightly more generic

[ https://issues.apache.org/jira/browse/KAFKA-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2879: - Assignee: Gwen Shapira > Make MiniKDC test service slightly more generic >

[jira] [Created] (KAFKA-2880) Fetcher.getTopicMetadata NullPointerException when broker cannot be reached

Ewen Cheslack-Postava created KAFKA-2880: Summary: Fetcher.getTopicMetadata NullPointerException when broker cannot be reached Key: KAFKA-2880 URL: https://issues.apache.org/jira/browse/KAFKA-2880

[GitHub] kafka pull request: KAFKA-2804: manage changelog topics through ZK...

GitHub user guozhangwang opened a pull request: https://github.com/apache/kafka/pull/579 KAFKA-2804: manage changelog topics through ZK in PartitionAssignor You can merge this pull request into a Git repository by running: $ git pull https://github.com/guozhangwang/kafka

[jira] [Commented] (KAFKA-2804) Create / Update changelog topics upon state store initialization

[ https://issues.apache.org/jira/browse/KAFKA-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15023433#comment-15023433 ] ASF GitHub Bot commented on KAFKA-2804: --- GitHub user guozhangwang opened a pull request:

Re: All brokers are running but some partitions' leader is -1

We fixed many many bugs since August. Since we are about to release 0.9.0 (with SSL!), maybe wait a day and go with a released and tested version. On Mon, Nov 23, 2015 at 3:01 PM, Qi Xu wrote: > Forgot to mention is that the Kafka version we're using is from Aug's > Trunk

Build failed in Jenkins: kafka-trunk-jdk8 #179

See Changes: [wangguoz] KAFKA-2879: Make MiniKDC test service slightly more generic -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu3

Jenkins build is back to normal : kafka-trunk-jdk7 #850

See

[jira] [Reopened] (KAFKA-2718) Reuse of temporary directories leading to transient unit test failures

[ https://issues.apache.org/jira/browse/KAFKA-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang reopened KAFKA-2718: -- > Reuse of temporary directories leading to transient unit test failures >

[jira] [Commented] (KAFKA-2718) Reuse of temporary directories leading to transient unit test failures

[ https://issues.apache.org/jira/browse/KAFKA-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15023598#comment-15023598 ] Guozhang Wang commented on KAFKA-2718: -- Saw another case with this issue:

[jira] [Created] (KAFKA-2881) Documentation improvement

Gwen Shapira created KAFKA-2881: --- Summary: Documentation improvement Key: KAFKA-2881 URL: https://issues.apache.org/jira/browse/KAFKA-2881 Project: Kafka Issue Type: Improvement

Re: 0.9.0.0 RC4

+1 (binding), ran quickstart and the topics / consumer-groups tools with 2.11 and 2.10 versions. Guozhang On Mon, Nov 23, 2015 at 4:14 PM, Ewen Cheslack-Postava wrote: > +1 non-binding. Built in a fresh VM, ran some smoke tests for both the > brokers and Kafka Connect. > >

[GitHub] kafka pull request: Minor: Fix KafkaConsumer Constructor Summary j...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/576 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Build failed in Jenkins: kafka-trunk-jdk7 #851

See Changes: [cshapi] Minor: Fix KafkaConsumer Constructor Summary javadoc -- [...truncated 1371 lines...] kafka.log.LogTest > testTruncateTo PASSED kafka.log.LogTest > testCleanShutdownFile

[jira] [Commented] (KAFKA-2880) Fetcher.getTopicMetadata NullPointerException when broker cannot be reached

[ https://issues.apache.org/jira/browse/KAFKA-2880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15023729#comment-15023729 ] Jason Gustafson commented on KAFKA-2880: [~ewencp] Looks like we're missing a disconnect check on

Re: All brokers are running but some partitions' leader is -1

Hi, With the information provided, these are the steps I can think of (based on the experience I had with kafka):- 1. do a describe on the topic. See if the partitions and replicas are evenly distributed amongst all. If not, you might want to try the 'Reassign Partitions Tool' -

[jira] [Created] (KAFKA-2875) Class path contains multiple SLF4J bindings warnings when using scripts under bin

Ismael Juma created KAFKA-2875: -- Summary: Class path contains multiple SLF4J bindings warnings when using scripts under bin Key: KAFKA-2875 URL: https://issues.apache.org/jira/browse/KAFKA-2875 Project:

[jira] [Updated] (KAFKA-2875) Class path contains multiple SLF4J bindings warnings when using scripts under bin

[ https://issues.apache.org/jira/browse/KAFKA-2875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-2875: --- Priority: Minor (was: Major) > Class path contains multiple SLF4J bindings warnings when using

[jira] [Commented] (KAFKA-2608) Recommend kafka_2.11 for 0.9.0.0 on the website

[ https://issues.apache.org/jira/browse/KAFKA-2608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022371#comment-15022371 ] ASF GitHub Bot commented on KAFKA-2608: --- Github user ijuma commented on the pull request:

Build failed in Jenkins: kafka-trunk-jdk7 #849

See Changes: [junrao] MINOR: Bump version to 0.9.1.0-SNAPSHOT -- [...truncated 1370 lines...] kafka.log.LogTest > testTruncateTo PASSED kafka.log.LogTest > testCleanShutdownFile PASSED

[GitHub] kafka-site pull request: Add 0.9.0.0 to downloads page

Github user ijuma commented on the pull request: https://github.com/apache/kafka-site/pull/4#issuecomment-158983344 This should only be merged after Kafka 0.9.0.0 is released. It recommends the Scala 2.11 version (as per https://issues.apache.org/jira/browse/KAFKA-2608). --- If

[jira] [Updated] (KAFKA-2608) Recommend kafka_2.11 for 0.9.0.0 on the website

[ https://issues.apache.org/jira/browse/KAFKA-2608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-2608: --- Assignee: Ismael Juma Reviewer: Jun Rao Status: Patch Available (was: Open) > Recommend

[GitHub] kafka pull request: MINOR: Bump version to 0.9.1.0-SNAPSHOT

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/575 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: 0.9.0.0 RC4

+1 (non-binding). Verified source and binary artifacts, ran ./gradlew testAll with JDK 7u80, quick start on source artifact and Scala 2.11 binary artifact. On Sat, Nov 21, 2015 at 1:21 AM, Jun Rao wrote: > This is the fourth candidate for release of Apache Kafka 0.9.0.0.

Re: 0.9.0.0 RC4

In http://kafka.apache.org/090/documentation.html#newconsumerconfigs partition.assignment.strategy should string, not a list of string? On Fri, Nov 20, 2015 at 5:21 PM, Jun Rao wrote: > This is the fourth candidate for release of Apache Kafka 0.9.0.0. This a > major release

kafka java consumer not consuming messsages produced by remote client

Hi all I have a remote java producer producing messages to the same topic where my local kafka java client is subscribed to but it doesn't consume any messages whereas if I ran the consumer from command line I can consume the messages produced by remote client. The following command line

[GitHub] kafka pull request: Minor: Fix KafkaConsumer Constructor Summary j...

GitHub user jholoman opened a pull request: https://github.com/apache/kafka/pull/576 Minor: Fix KafkaConsumer Constructor Summary javadoc You can merge this pull request into a Git repository by running: $ git pull https://github.com/jholoman/kafka

Re: 0.9.0.0 RC4

I think we should update the release notes to remove the Kafka Streams tickets, I have marked them as 0.9.1.0. Guozhang On Fri, Nov 20, 2015 at 5:21 PM, Jun Rao wrote: > This is the fourth candidate for release of Apache Kafka 0.9.0.0. This a > major release that includes

Build failed in Jenkins: kafka-trunk-jdk8 #178

See Changes: [junrao] MINOR: Bump version to 0.9.1.0-SNAPSHOT -- [...truncated 4428 lines...] org.apache.kafka.connect.json.JsonConverterTest > timeToJson PASSED

Re: 0.9.0.0 RC4

+1 (binding). Verified source and binary artifacts, ran unit tests. On Mon, Nov 23, 2015 at 9:32 AM, Jun Rao wrote: > I updated the release notes. Since this doesn't affect the release > artifacts to be voted upon, we don't have to do another RC. > > Please vote by 6pm PT

[jira] [Commented] (KAFKA-2873) o.a.k.connect.util.KafkaBasedLogTest failure in 0.9 RC4

[ https://issues.apache.org/jira/browse/KAFKA-2873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022533#comment-15022533 ] Jason Gustafson commented on KAFKA-2873: Duplicate of KAFKA-2667? >

[jira] [Commented] (KAFKA-493) High CPU usage on inactive server

[ https://issues.apache.org/jira/browse/KAFKA-493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022364#comment-15022364 ] Cosmin Marginean commented on KAFKA-493: Hi guys This seems to have been inactive for a while but

Re: 0.9.0.0 RC4

On Mon, Nov 23, 2015 at 4:15 PM, hsy...@gmail.com wrote: > In http://kafka.apache.org/090/documentation.html#newconsumerconfigs > partition.assignment.strategy should string, not a list of string? > List is correct, I believe, see how it's used in the code: List assignors =

[jira] [Comment Edited] (KAFKA-2875) Class path contains multiple SLF4J bindings warnings when using scripts under bin

[ https://issues.apache.org/jira/browse/KAFKA-2875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022306#comment-15022306 ] Ismael Juma edited comment on KAFKA-2875 at 11/23/15 3:46 PM: -- This only

[GitHub] kafka-site pull request: Add 0.9.0.0 to downloads page

GitHub user ijuma opened a pull request: https://github.com/apache/kafka-site/pull/4 Add 0.9.0.0 to downloads page You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka-site 0.9.0.0-in-downloads Alternatively you can

[jira] [Commented] (KAFKA-2873) o.a.k.connect.util.KafkaBasedLogTest failure in 0.9 RC4

[ https://issues.apache.org/jira/browse/KAFKA-2873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15023066#comment-15023066 ] Jiangjie Qin commented on KAFKA-2873: - [~hachikuji] Ah, looks it is duplicate. BTW, does the single

[jira] [Created] (KAFKA-2876) Broker allows startup with incompatible listen port/inter-broker protocol settings

Jason Gustafson created KAFKA-2876: -- Summary: Broker allows startup with incompatible listen port/inter-broker protocol settings Key: KAFKA-2876 URL: https://issues.apache.org/jira/browse/KAFKA-2876

[jira] [Assigned] (KAFKA-2876) Broker allows startup with incompatible listen port/inter-broker protocol settings

[ https://issues.apache.org/jira/browse/KAFKA-2876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma reassigned KAFKA-2876: -- Assignee: Ismael Juma > Broker allows startup with incompatible listen port/inter-broker

[jira] [Created] (KAFKA-2877) Messages sometimes not delivered by new consumer after Kafka restart

Rajini Sivaram created KAFKA-2877: - Summary: Messages sometimes not delivered by new consumer after Kafka restart Key: KAFKA-2877 URL: https://issues.apache.org/jira/browse/KAFKA-2877 Project: Kafka

[jira] [Assigned] (KAFKA-2877) Messages sometimes not delivered by new consumer after Kafka restart

[ https://issues.apache.org/jira/browse/KAFKA-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson reassigned KAFKA-2877: -- Assignee: Jason Gustafson (was: Neha Narkhede) > Messages sometimes not delivered by

[jira] [Commented] (KAFKA-2873) o.a.k.connect.util.KafkaBasedLogTest failure in 0.9 RC4

[ https://issues.apache.org/jira/browse/KAFKA-2873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15023157#comment-15023157 ] Jason Gustafson commented on KAFKA-2873: [~becket_qin] Looks like you need to include the connect