Build failed in Jenkins: kafka-0.11.0-jdk7 #343

2017-12-01 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-6118: Fix transient failure -- [...truncated 9.42 KB...] if(l == null) ^

[jira] [Resolved] (KAFKA-6118) Transient failure in kafka.api.SaslScramSslEndToEndAuthorizationTest.testTwoConsumersWithDifferentSaslCredentials

2017-12-01 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-6118. -- Resolution: Fixed Fix Version/s: 0.11.0.3 1.0.1

[GitHub] kafka pull request #4287: KAFKA-6118: Fix transient failure testTwoConsumers...

2017-12-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4287 ---

Re: Doc says when doing re-balance, sort by leader then partition, but the code seems sort only on partition

2017-12-01 Thread Guozhang Wang
Hello Xiang, I took a look at the PartitionAssignor and I agree with you that the doc is referring to an older version of the code now. It could be updated. BTW, this logic is referring the old ZK-dependent consumer behavior, which has been deprecated and will likely be removed in the future

[GitHub] kafka pull request #4287: KAFKA-6118: Fix transient failure testTwoConsumers...

2017-12-01 Thread hachikuji
GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/4287 KAFKA-6118: Fix transient failure testTwoConsumersWithDifferentSaslCredentials It's rare, but it can happen that the initial FindCoordinator request returns before the first Metadata request.

[DISCUSS] KIP-232: Detect outdated metadata by adding ControllerMetadataEpoch field

2017-12-01 Thread Dong Lin
Hi all, I have created KIP-232: Detect outdated metadata by adding ControllerMetadataEpoch field: https://cwiki.apache.org/confluence/display/KAFKA/KIP-232%3A+Detect+outdated+metadata+by+adding+ControllerMetadataEpoch+field . The KIP proposes to add fields in MetadataResponse and

Jenkins build is back to normal : kafka-trunk-jdk8 #2253

2017-12-01 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk7 #3014

2017-12-01 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: Improve EOS related config docs -- [...truncated 406.45 KB...] kafka.zk.KafkaZkClientTest > testSetAndGetConsumerOffset STARTED

Build failed in Jenkins: kafka-0.11.0-jdk7 #342

2017-12-01 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: Improve EOS related config docs -- [...truncated 2.45 MB...] org.apache.kafka.streams.integration.EosIntegrationTest >

[jira] [Created] (KAFKA-6298) Line numbers on log messages are incorrect

2017-12-01 Thread Colin P. McCabe (JIRA)
Colin P. McCabe created KAFKA-6298: -- Summary: Line numbers on log messages are incorrect Key: KAFKA-6298 URL: https://issues.apache.org/jira/browse/KAFKA-6298 Project: Kafka Issue Type: Bug

[jira] [Resolved] (KAFKA-6136) Transient test failure: SaslPlainSslEndToEndAuthorizationTest.testTwoConsumersWithDifferentSaslCredentials

2017-12-01 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-6136. Resolution: Duplicate > Transient test failure: >

[GitHub] kafka pull request #4284: MINOR: imporve EOS docs

2017-12-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4284 ---

[jira] [Reopened] (KAFKA-3508) Transient failure in kafka.security.auth.SimpleAclAuthorizerTest.testHighConcurrencyModificationOfResourceAcls

2017-12-01 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang reopened KAFKA-3508: -- Assignee: (was: Grant Henke) > Transient failure in >

Re: [VOTE] KIP-203: Add toLowerCase support to sasl.kerberos.principal.to.local rule

2017-12-01 Thread Guozhang Wang
Made a pass over the KIP. +1. Thanks! Guozhang On Wed, Nov 29, 2017 at 3:30 PM, Jason Gustafson wrote: > +1 Thanks for the KIP! > > On Fri, Nov 3, 2017 at 10:08 AM, Manikumar > wrote: > > > Bump up. waiting for few more binding votes. > > > >

Build failed in Jenkins: kafka-trunk-jdk7 #3013

2017-12-01 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-6296; Increase jitter to fix transient failure in -- [...truncated 403.30 KB...] kafka.zk.KafkaZkClientTest > testSetAndGetConsumerOffset

Build failed in Jenkins: kafka-trunk-jdk8 #2252

2017-12-01 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-6296; Increase jitter to fix transient failure in -- [...truncated 409.25 KB...] kafka.utils.CoreUtilsTest > testCsvList STARTED

[GitHub] kafka pull request #4286: Minor fix broker compatibility tests

2017-12-01 Thread bbejeck
GitHub user bbejeck opened a pull request: https://github.com/apache/kafka/pull/4286 Minor fix broker compatibility tests *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate comment to

Build failed in Jenkins: kafka-trunk-jdk7 #3012

2017-12-01 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-6260; Ensure selection keys are removed from all collections on -- [...truncated 408.39 KB...] kafka.zk.KafkaZkClientTest >

[GitHub] kafka pull request #4285: KAFKA-6296: Increase jitter to fix transient failu...

2017-12-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4285 ---

[jira] [Resolved] (KAFKA-6296) Transient failure in NetworkClientTest.testConnectionDelayDisconnected

2017-12-01 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-6296. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 4285

Jenkins build is back to normal : kafka-trunk-jdk9 #232

2017-12-01 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk8 #2251

2017-12-01 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-6260; Ensure selection keys are removed from all collections on -- [...truncated 1.42 MB...] org.apache.kafka.common.config.ConfigDefTest >

Re: [DISCUSS] KIP-227: Introduce Incremental FetchRequests to Increase Partition Scalability

2017-12-01 Thread Dong Lin
On Thu, Nov 30, 2017 at 9:37 AM, Colin McCabe wrote: > On Wed, Nov 29, 2017, at 18:59, Dong Lin wrote: > > Hey Colin, > > > > Thanks much for the update. I have a few questions below: > > > > 1. I am not very sure that we need Fetch Session Epoch. It seems that > > Fetch > >

Re: [DISCUSS] KIP-210: Provide for custom error handling when Kafka Streams fails to produce

2017-12-01 Thread Matt Farmer
Bump! It's been three days here and I haven't seen any further feedback. Eager to get this resolved, approved, and merged. =) On Tue, Nov 28, 2017 at 9:53 AM Matt Farmer wrote: > Hi there, sorry for the delay in responding. Last week had a holiday and > several busy work days in

[GitHub] kafka pull request #4276: KAFKA-6260: Ensure selection keys are removed from...

2017-12-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4276 ---

[jira] [Created] (KAFKA-6297) Consumer fetcher should handle UnsupportedVersionException more diligently

2017-12-01 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-6297: Summary: Consumer fetcher should handle UnsupportedVersionException more diligently Key: KAFKA-6297 URL: https://issues.apache.org/jira/browse/KAFKA-6297 Project:

[GitHub] kafka pull request #4285: KAFKA-6296: Increase jitter to fix transient failu...

2017-12-01 Thread hachikuji
GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/4285 KAFKA-6296: Increase jitter to fix transient failure in NetworkClientTest.testConnectionDelayDisconnected ### Committer Checklist (excluded from commit message) - [ ] Verify design and

[GitHub] kafka pull request #4284: MINOR: imporve EOS docs

2017-12-01 Thread mjsax
GitHub user mjsax opened a pull request: https://github.com/apache/kafka/pull/4284 MINOR: imporve EOS docs You can merge this pull request into a Git repository by running: $ git pull https://github.com/mjsax/kafka minor-improve-eos-docs Alternatively you can review and

[jira] [Created] (KAFKA-6296) Transient failure in NetworkClientTest.testConnectionDelayDisconnected

2017-12-01 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-6296: -- Summary: Transient failure in NetworkClientTest.testConnectionDelayDisconnected Key: KAFKA-6296 URL: https://issues.apache.org/jira/browse/KAFKA-6296 Project:

Re: [DISCUSS] KIP 226 - Dynamic Broker Configuration

2017-12-01 Thread Ted Yu
Thanks for the explanation. On Fri, Dec 1, 2017 at 10:13 AM, Rajini Sivaram wrote: > Hi Ted, > > Thank you for the review. */config/brokers/id *contains the persistent > configuration of broker *. *That will be configured using > kafka-configs.sh/AdminClient.

Re: [DISCUSS] KIP 226 - Dynamic Broker Configuration

2017-12-01 Thread Rajini Sivaram
Hi Ted, Thank you for the review. */config/brokers/id *contains the persistent configuration of broker *. *That will be configured using kafka-configs.sh/AdminClient. */brokers/ids/id* contains the ephemeral metadata registered by broker *.* For broker version, we don't want the data to outlive

[jira] [Created] (KAFKA-6295) Add 'Coordinator Id' to consumer metrics

2017-12-01 Thread Ryan P (JIRA)
Ryan P created KAFKA-6295: - Summary: Add 'Coordinator Id' to consumer metrics Key: KAFKA-6295 URL: https://issues.apache.org/jira/browse/KAFKA-6295 Project: Kafka Issue Type: Improvement

Re: [DISCUSS] KIP 226 - Dynamic Broker Configuration

2017-12-01 Thread Ted Yu
Thanks for the update. bq. To enable this, the version of the broker will be added to the JSON registered by each broker during startup at */brokers/ids/id* *It seems the path has typo. Should it be:* */config/brokers/id* *Cheers* On Fri, Dec 1, 2017 at 8:32 AM, Rajini Sivaram

[jira] [Created] (KAFKA-6294) ZkClient is not joining it's event thread during an interrupt

2017-12-01 Thread Zeynep Arikoglu (JIRA)
Zeynep Arikoglu created KAFKA-6294: -- Summary: ZkClient is not joining it's event thread during an interrupt Key: KAFKA-6294 URL: https://issues.apache.org/jira/browse/KAFKA-6294 Project: Kafka

Re: [DISCUSS] KIP 226 - Dynamic Broker Configuration

2017-12-01 Thread Rajini Sivaram
Made one change to the KIP - I added a *validate* method to the *Reconfigurable* interface so that we can validate new configs before they are applied. A couple of initial implementations: 1. Dynamic updates of keystores:

Re: [DISCUSS] KIP 226 - Dynamic Broker Configuration

2017-12-01 Thread Rajini Sivaram
Hi all, If there are no other suggestions or comments, I will start vote next week. In the meantime, please feel free to review and add any suggestions or improvements. Regards, Rajini On Wed, Nov 29, 2017 at 11:52 AM, Rajini Sivaram wrote: > Hi Jason, > > Thanks for

[GitHub] kafka pull request #4283: (WIP) KAFKA-6193: Flaky shouldPerformMultipleReass...

2017-12-01 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/4283 (WIP) KAFKA-6193: Flaky shouldPerformMultipleReassignmentOperationsOverVariousTopics I have been unable to reproduce it locally, so enabled additional logging while running it in Jenkins.

[GitHub] kafka pull request #4282: KAFKA-6293 Support for Avro formatter in ConsoleCo...

2017-12-01 Thread ethiebaut
GitHub user ethiebaut opened a pull request: https://github.com/apache/kafka/pull/4282 KAFKA-6293 Support for Avro formatter in ConsoleConsumer Support for Avro formatter in ConsoleConsumer With Confluent Schema Registry as per https://issues.apache.org/jira/browse/KAFKA-6293

[jira] [Created] (KAFKA-6293) Support for Avro formatter in ConsoleConsumer With Confluent Schema Registry

2017-12-01 Thread Eric Thiebaut-George (JIRA)
Eric Thiebaut-George created KAFKA-6293: --- Summary: Support for Avro formatter in ConsoleConsumer With Confluent Schema Registry Key: KAFKA-6293 URL: https://issues.apache.org/jira/browse/KAFKA-6293

Re: [DISCUSS] KIP-218: Make KafkaFuture.Function java 8 lambda compatible

2017-12-01 Thread Tom Bentley
Hi Steven, I'm particularly interested in seeing progress on this KIP as the work for KIP-183 needs a public version of BiConsumer. do you have any idea when the KIP might be ready for voting? Thanks, Tom On 10 November 2017 at 13:38, Steven Aerts wrote: > Collin,

Re: [VOTE] KIP-201: Rationalising policy interfaces

2017-12-01 Thread Tom Bentley
I have a PR for this (https://github.com/apache/kafka/pull/4281) in case anyone wants to look at the implementation in detail, but right now this KIP still lacks any committer votes. Cheers, Tom On 22 November 2017 at 17:32, Tom Bentley wrote: > Hi everyone, > > I just

[GitHub] kafka pull request #4281: [WIP] KAFKA-5693 rationalise policy interfaces

2017-12-01 Thread tombentley
GitHub user tombentley opened a pull request: https://github.com/apache/kafka/pull/4281 [WIP] KAFKA-5693 rationalise policy interfaces As described in KIP-201 (not yet accepted), this: * deprecates the CreateTopicPolicy and AlterConfigPolicy * adds a new

Re: [DISCUSS] KIP-227: Introduce Incremental FetchRequests to Increase Partition Scalability

2017-12-01 Thread Jan Filipiak
BTW: the shuffle problem would exist in all our solutions. An empty fetch request had the same issue about what order to serve the topic and partitions. So my suggestion is not introducing this problem. Best Jan On 01.12.2017 08:29, Jan Filipiak wrote: Hi, this discussion is going a

Re: [DISCUSS] KIP-227: Introduce Incremental FetchRequests to Increase Partition Scalability

2017-12-01 Thread Jan Filipiak
Hi, good catch about the rotation. This is probably not a too big blocker. Plenty of ideas spring to my mind of how this can be done. Maybe one can offer different algorithms here. (nothing, random shuffle, client sends bitmask which it wants to fetch first, broker logic... many more) Thank

[jira] [Created] (KAFKA-6292) ReplicaManager not respect the rolled log

2017-12-01 Thread Terence Yi (JIRA)
Terence Yi created KAFKA-6292: - Summary: ReplicaManager not respect the rolled log Key: KAFKA-6292 URL: https://issues.apache.org/jira/browse/KAFKA-6292 Project: Kafka Issue Type: Bug