[jira] [Created] (KAFKA-5834) AbstractConfig.logUnused() may log confusing warning information.

2017-09-04 Thread Jiangjie Qin (JIRA)
Jiangjie Qin created KAFKA-5834: --- Summary: AbstractConfig.logUnused() may log confusing warning information. Key: KAFKA-5834 URL: https://issues.apache.org/jira/browse/KAFKA-5834 Project: Kafka

[GitHub] kafka-site pull request #73: Add coding guidelines for Streams API

2017-09-04 Thread Sharon2017
Github user Sharon2017 commented on a diff in the pull request: https://github.com/apache/kafka-site/pull/73#discussion_r136896770 --- Diff: coding-guide.html --- @@ -102,6 +102,47 @@ We should attempt to maintain API compatibility when possible, though at this

[GitHub] kafka-site pull request #73: Add coding guidelines for Streams API

2017-09-04 Thread Kamal15
Github user Kamal15 commented on a diff in the pull request: https://github.com/apache/kafka-site/pull/73#discussion_r136894052 --- Diff: coding-guide.html --- @@ -102,6 +102,47 @@ We should attempt to maintain API compatibility when possible, though at this point

[jira] [Created] (KAFKA-5833) Reset thread interrupt state in case of InterruptedException

2017-09-04 Thread Ted Yu (JIRA)
Ted Yu created KAFKA-5833: - Summary: Reset thread interrupt state in case of InterruptedException Key: KAFKA-5833 URL: https://issues.apache.org/jira/browse/KAFKA-5833 Project: Kafka Issue Type:

[GitHub] kafka pull request #3787: KAFKA-5823: Extend upgrade section for KIP-120

2017-09-04 Thread mjsax
GitHub user mjsax opened a pull request: https://github.com/apache/kafka/pull/3787 KAFKA-5823: Extend upgrade section for KIP-120 You can merge this pull request into a Git repository by running: $ git pull https://github.com/mjsax/kafka kafka-5823-kip120-docs Alternatively

[GitHub] kafka-site issue #73: Add coding guidelines for Streams API

2017-09-04 Thread mjsax
Github user mjsax commented on the issue: https://github.com/apache/kafka-site/pull/73 Call for reviews, @guozhangwang @dguy @bbejeck ---

[GitHub] kafka-site pull request #73: Add coding guidelines for Streams API

2017-09-04 Thread mjsax
GitHub user mjsax opened a pull request: https://github.com/apache/kafka-site/pull/73 Add coding guidelines for Streams API You can merge this pull request into a Git repository by running: $ git pull https://github.com/mjsax/kafka-site streams-coding-guidelines

[GitHub] kafka pull request #3786: MINOR: preparing for bug fix release

2017-09-04 Thread dguy
GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/3786 MINOR: preparing for bug fix release You can merge this pull request into a Git repository by running: $ git pull https://github.com/dguy/kafka 0.11.0 Alternatively you can review and apply

[GitHub] kafka pull request #3785: KAFKA-5830: kafka-configs.sh should allow deletion...

2017-09-04 Thread mimaison
GitHub user mimaison opened a pull request: https://github.com/apache/kafka/pull/3785 KAFKA-5830: kafka-configs.sh should allow deletion of all configs for… … an entity Added a --delete-all-configs flag to delete all configurations for a given entity You can merge

[jira] [Created] (KAFKA-5832) Add Consumed class and overloads to StreamBuilder

2017-09-04 Thread Damian Guy (JIRA)
Damian Guy created KAFKA-5832: - Summary: Add Consumed class and overloads to StreamBuilder Key: KAFKA-5832 URL: https://issues.apache.org/jira/browse/KAFKA-5832 Project: Kafka Issue Type:

[GitHub] kafka pull request #3784: KAFKA-5832: add Consumed and change StreamBuilder ...

2017-09-04 Thread dguy
GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/3784 KAFKA-5832: add Consumed and change StreamBuilder to use it Added `Consumed` class. Updated `StreamBuilder#stream`, `StreamBuilder#table`, `StreamBuilder#globalTable` You can merge this pull

Jenkins build is back to normal : kafka-trunk-jdk8 #1970

2017-09-04 Thread Apache Jenkins Server
See

[GitHub] kafka pull request #3779: KAFKA-5818: KafkaStreams state transitions not cor...

2017-09-04 Thread mjsax
Github user mjsax closed the pull request at: https://github.com/apache/kafka/pull/3779 ---

Fetching topic metadata issue

2017-09-04 Thread Sagar Nadagoud
Hi, Please help me in this issue i am unable to read the message from topic.

Re: [VOTE] KIP-188 - Add new metrics to support health checks

2017-09-04 Thread Thomas Crayford
+1 (non-binding) On Mon, Sep 4, 2017 at 3:30 PM, Manikumar wrote: > +1 (non-binding) > > On Mon, Sep 4, 2017 at 6:39 PM, Rajini Sivaram > wrote: > > > All the suggestions on the discuss thread have been incorporated into the > > KIP. Please

Re: [VOTE] KIP-188 - Add new metrics to support health checks

2017-09-04 Thread Manikumar
+1 (non-binding) On Mon, Sep 4, 2017 at 6:39 PM, Rajini Sivaram wrote: > All the suggestions on the discuss thread have been incorporated into the > KIP. Please let me know if you have any more concerns or else can we > proceed with voting for this KIP? > > Thank you, >

Build failed in Jenkins: kafka-trunk-jdk7 #2705

2017-09-04 Thread Apache Jenkins Server
See Changes: [damian.guy] MINOR: add table of contents -- [...truncated 921.69 KB...] kafka.server.epoch.LeaderEpochFileCacheTest >

[GitHub] kafka pull request #3760: MINOR: add table of contents

2017-09-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3760 ---

[jira] [Resolved] (KAFKA-5814) java.lang.OutOfMemoryError: Direct buffer memory

2017-09-04 Thread Alexander Petrovsky (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Petrovsky resolved KAFKA-5814. Resolution: Duplicate > java.lang.OutOfMemoryError: Direct buffer memory >

[GitHub] kafka pull request #3783: KAFKA-5515: Remove date formatting from Segments

2017-09-04 Thread dguy
GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/3783 KAFKA-5515: Remove date formatting from Segments Remove date formatting from `Segments` and use the `segementId` instead. Add tests to make sure can load old segments. Rename old segment dirs

Re: [VOTE] KIP-188 - Add new metrics to support health checks

2017-09-04 Thread Rajini Sivaram
All the suggestions on the discuss thread have been incorporated into the KIP. Please let me know if you have any more concerns or else can we proceed with voting for this KIP? Thank you, Rajini On Thu, Aug 24, 2017 at 6:50 PM, Rajini Sivaram wrote: > Hi all, > > I

Re: Plans to improve SSL performance in Kafka, for 0.10.x?

2017-09-04 Thread Ismael Juma
Great! Ismael On Mon, Sep 4, 2017 at 1:43 PM, Todd Palino wrote: > I will say that we've been turning on TLS consume lately (including using > it for IBP, which we've been doing for a while) and we haven't seen any of > the performance concerns that we originally did. Very

Re: Plans to improve SSL performance in Kafka, for 0.10.x?

2017-09-04 Thread Todd Palino
I will say that we've been turning on TLS consume lately (including using it for IBP, which we've been doing for a while) and we haven't seen any of the performance concerns that we originally did. Very little hit at all. -Todd On Sep 4, 2017 12:45 AM, "Ismael Juma" wrote: >

[jira] [Resolved] (KAFKA-5831) MemoryRecordsBuilder uses small compression buffer leading to snappy low compression ratio

2017-09-04 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-5831. Resolution: Duplicate Thanks for filing the report. This is a duplicate of KAFKA-5236. >

Re: [DISCUSS] KIP-183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient

2017-09-04 Thread Tom Bentley
The KIP has been adopted after a successful vote. Unfortunately I've discovered that there's an annoying detail in the handling of the case that electPreferredLeaders() is called with a null partitions argument. As discussed with Ewen, this is supposed to mean "all partitions", but we don't know

[jira] [Resolved] (KAFKA-1946) Fix various broker metrics

2017-09-04 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-1946. -- Resolution: Fixed > Fix various broker metrics > -- > > Key:

[jira] [Resolved] (KAFKA-1962) Restore delayed request metrics

2017-09-04 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-1962. -- Resolution: Fixed > Restore delayed request metrics > --- > >

[jira] [Created] (KAFKA-5831) MemoryRecordsBuilder uses small compression buffer leading to snappy low compression ratio

2017-09-04 Thread fengchaoli (JIRA)
fengchaoli created KAFKA-5831: - Summary: MemoryRecordsBuilder uses small compression buffer leading to snappy low compression ratio Key: KAFKA-5831 URL: https://issues.apache.org/jira/browse/KAFKA-5831

[jira] [Created] (KAFKA-5830) kafka-configs.sh allow to delete all configs for an entity

2017-09-04 Thread Mickael Maison (JIRA)
Mickael Maison created KAFKA-5830: - Summary: kafka-configs.sh allow to delete all configs for an entity Key: KAFKA-5830 URL: https://issues.apache.org/jira/browse/KAFKA-5830 Project: Kafka

[jira] [Resolved] (KAFKA-1505) Broker failed to start because of corrupted replication-offset-checkpoint file

2017-09-04 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-1505. -- Resolution: Fixed This was fixed in newer versions. Pl reopen if you think the issue still exists >

Re: [VOTE] KIP-183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient

2017-09-04 Thread Ismael Juma
Hi Tom, You can update the KIP for minor things like that. Worth updating the thread if it's something that is done during the PR review. With regards to exceptions, yes, that's definitely desired. I filed a JIRA a while back for this: https://issues.apache.org/jira/browse/KAFKA-5445 Ideally,

Re: [VOTE] KIP-183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient

2017-09-04 Thread Tom Bentley
Hi Jun, You're correct about those other expected errors. If it's OK to update the KIP after the vote I'll add those. But this makes me wonder about the value of documenting expected errors in the Javadocs for the AdminClient (on the Results class, to be specific). Currently we don't do this,

Re: [VOTE] KIP-183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient

2017-09-04 Thread Tom Bentley
I see three +1s, no +0s and no -1, so the vote passes. Thanks to those who voted and/or commented on the discussion thread. On 1 September 2017 at 07:36, Gwen Shapira wrote: > Thank you! +1 (binding). > > On Thu, Aug 31, 2017 at 9:48 AM Jun Rao wrote: > >

Re: Dry-run option for new admin commands

2017-09-04 Thread Tom Bentley
Hi Viktor, KIP-179's reassignPartitions() API already has a validateOnly() option. There's no technical barrier to adding similar options to the other state-changing APIs in that KIP, if people think it would be useful. Please comment to say this on the [DISCUSS] thread for the KIP though. In

[jira] [Resolved] (KAFKA-3059) ConsumerGroupCommand should allow resetting offsets for consumer groups

2017-09-04 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-3059. -- Resolution: Duplicate This functionality is implemented in KAFKA-4743 > ConsumerGroupCommand should

[GitHub] kafka pull request #3782: KAFKA-5829; Speedup broker startup after unclean s...

2017-09-04 Thread lindong28
GitHub user lindong28 opened a pull request: https://github.com/apache/kafka/pull/3782 KAFKA-5829; Speedup broker startup after unclean shutdown by reducing unnecessary snapshot files deletion You can merge this pull request into a Git repository by running: $ git pull

[jira] [Created] (KAFKA-5829) Speedup broker startup after unclean shutdown by reducing unnecessary snapshot files deletion

2017-09-04 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-5829: --- Summary: Speedup broker startup after unclean shutdown by reducing unnecessary snapshot files deletion Key: KAFKA-5829 URL: https://issues.apache.org/jira/browse/KAFKA-5829

Re: Plans to improve SSL performance in Kafka, for 0.10.x?

2017-09-04 Thread Ismael Juma
By the way, in-kernel TLS has now landed in the Linux kernel: https://github.com/torvalds/linux/blob/master/Documentation/networking/tls.txt There is work in progress to take advantage of that in OpenSSL: https://github.com/Mellanox/tls-openssl Ismael On Tue, Sep 6, 2016 at 1:48 PM, Todd