Re: [DISCUSS] KIP-80: Kafka REST Server

2016-10-11 Thread Harsha Chintalapani
Neha, "But I haven't seen any community emails or patches being submitted by you guys, so I'm wondering why you are concerned about whether the community is open to accepting patches or not." I think you are talking about contributing patches to this repository right?

[GitHub] kafka pull request #2010: MINOR: Fixed broken links in the documentation

2016-10-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2010 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: Store flushing on commit.interval.ms from KIP-63 introduces aggregation latency

2016-10-11 Thread Guozhang Wang
Hello Greg, I can share some context of KIP-63 here: 1. Like Eno mentioned, we believe RocksDB's own mem-table is already optimizing a large portion of IO access for its write performance, and adding an extra caching layer on top of that was mainly for saving ser-de costs (note that you still

Build failed in Jenkins: kafka-trunk-jdk7 #1623

2016-10-11 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-4283: records deleted from CachingKeyValueStore still appear in -- [...truncated 14115 lines...] org.apache.kafka.streams.state.internals.InMemoryLRUCacheStoreTest

[GitHub] kafka pull request #2013: MINOR: Code refactor - cleaning up some boolean as...

2016-10-11 Thread imandhan
GitHub user imandhan opened a pull request: https://github.com/apache/kafka/pull/2013 MINOR: Code refactor - cleaning up some boolean assignments You can merge this pull request into a Git repository by running: $ git pull https://github.com/imandhan/kafka KAFKA-refactor

Build failed in Jenkins: kafka-trunk-jdk8 #972

2016-10-11 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-4283: records deleted from CachingKeyValueStore still appear in -- [...truncated 3067 lines...] kafka.KafkaTest > testGetKafkaConfigFromArgsNonArgsOnly PASSED

Build failed in Jenkins: kafka-0.10.1-jdk7 #67

2016-10-11 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-4283: records deleted from CachingKeyValueStore still appear in -- [...truncated 426 lines...] kafka.tools.ConsoleConsumerTest > shouldStopWhenOutputCheckErrorFails

[jira] [Created] (KAFKA-4293) ByteBufferMessageSet.deepIterator burns CPU catching EOFExceptions

2016-10-11 Thread radai rosenblatt (JIRA)
radai rosenblatt created KAFKA-4293: --- Summary: ByteBufferMessageSet.deepIterator burns CPU catching EOFExceptions Key: KAFKA-4293 URL: https://issues.apache.org/jira/browse/KAFKA-4293 Project:

Re: [VOTE] KIP-47 - Add timestamp-based log deletion policy

2016-10-11 Thread Guozhang Wang
+1. On Fri, Oct 7, 2016 at 3:35 PM, Gwen Shapira wrote: > +1 (binding) > > On Wed, Oct 5, 2016 at 1:55 PM, Bill Warshaw wrote: > > Bumping for visibility. KIP is here: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-47+-+ >

[jira] [Commented] (KAFKA-4283) records deleted from CachingKeyValueStore still appear in range and all queries

2016-10-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566589#comment-15566589 ] ASF GitHub Bot commented on KAFKA-4283: --- Github user asfgit closed the pull request at:

[jira] [Updated] (KAFKA-4283) records deleted from CachingKeyValueStore still appear in range and all queries

2016-10-11 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4283: - Resolution: Fixed Fix Version/s: (was: 0.10.1.1) 0.10.2.0

[GitHub] kafka pull request #2001: KAFKA-4283: records deleted from CachingKeyValueSt...

2016-10-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2001 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Build failed in Jenkins: kafka-trunk-jdk8 #971

2016-10-11 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-4130; Link to Varnish architect notes is broken -- [...truncated 7823 lines...] kafka.integration.SaslPlaintextTopicMetadataTest >

[jira] [Resolved] (KAFKA-2552) Certain admin commands such as partition assignment fail on large clusters

2016-10-11 Thread Grant Henke (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke resolved KAFKA-2552. Resolution: Duplicate > Certain admin commands such as partition assignment fail on large clusters

Jenkins build is back to normal : kafka-0.10.1-jdk7 #66

2016-10-11 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk8 #970

2016-10-11 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-eu2 (Ubuntu ubuntu ubuntu-eu docker) in workspace

Build failed in Jenkins: kafka-trunk-jdk8 #969

2016-10-11 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-eu2 (Ubuntu ubuntu ubuntu-eu docker) in workspace

Re: Store flushing on commit.interval.ms from KIP-63 introduces aggregation latency

2016-10-11 Thread Greg Fodor
Thanks Eno -- my understanding is that cache is already enabled to be 100MB per rocksdb so it should be on already, but I'll check. I was wondering if you could shed some light on the changes between 0.10.0 and 0.10.1 -- in 0.10.0 there was an intermediate cache within RocksDbStore -- presumably

Re: [DISCUSS] KIP-81: Max in-flight fetches

2016-10-11 Thread Mickael Maison
Thanks for the feedback. Regarding the config name, I agree it's probably best to reuse the same name as the producer (buffer.memory) whichever implementation we decide to use. At first, I opted for limiting the max number of concurrent fetches as it felt more natural in the Fetcher code.

[GitHub] kafka-site pull request #24: update htaccess to load images nested inside of...

2016-10-11 Thread derrickdoo
Github user derrickdoo closed the pull request at: https://github.com/apache/kafka-site/pull/24 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Resolved] (KAFKA-4130) [docs] Link to Varnish architect notes is broken

2016-10-11 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-4130. Resolution: Fixed Fix Version/s: 0.10.1.0 Issue resolved by pull request 1835

[jira] [Commented] (KAFKA-4130) [docs] Link to Varnish architect notes is broken

2016-10-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15565915#comment-15565915 ] ASF GitHub Bot commented on KAFKA-4130: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request #1835: [DOCS] KAFKA-4130: Link to Varnish architect notes...

2016-10-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1835 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-4130) [docs] Link to Varnish architect notes is broken

2016-10-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15565889#comment-15565889 ] ASF GitHub Bot commented on KAFKA-4130: --- GitHub user oscerd reopened a pull request:

[GitHub] kafka pull request #1835: [DOCS] KAFKA-4130: Link to Varnish architect notes...

2016-10-11 Thread oscerd
GitHub user oscerd reopened a pull request: https://github.com/apache/kafka/pull/1835 [DOCS] KAFKA-4130: Link to Varnish architect notes is broken Hi all, The PR is related to https://issues.apache.org/jira/browse/KAFKA-4130 Thanks, Andrea You can

[jira] [Updated] (KAFKA-4269) Multiple KStream instances with at least one Regex source causes NPE when using multiple consumers

2016-10-11 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4269: - Fix Version/s: (was: 0.10.1.0) 0.10.1.1 > Multiple KStream instances with

Re: Request to get added to contributor list

2016-10-11 Thread Jason Gustafson
Done. Thanks for contributing! -Jason On Tue, Oct 11, 2016 at 3:25 AM, HuXi wrote: > Hi, can I get added to the contributor list? I 'd like to take crack at > some issues. Thank you. My JIRA id: huxi_2b >

[jira] [Commented] (KAFKA-4117) Cleanup StreamPartitionAssignor behavior

2016-10-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15565808#comment-15565808 ] ASF GitHub Bot commented on KAFKA-4117: --- GitHub user guozhangwang opened a pull request:

[GitHub] kafka pull request #2012: [WIP] KAFKA-4117: Stream partitionassignro cleanup

2016-10-11 Thread guozhangwang
GitHub user guozhangwang opened a pull request: https://github.com/apache/kafka/pull/2012 [WIP] KAFKA-4117: Stream partitionassignro cleanup 1. Create a new ClientMetadata` to collapse `Set consumerMemberIds`, `ClientState state`, and `HostInfo hostInfo`. 2. Stop reusing

Can broker recover to alive when zk callback miss?

2016-10-11 Thread 涂扬
hi, we meet a issue that the temporary node of broker in zookeeper was lost when the network bewteen broker and zk cluster is not good enough, while the process of the broker still exist. as we know, the controller would consider it to be offline in kafka. After we open zkClient log, we

[jira] [Commented] (KAFKA-4291) TopicCommand --describe shows topics marked for deletion as under-replicated and unavailable

2016-10-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15565750#comment-15565750 ] ASF GitHub Bot commented on KAFKA-4291: --- GitHub user mimaison opened a pull request:

[GitHub] kafka pull request #2011: KAFKA-4291: TopicCommand --describe shows topics m...

2016-10-11 Thread mimaison
GitHub user mimaison opened a pull request: https://github.com/apache/kafka/pull/2011 KAFKA-4291: TopicCommand --describe shows topics marked for deletion … …as under-replicated and unavailable TopicCommand --describe now shows if a topic is marked for deletion.

Re: [DISCUSS] KIP-84: Support SASL/SCRAM mechanisms

2016-10-11 Thread Rajini Sivaram
I have created KIP-86 ( https://cwiki.apache.org/confluence/display/KAFKA/KIP-86%3A+Configurable+SASL+callback+handlers) to enable pluggable credential providers. On Mon, Oct 10, 2016 at 7:40 PM, Rajini Sivaram < rajinisiva...@googlemail.com> wrote: > Gwen, > > Thank you, will raise a separate

[jira] [Created] (KAFKA-4292) Configurable SASL callback handlers

2016-10-11 Thread Rajini Sivaram (JIRA)
Rajini Sivaram created KAFKA-4292: - Summary: Configurable SASL callback handlers Key: KAFKA-4292 URL: https://issues.apache.org/jira/browse/KAFKA-4292 Project: Kafka Issue Type: Improvement

[DISCUSS] KIP-86: Configurable SASL callback handlers

2016-10-11 Thread Rajini Sivaram
Hi all, I have just created KIP-86 make callback handlers in SASL configurable so that credential providers for SASL/PLAIN (and SASL/SCRAM when it is implemented) can be used with custom credential callbacks:

Build failed in Jenkins: kafka-0.10.1-jdk7 #65

2016-10-11 Thread Apache Jenkins Server
See Changes: [me] KAFKA-4290: Fix timeout overflow in WorkerCoordinator.poll -- [...truncated 4984 lines...] kafka.coordinator.GroupMetadataManagerTest > testCommitOffset STARTED

Re: Store flushing on commit.interval.ms from KIP-63 introduces aggregation latency

2016-10-11 Thread Eno Thereska
Hi Greg, An alternative would be to set up RocksDB's cache, while keeping the streams cache to 0. That might give you what you need, especially if you can work with RocksDb and don't need to change the store. For example, here is how to set the Block Cache size to 100MB and the Write Buffer

[jira] [Created] (KAFKA-4291) TopicCommand --describe shows topics marked for deletion as under-replicated and unavailable

2016-10-11 Thread Mickael Maison (JIRA)
Mickael Maison created KAFKA-4291: - Summary: TopicCommand --describe shows topics marked for deletion as under-replicated and unavailable Key: KAFKA-4291 URL: https://issues.apache.org/jira/browse/KAFKA-4291

Request to get added to contributor list

2016-10-11 Thread HuXi
Hi, can I get added to the contributor list? I 'd like to take crack at some issues. Thank you. My JIRA id: huxi_2b

[jira] [Commented] (KAFKA-4130) [docs] Link to Varnish architect notes is broken

2016-10-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15565051#comment-15565051 ] ASF GitHub Bot commented on KAFKA-4130: --- Github user oscerd closed the pull request at:

[jira] [Commented] (KAFKA-3385) Need to log "Rejected connection" as WARNING message

2016-10-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15565050#comment-15565050 ] ASF GitHub Bot commented on KAFKA-3385: --- Github user oscerd closed the pull request at:

[GitHub] kafka pull request #1835: [DOCS] KAFKA-4130: Link to Varnish architect notes...

2016-10-11 Thread oscerd
Github user oscerd closed the pull request at: https://github.com/apache/kafka/pull/1835 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #1144: KAFKA-3385: Need to log "Rejected connection" as W...

2016-10-11 Thread oscerd
Github user oscerd closed the pull request at: https://github.com/apache/kafka/pull/1144 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Jenkins build is back to normal : kafka-trunk-jdk8 #968

2016-10-11 Thread Apache Jenkins Server
See

Jenkins build is back to normal : kafka-trunk-jdk7 #1621

2016-10-11 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-0.10.1-jdk7 #64

2016-10-11 Thread Apache Jenkins Server
See -- Started by an SCM change Started by an SCM change Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-eu2 (Ubuntu ubuntu ubuntu-eu docker) in

Build failed in Jenkins: kafka-0.10.1-jdk7 #63

2016-10-11 Thread Apache Jenkins Server
See Changes: [jason] MINOR: Add images missing from documentation -- [...truncated 2407 lines...] kafka.api.AdminClientTest > testListGroups STARTED kafka.api.AdminClientTest > testListGroups

Build failed in Jenkins: kafka-trunk-jdk8 #967

2016-10-11 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-eu2 (Ubuntu ubuntu ubuntu-eu docker) in workspace

Jenkins build is back to normal : kafka-trunk-jdk8 #966

2016-10-11 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk7 #1620

2016-10-11 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-eu2 (Ubuntu ubuntu ubuntu-eu docker) in workspace

Build failed in Jenkins: kafka-trunk-jdk7 #1619

2016-10-11 Thread Apache Jenkins Server
See Changes: [jason] MINOR: Add images missing from documentation [me] KAFKA-4010: add ConfigDef toEnrichedRst() for additional fields in -- [...truncated 4982 lines...]

[jira] [Updated] (KAFKA-4290) High CPU caused by timeout overflow in WorkerCoordinator

2016-10-11 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4290: - Fix Version/s: 0.10.2.0 > High CPU caused by timeout overflow in

[jira] [Resolved] (KAFKA-4290) High CPU caused by timeout overflow in WorkerCoordinator

2016-10-11 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-4290. -- Resolution: Fixed Reviewer: Ewen Cheslack-Postava > High CPU caused by

[jira] [Commented] (KAFKA-4290) High CPU caused by timeout overflow in WorkerCoordinator

2016-10-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15564640#comment-15564640 ] ASF GitHub Bot commented on KAFKA-4290: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request #2009: KAFKA-4290: Fix timeout overflow in WorkerCoordina...

2016-10-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2009 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is