[GitHub] kafka pull request: KAFKA-2771: Added rolling upgrade system test ...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/496 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-2771) Add Rolling Upgrade to Secured Cluster to System Tests

[ https://issues.apache.org/jira/browse/KAFKA-2771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032598#comment-15032598 ] ASF GitHub Bot commented on KAFKA-2771: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request: MINOR: Update "Java Version" section

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/603 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: partitionsFor method doesn't return latest partition metadata

Siyuan, This behavior of only periodically update metadata at the consumer is by-design to abstract users from manual metadata refresh, and having a stale metadata would not have incorrectness issues since it will only mean some newly added partitions will not be consumed for at most

Looking for review

I have a few outstanding pull requests that need review or commit. I rebased all of them today to be sure they auto-merge. Does anyone have time to look these over? Small/Quick Changes (likely ready for commit): - MINOR: Fix building from subproject directory -

[jira] [Updated] (KAFKA-2167) ZkUtils updateEphemeralPath JavaDoc (spelling and correctness)

[ https://issues.apache.org/jira/browse/KAFKA-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neelesh Srinivas Salian updated KAFKA-2167: --- Status: Open (was: Patch Available) > ZkUtils updateEphemeralPath JavaDoc

[jira] [Commented] (KAFKA-2904) Consumer Fails to Reconnect after 30s post restarts

[ https://issues.apache.org/jira/browse/KAFKA-2904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032091#comment-15032091 ] Ben Stopford commented on KAFKA-2904: - This hasn't reoccured since the timeout was increased to 60s.

[jira] [Comment Edited] (KAFKA-2904) Consumer Fails to Reconnect after 30s post restarts

[ https://issues.apache.org/jira/browse/KAFKA-2904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032091#comment-15032091 ] Ben Stopford edited comment on KAFKA-2904 at 11/30/15 5:11 PM: --- This hasn't

partitionsFor method doesn't return latest partition metadata

Hi guys, I want to use partitionsFor method of new consumer API periodically to get the monitor partition metadata change, It seems it only issue remote call to the server for the first time. If I add partitions after that, partitionsFor will return stale value. Is there a way to reuse consumer

[jira] [Updated] (KAFKA-2909) Example of Gap in Consumption after Restart

[ https://issues.apache.org/jira/browse/KAFKA-2909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-2909: Summary: Example of Gap in Consumption after Restart (was: Another Instance of Gap in Consumption

[jira] [Updated] (KAFKA-2908) Another, possibly different, Gap in Consumption after Restart

[ https://issues.apache.org/jira/browse/KAFKA-2908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-2908: Summary: Another, possibly different, Gap in Consumption after Restart (was: Instance of Gap in

[jira] [Created] (KAFKA-2909) Another Instance of Gap in Consumption after Restart

Ben Stopford created KAFKA-2909: --- Summary: Another Instance of Gap in Consumption after Restart Key: KAFKA-2909 URL: https://issues.apache.org/jira/browse/KAFKA-2909 Project: Kafka Issue Type:

[jira] [Updated] (KAFKA-2909) Another Instance of Gap in Consumption after Restart

[ https://issues.apache.org/jira/browse/KAFKA-2909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-2909: Description: This seems very similar to Rajini's reported KAFAK-2891 *Context* The context is

[GitHub] kafka pull request: Fixed new consumer Javadoc typo

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/601 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-2856) add KTable

[ https://issues.apache.org/jira/browse/KAFKA-2856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032294#comment-15032294 ] ASF GitHub Bot commented on KAFKA-2856: --- Github user ymatsuda closed the pull request at:

[GitHub] kafka pull request: KAFKA-2856: add ktable

Github user ymatsuda closed the pull request at: https://github.com/apache/kafka/pull/604 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-2887) TopicMetadataRequest creates topic if it does not exist

[ https://issues.apache.org/jira/browse/KAFKA-2887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032239#comment-15032239 ] Andrew Winterman commented on KAFKA-2887: - Mind linking to KIP-4? > TopicMetadataRequest creates

[jira] [Commented] (KAFKA-2718) Reuse of temporary directories leading to transient unit test failures

[ https://issues.apache.org/jira/browse/KAFKA-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032254#comment-15032254 ] Guozhang Wang commented on KAFKA-2718: -- [~rsivaram] This test failed after the patch is merged in,

[GitHub] kafka pull request: MINOR: fix verifiable consumer assertion

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/597 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Created] (KAFKA-2910) Failure in kafka.api.SslEndToEndAuthorizationTest.testNoGroupAcl

Guozhang Wang created KAFKA-2910: Summary: Failure in kafka.api.SslEndToEndAuthorizationTest.testNoGroupAcl Key: KAFKA-2910 URL: https://issues.apache.org/jira/browse/KAFKA-2910 Project: Kafka

[jira] [Updated] (KAFKA-2902) StreamingConfig getConsumerConfiigs uses getRestoreConsumerConfigs instead of getBaseConsumerConfigs

[ https://issues.apache.org/jira/browse/KAFKA-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck updated KAFKA-2902: --- Component/s: kafka streams > StreamingConfig getConsumerConfiigs uses getRestoreConsumerConfigs

[GitHub] kafka pull request: KAFKA-2856: add ktable

GitHub user ymatsuda opened a pull request: https://github.com/apache/kafka/pull/604 KAFKA-2856: add ktable @guozhangwang * added KTable API and impl * added standby support for KTable You can merge this pull request into a Git repository by running: $ git pull

Re: partitionsFor method doesn't return latest partition metadata

Hey Siyuan, Are you also consuming from the topics you are querying with partitionsFor? I'm guessing the problem is that we're pulling the metadata from a local cache, and it's not refreshed as quick as you're expecting (the default is 5 minutes). We only use the cache for topics which have

[jira] [Assigned] (KAFKA-2909) Example of Gap in Consumption after Restart

[ https://issues.apache.org/jira/browse/KAFKA-2909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson reassigned KAFKA-2909: -- Assignee: Jason Gustafson > Example of Gap in Consumption after Restart >

Build failed in Jenkins: kafka_0.9.0_jdk7 #50

See Changes: [wangguoz] MINOR: fix verifiable consumer assertion [wangguoz] MINOR: Fixed new consumer Javadoc typo -- [...truncated 214 lines...] new

0.9.0.0 release notes is opening download mirrors page

Hi, Just noticed that the Release notes link of 0.9.0.0 is pointing to the download mirrors page. https://www.apache.org/dyn/closer.cgi?path=/kafka/0.9.0.0/RELEASE_NOTES.html Thanks, Kris K

[jira] [Commented] (KAFKA-2856) add KTable

[ https://issues.apache.org/jira/browse/KAFKA-2856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032309#comment-15032309 ] ASF GitHub Bot commented on KAFKA-2856: --- GitHub user ymatsuda reopened a pull request:

[GitHub] kafka pull request: KAFKA-2856: add ktable

GitHub user ymatsuda reopened a pull request: https://github.com/apache/kafka/pull/604 KAFKA-2856: add ktable @guozhangwang * added KTable API and impl * added standby support for KTable You can merge this pull request into a Git repository by running: $ git pull

[jira] [Commented] (KAFKA-2905) System test for rolling upgrade to enable ZooKeeper ACLs with SASL

[ https://issues.apache.org/jira/browse/KAFKA-2905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032377#comment-15032377 ] Guozhang Wang commented on KAFKA-2905: -- Github PR: https://github.com/apache/kafka/pull/598 > System

[jira] [Created] (KAFKA-2911) Replace Utils.sleep() with Time.sleep() whenever possible

Guozhang Wang created KAFKA-2911: Summary: Replace Utils.sleep() with Time.sleep() whenever possible Key: KAFKA-2911 URL: https://issues.apache.org/jira/browse/KAFKA-2911 Project: Kafka

[jira] [Updated] (KAFKA-2836) FAILING TEST: SaslSslTopicMetadataTest

[ https://issues.apache.org/jira/browse/KAFKA-2836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2836: - Description: {code} java.lang.AssertionError: Topic metadata is not correctly updated for broker

[jira] [Commented] (KAFKA-2836) FAILING TEST: SaslSslTopicMetadataTest

[ https://issues.apache.org/jira/browse/KAFKA-2836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032395#comment-15032395 ] Guozhang Wang commented on KAFKA-2836: -- Got another case for this failure:

Build failed in Jenkins: kafka-trunk-jdk8 #193

See Changes: [wangguoz] MINOR: fix verifiable consumer assertion [wangguoz] MINOR: Fixed new consumer Javadoc typo -- [...truncated 4499 lines...]

[jira] [Created] (KAFKA-2912) Add error code 4 (InvalidFetchSize) to Errors.java

Grant Henke created KAFKA-2912: -- Summary: Add error code 4 (InvalidFetchSize) to Errors.java Key: KAFKA-2912 URL: https://issues.apache.org/jira/browse/KAFKA-2912 Project: Kafka Issue Type: Bug

[jira] [Commented] (KAFKA-2912) Add error code 4 (InvalidFetchSize) to Errors.java

[ https://issues.apache.org/jira/browse/KAFKA-2912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032446#comment-15032446 ] Grant Henke commented on KAFKA-2912: See Errors.java in trunk

[jira] [Resolved] (KAFKA-2911) Replace Utils.sleep() with Time.sleep() whenever possible

[ https://issues.apache.org/jira/browse/KAFKA-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-2911. Resolution: Fixed Assignee: Jason Gustafson > Replace Utils.sleep() with Time.sleep()

[jira] [Commented] (KAFKA-2911) Replace Utils.sleep() with Time.sleep() whenever possible

[ https://issues.apache.org/jira/browse/KAFKA-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032852#comment-15032852 ] Jason Gustafson commented on KAFKA-2911: There were only a few places in the new consumer, so I

[jira] [Assigned] (KAFKA-1342) Slow controlled shutdowns can result in stale shutdown requests

[ https://issues.apache.org/jira/browse/KAFKA-1342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned KAFKA-1342: --- Assignee: Jiangjie Qin > Slow controlled shutdowns can result in stale shutdown requests >

[jira] [Commented] (KAFKA-2334) Prevent HW from going back during leader failover

[ https://issues.apache.org/jira/browse/KAFKA-2334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032642#comment-15032642 ] Guozhang Wang commented on KAFKA-2334: -- [~jinxing6...@126.com] The problem with this scenario is not

Re: 0.9.0.0 release notes is opening download mirrors page

Kris, It just points to the mirror site. If you click on one of the links, you will see the release notes. Thanks, Jun On Mon, Nov 30, 2015 at 1:37 PM, Kris K wrote: > Hi, > > Just noticed that the Release notes link of 0.9.0.0 is pointing to the > download mirrors

Build failed in Jenkins: kafka-trunk-jdk8 #194

See Changes: [wangguoz] MINOR: Update "Java Version" section -- [...truncated 4499 lines...] org.apache.kafka.connect.json.JsonConverterTest > timeToJson PASSED

Build failed in Jenkins: kafka-trunk-jdk8 #195

See Changes: [wangguoz] KAFKA-2771: Added rolling upgrade system test (ducktape) for Secured -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on

[jira] [Created] (KAFKA-2913) GroupMetadataManager unloads all groups in removeGroupsForPartitions

Jason Gustafson created KAFKA-2913: -- Summary: GroupMetadataManager unloads all groups in removeGroupsForPartitions Key: KAFKA-2913 URL: https://issues.apache.org/jira/browse/KAFKA-2913 Project:

FOSDEM 2016 - take action by 4th of December 2015

As most of you probably know FOSDEM 2016 (the biggest, 100% free open source developer conference) is right around the corner: https://fosdem.org/2016/ We hope to have an ASF booth and we would love to see as many ASF projects as possible present at various tracks (AKA Developer rooms):

Build failed in Jenkins: kafka_0.9.0_jdk7 #51

See Changes: [wangguoz] KAFKA-2913: missing partition check when removing groups from cache -- [...truncated 3015 lines...] kafka.consumer.ZookeeperConsumerConnectorTest > testCompression PASSED

[GitHub] kafka pull request: KAFKA-2913: missing partition check when remov...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/605 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Resolved] (KAFKA-2913) GroupMetadataManager unloads all groups in removeGroupsForPartitions

[ https://issues.apache.org/jira/browse/KAFKA-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-2913. -- Resolution: Fixed Fix Version/s: 0.9.0.1 Issue resolved by pull request 605

[jira] [Commented] (KAFKA-2913) GroupMetadataManager unloads all groups in removeGroupsForPartitions

[ https://issues.apache.org/jira/browse/KAFKA-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15033135#comment-15033135 ] ASF GitHub Bot commented on KAFKA-2913: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request: KAFKA-2913: missing partition check when remov...

GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/605 KAFKA-2913: missing partition check when removing groups from cache You can merge this pull request into a Git repository by running: $ git pull https://github.com/hachikuji/kafka KAFKA-2913

[jira] [Commented] (KAFKA-2913) GroupMetadataManager unloads all groups in removeGroupsForPartitions

[ https://issues.apache.org/jira/browse/KAFKA-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15033126#comment-15033126 ] ASF GitHub Bot commented on KAFKA-2913: --- GitHub user hachikuji opened a pull request:

[jira] [Updated] (KAFKA-2908) Instance of Gap in Consumption after Restart

[ https://issues.apache.org/jira/browse/KAFKA-2908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-2908: Attachment: 2015-11-28--001.tar.gz > Instance of Gap in Consumption after Restart >

[jira] [Comment Edited] (KAFKA-2891) Gaps in messages delivered by new consumer after Kafka restart

[ https://issues.apache.org/jira/browse/KAFKA-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030082#comment-15030082 ] Ben Stopford edited comment on KAFKA-2891 at 11/30/15 1:47 PM: --- Retracting

[jira] [Comment Edited] (KAFKA-2891) Gaps in messages delivered by new consumer after Kafka restart

[ https://issues.apache.org/jira/browse/KAFKA-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030455#comment-15030455 ] Ben Stopford edited comment on KAFKA-2891 at 11/30/15 1:53 PM: --- Sorry

[jira] [Comment Edited] (KAFKA-2891) Gaps in messages delivered by new consumer after Kafka restart

[ https://issues.apache.org/jira/browse/KAFKA-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030455#comment-15030455 ] Ben Stopford edited comment on KAFKA-2891 at 11/30/15 1:53 PM: --- Sorry

[jira] [Updated] (KAFKA-2908) Instance of Gap in Consumption after Restart

[ https://issues.apache.org/jira/browse/KAFKA-2908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-2908: Description: *Context:* Instance of the rolling upgrade test. 10s sleeps have been put around node

[jira] [Updated] (KAFKA-2908) Instance of Gap in Consumption after Restart

[ https://issues.apache.org/jira/browse/KAFKA-2908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-2908: Description: *Context:* Instance of the rolling upgrade test. 10s sleeps have been put around node

[GitHub] kafka pull request: MINOR: Update "Java Version" section

GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/603 MINOR: Update "Java Version" section Use the latest information from LinkedIn and mention that the latest released version is recommended from a security perspective. You can merge this pull

[jira] [Created] (KAFKA-2907) Client libraries 0.9 are missing in Maven repository

Michal Turek created KAFKA-2907: --- Summary: Client libraries 0.9 are missing in Maven repository Key: KAFKA-2907 URL: https://issues.apache.org/jira/browse/KAFKA-2907 Project: Kafka Issue Type:

[jira] [Commented] (KAFKA-2907) Client libraries 0.9 are missing in Maven repository

[ https://issues.apache.org/jira/browse/KAFKA-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15031766#comment-15031766 ] Ismael Juma commented on KAFKA-2907: The JARs are available, see:

[jira] [Created] (KAFKA-2908) Instance of Gap in Consumption after Restart

Ben Stopford created KAFKA-2908: --- Summary: Instance of Gap in Consumption after Restart Key: KAFKA-2908 URL: https://issues.apache.org/jira/browse/KAFKA-2908 Project: Kafka Issue Type:

[jira] [Commented] (KAFKA-2860) New consumer should handle auto-commit errors more gracefully

[ https://issues.apache.org/jira/browse/KAFKA-2860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15031855#comment-15031855 ] Ismael Juma commented on KAFKA-2860: This was actually included in 0.9.0.0:

[jira] [Updated] (KAFKA-2902) StreamingConfig getConsumerConfiigs uses getRestoreConsumerConfigs instead of getBaseConsumerConfigs

[ https://issues.apache.org/jira/browse/KAFKA-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck updated KAFKA-2902: --- Component/s: (was: kafka streams) > StreamingConfig getConsumerConfiigs uses

[jira] [Updated] (KAFKA-2860) New consumer should handle auto-commit errors more gracefully

[ https://issues.apache.org/jira/browse/KAFKA-2860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-2860: --- Fix Version/s: (was: 0.9.1.0) 0.9.0.0 > New consumer should handle auto-commit

Re: Release source doesn't contain .gitignore

Hi Grant, On Sat, Nov 28, 2015 at 5:28 PM, Grant Henke wrote: > I am not sure what the best practice is. Since it is checked in as part of > the project, I considered it effectively part of its source. I suspect the > method for collecting and taring the source files