Build failed in Jenkins: kafka_0.9.0_jdk7 #53

2015-12-01 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR - fix typo in index corruption warning message -- [...truncated 214 lines...] new UpdateMetadataRequest.BrokerEndPoint(brokerEndPoint.id,

Build failed in Jenkins: kafka-trunk-jdk8 #197

2015-12-01 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: Update LinkedIn JVM tuning settings [wangguoz] KAFKA-2915: Fix problem with System Tests that use bootstrap.servers [wangguoz] MINOR - fix typo in index corruption warning message [wangguoz] MINOR: Fix

Re: 0.9.0.0 release notes is opening download mirrors page

2015-12-01 Thread Kris K
Thanks Jun. Missed that part, my bad. Regards, Kris On Mon, Nov 30, 2015 at 4:17 PM, Jun Rao wrote: > Kris, > > It just points to the mirror site. If you click on one of the links, you > will see the release notes. > > Thanks, > > Jun > > On Mon, Nov 30, 2015 at 1:37 PM,

Re: [DISCUSS] KIP-30 Allow for brokers to have plug-able consensus and meta data storage sub systems

2015-12-01 Thread Jay Kreps
Hey Joe, I agree that you would need some transition plan, but think we may be proposing two different things. I think I'm proposing something like this: 1. Make tactical improvements to ZK usage as Neha describes 2. Scope out the longer term design for how we want to handle this 3. Build some

Re: [DISCUSS] KIP-30 Allow for brokers to have plug-able consensus and meta data storage sub systems

2015-12-01 Thread Onur Karaman
+1 on what Neha said. On Tue, Dec 1, 2015 at 1:41 PM, Neha Narkhede wrote: > I share Jay's concerns around plugins and he explained that very well, so I > will avoid repeating those. > > Agree that there is some feedback about getting rid of ZooKeeper altogether > and I'm on

Jenkins build is back to normal : kafka-trunk-jdk7 #868

2015-12-01 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-30 Allow for brokers to have plug-able consensus and meta data storage sub systems

2015-12-01 Thread Flavio Junqueira
I'm new to this community and I don't necessarily have all the background around the complaints on ZooKeeper, but I'd like to give my opinion, even if biased. To introduce myself in the case folks here don't know me, I'm one of the guys who developed ZooKeeper originally and designed the Zab

Re: [DISCUSS] KIP-30 Allow for brokers to have plug-able consensus and meta data storage sub systems

2015-12-01 Thread Neha Narkhede
I share Jay's concerns around plugins and he explained that very well, so I will avoid repeating those. Agree that there is some feedback about getting rid of ZooKeeper altogether and I'm on board with building a native version whenever we are ready to take this on. But I don't think the pain is

[jira] [Commented] (KAFKA-2308) New producer + Snappy face un-compression errors after broker restart

2015-12-01 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034497#comment-15034497 ] Guozhang Wang commented on KAFKA-2308: -- [~allenxwang] This bug should be only in the producer due to

Re: [DISCUSS] KIP-30 Allow for brokers to have plug-able consensus and meta data storage sub systems

2015-12-01 Thread Joe Stein
Yeah, lets do both! :) I always had trepidations about leaving things as is with ZooKeeper there. Can we have this new internal system be what replaces that but still make it modular somewhat. The problem with any new system is that everyone already trusts and relies on the existing scars we know

Jenkins build is back to normal : kafka_0.9.0_jdk7 #52

2015-12-01 Thread Apache Jenkins Server
See

[jira] [Commented] (KAFKA-2896) System test for partition re-assignment

2015-12-01 Thread Anna Povzner (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034606#comment-15034606 ] Anna Povzner commented on KAFKA-2896: - [~jinxing6...@126.com] I am already working on it, sorry I did

[jira] [Work started] (KAFKA-2896) System test for partition re-assignment

2015-12-01 Thread Anna Povzner (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-2896 started by Anna Povzner. --- > System test for partition re-assignment >

[jira] [Assigned] (KAFKA-2896) System test for partition re-assignment

2015-12-01 Thread Anna Povzner (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anna Povzner reassigned KAFKA-2896: --- Assignee: Anna Povzner > System test for partition re-assignment >

[jira] [Created] (KAFKA-2924) Add offsets/group metadata decoder so that DumpLogSegments can be used with the offsets topic

2015-12-01 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-2924: -- Summary: Add offsets/group metadata decoder so that DumpLogSegments can be used with the offsets topic Key: KAFKA-2924 URL: https://issues.apache.org/jira/browse/KAFKA-2924

[jira] [Created] (KAFKA-2925) NullPointerException if FileStreamSinkTask is stopped before initialization finishes

2015-12-01 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-2925: Summary: NullPointerException if FileStreamSinkTask is stopped before initialization finishes Key: KAFKA-2925 URL:

[jira] [Commented] (KAFKA-2891) Gaps in messages delivered by new consumer after Kafka restart

2015-12-01 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034892#comment-15034892 ] Rajini Sivaram commented on KAFKA-2891: --- [~benstopford] The logs from my failing test runs all show

[jira] [Comment Edited] (KAFKA-2891) Gaps in messages delivered by new consumer after Kafka restart

2015-12-01 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034892#comment-15034892 ] Rajini Sivaram edited comment on KAFKA-2891 at 12/1/15 11:53 PM: -

[GitHub] kafka pull request: KAFKA-1851 Using random dir under /temp for lo...

2015-12-01 Thread apovzner
GitHub user apovzner opened a pull request: https://github.com/apache/kafka/pull/609 KAFKA-1851 Using random dir under /temp for local kdc files to avoid conflicts. when multiple test jobs are running. I manually separated changes for KAFKA-2851 from this PR:

[jira] [Commented] (KAFKA-1851) OffsetFetchRequest returns extra partitions when input only contains unknown partitions

2015-12-01 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034929#comment-15034929 ] ASF GitHub Bot commented on KAFKA-1851: --- GitHub user apovzner opened a pull request:

[jira] [Commented] (KAFKA-2908) Another, possibly different, Gap in Consumption after Restart

2015-12-01 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034878#comment-15034878 ] Jason Gustafson commented on KAFKA-2908: After inspecting the broker data logs, I found that there

[jira] [Issue Comment Deleted] (KAFKA-2851) system tests: error copying keytab file

2015-12-01 Thread Anna Povzner (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anna Povzner updated KAFKA-2851: Comment: was deleted (was: In the same PR as KAFKA-2825) > system tests: error copying keytab file

[jira] [Comment Edited] (KAFKA-2851) system tests: error copying keytab file

2015-12-01 Thread Anna Povzner (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15010231#comment-15010231 ] Anna Povzner edited comment on KAFKA-2851 at 12/2/15 12:10 AM: --- Pull

Re: [DISCUSS] KIP-30 Allow for brokers to have plug-able consensus and meta data storage sub systems

2015-12-01 Thread Jay Kreps
Hey Flavio, Yeah, I think we are largely in agreement on virtually all points. Where I saw ZK shine was really in in-house infrastructure. LinkedIn had a dozen in-house systems that all used it, and it wouldn't have made sense for any of those systems to build their own. Likewise when we started

[jira] [Created] (KAFKA-2926) [MirrorMaker] InternalRebalancer calls wrong method of external rebalancer

2015-12-01 Thread Gwen Shapira (JIRA)
Gwen Shapira created KAFKA-2926: --- Summary: [MirrorMaker] InternalRebalancer calls wrong method of external rebalancer Key: KAFKA-2926 URL: https://issues.apache.org/jira/browse/KAFKA-2926 Project:

[jira] [Updated] (KAFKA-2926) [MirrorMaker] InternalRebalancer calls wrong method of external rebalancer

2015-12-01 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-2926: Description: MirrorMaker has an internal rebalance listener that will invoke an external

[jira] [Created] (KAFKA-2927) System tests: reduce storage footprint of KafkaService

2015-12-01 Thread Geoff Anderson (JIRA)
Geoff Anderson created KAFKA-2927: - Summary: System tests: reduce storage footprint of KafkaService Key: KAFKA-2927 URL: https://issues.apache.org/jira/browse/KAFKA-2927 Project: Kafka Issue

[jira] [Updated] (KAFKA-2927) System tests: reduce storage footprint of collected logs

2015-12-01 Thread Geoff Anderson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Geoff Anderson updated KAFKA-2927: -- Summary: System tests: reduce storage footprint of collected logs (was: System tests: reduce

[jira] [Assigned] (KAFKA-2926) [MirrorMaker] InternalRebalancer calls wrong method of external rebalancer

2015-12-01 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira reassigned KAFKA-2926: --- Assignee: Gwen Shapira > [MirrorMaker] InternalRebalancer calls wrong method of external

[jira] [Created] (KAFKA-2928) system tests: failures in version-related sanity checks

2015-12-01 Thread Geoff Anderson (JIRA)
Geoff Anderson created KAFKA-2928: - Summary: system tests: failures in version-related sanity checks Key: KAFKA-2928 URL: https://issues.apache.org/jira/browse/KAFKA-2928 Project: Kafka

[jira] [Commented] (KAFKA-1851) OffsetFetchRequest returns extra partitions when input only contains unknown partitions

2015-12-01 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035112#comment-15035112 ] ASF GitHub Bot commented on KAFKA-1851: --- GitHub user apovzner opened a pull request:

[jira] [Resolved] (KAFKA-656) Add Quotas to Kafka

2015-12-01 Thread Grant Henke (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke resolved KAFKA-656. --- Resolution: Duplicate > Add Quotas to Kafka > --- > > Key: KAFKA-656 >

[GitHub] kafka pull request: KAFKA-2926: [MirrorMaker] InternalRebalancer c...

2015-12-01 Thread gwenshap
GitHub user gwenshap opened a pull request: https://github.com/apache/kafka/pull/611 KAFKA-2926: [MirrorMaker] InternalRebalancer calls wrong method of ex… …ternal rebalancer You can merge this pull request into a Git repository by running: $ git pull

[GitHub] kafka pull request: KAFKA-1851 Using random file names for local k...

2015-12-01 Thread apovzner
GitHub user apovzner opened a pull request: https://github.com/apache/kafka/pull/610 KAFKA-1851 Using random file names for local kdc files to avoid conflicts. I originally tried to solve the problem by using tempfile, and creating and using scp() utility method that created a

[jira] [Commented] (KAFKA-2926) [MirrorMaker] InternalRebalancer calls wrong method of external rebalancer

2015-12-01 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035135#comment-15035135 ] ASF GitHub Bot commented on KAFKA-2926: --- GitHub user gwenshap opened a pull request:

[jira] [Updated] (KAFKA-2908) Another, possibly different, Gap in Consumption after Restart

2015-12-01 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-2908: Description: *Context:* Instance of the rolling upgrade test. 10s sleeps have been put around node

[jira] [Commented] (KAFKA-2909) Example of Gap in Consumption after Restart

2015-12-01 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034158#comment-15034158 ] Ben Stopford commented on KAFKA-2909: - This problem is producer-side > Example of Gap in Consumption

[jira] [Updated] (KAFKA-2908) Another, possibly different, Gap in Consumption after Restart

2015-12-01 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-2908: Description: *Context:* Instance of the rolling upgrade test. 10s sleeps have been put around node

[jira] [Commented] (KAFKA-2908) Another, possibly different, Gap in Consumption after Restart

2015-12-01 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034160#comment-15034160 ] Ben Stopford commented on KAFKA-2908: - This problem is consumer-side > Another, possibly different,

[jira] [Commented] (KAFKA-1374) LogCleaner (compaction) does not support compressed topics

2015-12-01 Thread Grant Henke (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034056#comment-15034056 ] Grant Henke commented on KAFKA-1374: With this being resolved, should we update this section of the

[jira] [Updated] (KAFKA-2909) Example of Gap in Consumption after Restart

2015-12-01 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-2909: Description: This seems very similar to Rajini's reported KAFAK-2891 *Context* The context is

[jira] [Updated] (KAFKA-2909) Example of Gap in Consumption after Restart

2015-12-01 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-2909: Description: This seems very similar to Rajini's reported KAFAK-2891 *Context* The context is

[jira] [Assigned] (KAFKA-2908) Another, possibly different, Gap in Consumption after Restart

2015-12-01 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson reassigned KAFKA-2908: -- Assignee: Jason Gustafson > Another, possibly different, Gap in Consumption after

[GitHub] kafka pull request: KAFKA-2915: Fix problem with System Tests that...

2015-12-01 Thread benstopford
GitHub user benstopford opened a pull request: https://github.com/apache/kafka/pull/608 KAFKA-2915: Fix problem with System Tests that use bootstrap.servers embedded in jinja files Fixes problems in mirror maker and consumer tests

[jira] [Commented] (KAFKA-2915) System Tests that use bootstrap.servers embedded in jinja files are not working

2015-12-01 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034245#comment-15034245 ] ASF GitHub Bot commented on KAFKA-2915: --- GitHub user benstopford opened a pull request:

[jira] [Commented] (KAFKA-2891) Gaps in messages delivered by new consumer after Kafka restart

2015-12-01 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034222#comment-15034222 ] Ben Stopford commented on KAFKA-2891: - [~rsivaram] I found an error in my analysis of KAFKA-2909

[jira] [Commented] (KAFKA-2908) Another, possibly different, Gap in Consumption after Restart

2015-12-01 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035355#comment-15035355 ] Jason Gustafson commented on KAFKA-2908: An additional note from the test failure: The last

[jira] [Commented] (KAFKA-936) Kafka Metrics Memory Leak

2015-12-01 Thread Hechen Gao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035307#comment-15035307 ] Hechen Gao commented on KAFKA-936: -- I am using kafka_2.10-0.8.1.1.jar in my project (which depend on

[DISCUSS] KIP-30 Allow for brokers to have plug-able consensus and meta data storage sub systems

2015-12-01 Thread Joe Stein
I would like to start a discussion around the work that has started in regards to KIP-30 https://cwiki.apache.org/confluence/display/KAFKA/KIP-30+-+Allow+for+brokers+to+have+plug-able+consensus+and+meta+data+storage+sub+systems The impetus for working on this came a lot from the community. For

[GitHub] kafka pull request: MINOR: Update LinkedIn JVM tuning settings

2015-12-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/607 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka-site pull request: MINOR: Update JVM version and tuning sett...

2015-12-01 Thread guozhangwang
Github user guozhangwang commented on the pull request: https://github.com/apache/kafka-site/pull/6#issuecomment-161068767 LGTM, merged to asf-site. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] kafka-site pull request: MINOR: Update JVM version and tuning sett...

2015-12-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka-site/pull/6 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-2308) New producer + Snappy face un-compression errors after broker restart

2015-12-01 Thread Allen Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034439#comment-15034439 ] Allen Wang commented on KAFKA-2308: --- [~gwenshap] [~guozhang] Is the fix in producer only? If I take

[jira] [Created] (KAFKA-2923) Improve 0.9.0 Upgrade Documents

2015-12-01 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-2923: Summary: Improve 0.9.0 Upgrade Documents Key: KAFKA-2923 URL: https://issues.apache.org/jira/browse/KAFKA-2923 Project: Kafka Issue Type: Bug

Build failed in Jenkins: kafka-trunk-jdk7 #867

2015-12-01 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: Update LinkedIn JVM tuning settings -- [...truncated 1793 lines...] jdk1.7.0_51/jre/lib/amd64/libjava.so jdk1.7.0_51/jre/lib/amd64/libJdbcOdbc.so

[jira] [Commented] (KAFKA-2837) FAILING TEST: kafka.api.ProducerBounceTest > testBrokerFailure

2015-12-01 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034446#comment-15034446 ] Guozhang Wang commented on KAFKA-2837: -- Another example:

[jira] [Updated] (KAFKA-2837) FAILING TEST: kafka.api.ProducerBounceTest > testBrokerFailure

2015-12-01 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2837: - Description: {code} java.lang.AssertionError at org.junit.Assert.fail(Assert.java:86)

[GitHub] kafka pull request: KAFKA-2915: Fix problem with System Tests that...

2015-12-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/608 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-2915) System Tests that use bootstrap.servers embedded in jinja files are not working

2015-12-01 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034462#comment-15034462 ] ASF GitHub Bot commented on KAFKA-2915: --- Github user asfgit closed the pull request at:

[jira] [Resolved] (KAFKA-2915) System Tests that use bootstrap.servers embedded in jinja files are not working

2015-12-01 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-2915. -- Resolution: Fixed Fix Version/s: 0.9.1.0 Issue resolved by pull request 608

[jira] [Updated] (KAFKA-2837) FAILING TEST: kafka.api.ProducerBounceTest > testBrokerFailure

2015-12-01 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2837: - Labels: newbie (was: ) > FAILING TEST: kafka.api.ProducerBounceTest > testBrokerFailure >

[GitHub] kafka pull request: MINOR - fix typo in index corruption warning m...

2015-12-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/606 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request: MINOR: Fix building from subproject directory

2015-12-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/509 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request: KAFKA-2421: Upgrade LZ4 to version 1.3

2015-12-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/552 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: [DISCUSS] KIP-30 Allow for brokers to have plug-able consensus and meta data storage sub systems

2015-12-01 Thread Jay Kreps
Hey Joe, Thanks for raising this. People really want to get rid of the ZK dependency, I agree it is among the most asked for things. Let me give a quick critique and a more radical plan. I don't think making ZK pluggable is the right thing to do. I have a lot of experience with this dynamic of

[jira] [Commented] (KAFKA-2421) Upgrade LZ4 to version 1.3 to avoid crashing with IBM Java 7

2015-12-01 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034476#comment-15034476 ] ASF GitHub Bot commented on KAFKA-2421: --- Github user asfgit closed the pull request at:

[jira] [Updated] (KAFKA-2421) Upgrade LZ4 to version 1.3 to avoid crashing with IBM Java 7

2015-12-01 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2421: - Resolution: Fixed Fix Version/s: 0.9.1.0 Status: Resolved (was: Patch

[jira] [Created] (KAFKA-2914) Kafka Connect Source connector for HBase

2015-12-01 Thread Niels Basjes (JIRA)
Niels Basjes created KAFKA-2914: --- Summary: Kafka Connect Source connector for HBase Key: KAFKA-2914 URL: https://issues.apache.org/jira/browse/KAFKA-2914 Project: Kafka Issue Type: New

[jira] [Commented] (KAFKA-2718) Reuse of temporary directories leading to transient unit test failures

2015-12-01 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15033407#comment-15033407 ] Rajini Sivaram commented on KAFKA-2718: --- [~guozhang] I tried to recreate, but I couldn't. I will

[GitHub] kafka pull request: MINOR - fix typo in index corruption warning m...

2015-12-01 Thread lindong28
GitHub user lindong28 opened a pull request: https://github.com/apache/kafka/pull/606 MINOR - fix typo in index corruption warning message You can merge this pull request into a Git repository by running: $ git pull https://github.com/lindong28/kafka minor-fix-typo

[jira] [Commented] (KAFKA-2891) Gaps in messages delivered by new consumer after Kafka restart

2015-12-01 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15033457#comment-15033457 ] Rajini Sivaram commented on KAFKA-2891: --- [~geoffra] Replication tests expect all ack'ed messages to

Build failed in Jenkins: kafka-trunk-jdk8 #196

2015-12-01 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-2913: missing partition check when removing groups from cache -- [...truncated 2828 lines...] kafka.api.ApiUtilsTest > testShortStringNonASCII PASSED

[GitHub] kafka pull request: MINOR: Update LinkedIn JVM tuning settings

2015-12-01 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/607 MINOR: Update LinkedIn JVM tuning settings This is a follow-up as the previous update was missing some changes. You can merge this pull request into a Git repository by running: $ git pull

[jira] [Created] (KAFKA-2915) Tests that use bootstrap.servers embedded in jinja files are not working

2015-12-01 Thread Ben Stopford (JIRA)
Ben Stopford created KAFKA-2915: --- Summary: Tests that use bootstrap.servers embedded in jinja files are not working Key: KAFKA-2915 URL: https://issues.apache.org/jira/browse/KAFKA-2915 Project: Kafka

[jira] [Commented] (KAFKA-2891) Gaps in messages delivered by new consumer after Kafka restart

2015-12-01 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15033850#comment-15033850 ] Rajini Sivaram commented on KAFKA-2891: --- [~benstopford] I dont see errors in my local replication

[jira] [Created] (KAFKA-2916) KIP-30 Plug-able interface for consensus and storage sub-systems

2015-12-01 Thread Andrii Biletskyi (JIRA)
Andrii Biletskyi created KAFKA-2916: --- Summary: KIP-30 Plug-able interface for consensus and storage sub-systems Key: KAFKA-2916 URL: https://issues.apache.org/jira/browse/KAFKA-2916 Project: Kafka

[jira] [Created] (KAFKA-2918) GroupMembership module

2015-12-01 Thread Andrii Biletskyi (JIRA)
Andrii Biletskyi created KAFKA-2918: --- Summary: GroupMembership module Key: KAFKA-2918 URL: https://issues.apache.org/jira/browse/KAFKA-2918 Project: Kafka Issue Type: Sub-task

[jira] [Updated] (KAFKA-2915) System Tests that use bootstrap.servers embedded in jinja files are not working

2015-12-01 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-2915: Summary: System Tests that use bootstrap.servers embedded in jinja files are not working (was:

[jira] [Created] (KAFKA-2917) LeaderElection module

2015-12-01 Thread Andrii Biletskyi (JIRA)
Andrii Biletskyi created KAFKA-2917: --- Summary: LeaderElection module Key: KAFKA-2917 URL: https://issues.apache.org/jira/browse/KAFKA-2917 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-2919) ListenerRegistry

2015-12-01 Thread Andrii Biletskyi (JIRA)
Andrii Biletskyi created KAFKA-2919: --- Summary: ListenerRegistry Key: KAFKA-2919 URL: https://issues.apache.org/jira/browse/KAFKA-2919 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-2920) Storage module

2015-12-01 Thread Andrii Biletskyi (JIRA)
Andrii Biletskyi created KAFKA-2920: --- Summary: Storage module Key: KAFKA-2920 URL: https://issues.apache.org/jira/browse/KAFKA-2920 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-2921) Plug-able implementations support

2015-12-01 Thread Andrii Biletskyi (JIRA)
Andrii Biletskyi created KAFKA-2921: --- Summary: Plug-able implementations support Key: KAFKA-2921 URL: https://issues.apache.org/jira/browse/KAFKA-2921 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-2922) System and Replication tools verification

2015-12-01 Thread Andrii Biletskyi (JIRA)
Andrii Biletskyi created KAFKA-2922: --- Summary: System and Replication tools verification Key: KAFKA-2922 URL: https://issues.apache.org/jira/browse/KAFKA-2922 Project: Kafka Issue Type:

[jira] [Commented] (KAFKA-2891) Gaps in messages delivered by new consumer after Kafka restart

2015-12-01 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15033560#comment-15033560 ] Ben Stopford commented on KAFKA-2891: - [~rsivaram] That sounds reasonable to me. I'm also surprised it

[jira] [Comment Edited] (KAFKA-2891) Gaps in messages delivered by new consumer after Kafka restart

2015-12-01 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15033560#comment-15033560 ] Ben Stopford edited comment on KAFKA-2891 at 12/1/15 12:18 PM: --- [~rsivaram]

[GitHub] kafka-site pull request: MINOR: Update JVM version and tuning sett...

2015-12-01 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka-site/pull/6 MINOR: Update JVM version and tuning settings Changes copied from 0.9.0 branch of the kafka repo. You can merge this pull request into a Git repository by running: $ git pull

[jira] [Issue Comment Deleted] (KAFKA-2891) Gaps in messages delivered by new consumer after Kafka restart

2015-12-01 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram updated KAFKA-2891: -- Comment: was deleted (was: [~geoffra] Replication tests expect all ack'ed messages to be

[jira] [Commented] (KAFKA-2891) Gaps in messages delivered by new consumer after Kafka restart

2015-12-01 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15033694#comment-15033694 ] Rajini Sivaram commented on KAFKA-2891: --- [~benstopford] Yes, you are right, replication test does

[jira] [Commented] (KAFKA-2891) Gaps in messages delivered by new consumer after Kafka restart

2015-12-01 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15033724#comment-15033724 ] Ben Stopford commented on KAFKA-2891: - [~rsivaram] so - in my investigations, even with

[jira] [Commented] (KAFKA-2896) System test for partition re-assignment

2015-12-01 Thread jin xing (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15033706#comment-15033706 ] jin xing commented on KAFKA-2896: - Hi, [~gwenshap] For this task, in my understanding, we need to do a