Build failed in Jenkins: KafkaPreCommit #70

2015-04-09 Thread Apache Jenkins Server
See https://builds.apache.org/job/KafkaPreCommit/70/changes Changes: [junrao] kafka-2112; make overflowWheel volatile; patched by Yasuhiro Matsuda; reviewed by Jun Rao -- [...truncated 1521 lines...] at

[jira] [Commented] (KAFKA-1367) Broker topic metadata not kept in sync with ZooKeeper

2015-04-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14488218#comment-14488218 ] Jun Rao commented on KAFKA-1367: [~Skandragon], for the operational issue that you pointed

[jira] [Updated] (KAFKA-1788) producer record can stay in RecordAccumulator forever if leader is no available

2015-04-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-1788: --- Assignee: Parth Brahmbhatt (was: Jun Rao) producer record can stay in RecordAccumulator forever if leader

RE: Is there a complete Kafka 0.8.* replication design document

2015-04-09 Thread Jason Guo (jguo2)
Thanks. When a failed broker recovery, it will truncate its log to the last HW. But how to truncate? For a partition, it will store the log in many segment and one segment is a physical file. How to truncate a file to a specified HW? [cid:image001.png@01D072D5.BD52DFF0] Regards, Jason From:

[jira] [Created] (KAFKA-2112) make overflowWheel volatile

2015-04-09 Thread Yasuhiro Matsuda (JIRA)
Yasuhiro Matsuda created KAFKA-2112: --- Summary: make overflowWheel volatile Key: KAFKA-2112 URL: https://issues.apache.org/jira/browse/KAFKA-2112 Project: Kafka Issue Type: Bug

[DISCUSS] KIP-18 - JBOD Support

2015-04-09 Thread Andrii Biletskyi
Hi, Let me start discussion thread for KIP-18 - JBOD Support. Link to wiki: https://cwiki.apache.org/confluence/display/KAFKA/KIP-18+-+JBOD+Support Thanks, Andrii Biletskyi

[jira] [Updated] (KAFKA-2109) Support retries in KafkaLog4jAppender

2015-04-09 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-2109: Assignee: Dave Beech (was: Jun Rao) Support retries in KafkaLog4jAppender

Re: jira backlogs

2015-04-09 Thread Jun Rao
Gwen, Kafka jira is configured to allow contributors to edit and transition issues. So, not sure why you can't assign yourself as a reviewer. If you still have the problem, could you file an infra jira? Thanks, Jun On Wed, Apr 8, 2015 at 9:41 AM, Gwen Shapira gshap...@cloudera.com wrote: One

Re: Review Request 32890: Patch for conrolled shutdown rebase on trunk

2015-04-09 Thread Jiangjie Qin
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/32890/#review79533 --- Thanks for the patch. Interesting improvement. Some comments below.

[jira] [Commented] (KAFKA-2057) DelayedOperationTest.testRequestExpiry transient failure

2015-04-09 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487804#comment-14487804 ] Rajini Sivaram commented on KAFKA-2057: --- There is a small timing window in the test

[jira] [Commented] (KAFKA-2078) Getting Selector [WARN] Error in I/O with host java.io.EOFException

2015-04-09 Thread Aravind (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487954#comment-14487954 ] Aravind commented on KAFKA-2078: Hi, no OOME on broker or client. Else I would have

[jira] [Updated] (KAFKA-2089) MetadataTest transient failure

2015-04-09 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram updated KAFKA-2089: -- Assignee: Rajini Sivaram Status: Patch Available (was: Open) MetadataTest transient

[jira] [Commented] (KAFKA-2089) MetadataTest transient failure

2015-04-09 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487535#comment-14487535 ] Rajini Sivaram commented on KAFKA-2089: --- Created reviewboard

[jira] [Updated] (KAFKA-2089) MetadataTest transient failure

2015-04-09 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram updated KAFKA-2089: -- Attachment: KAFKA-2089.patch MetadataTest transient failure --

[jira] [Updated] (KAFKA-2077) Add ability to specify a TopicPicker class for KafkaLog4jApender

2015-04-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2077: --- Reviewer: (was: Gwen Shapira) Add ability to specify a TopicPicker class for KafkaLog4jApender

[jira] [Commented] (KAFKA-1367) Broker topic metadata not kept in sync with ZooKeeper

2015-04-09 Thread Michael Graff (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14488058#comment-14488058 ] Michael Graff commented on KAFKA-1367: -- There is another issue that no one seems to

[jira] [Commented] (KAFKA-2082) Kafka Replication ends up in a bad state

2015-04-09 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487473#comment-14487473 ] Sriharsha Chintalapani commented on KAFKA-2082: --- [~junrao] I ran a quick

Re: [KIP-DISCUSSION] KIP-13 Quotas

2015-04-09 Thread Jun Rao
Since we are also thinking about evolving the fetch request protocol in KAFKA-2063 (bound fetch response size), perhaps it's worth thinking through if we can just evolve the protocol once. Thanks, Jun On Wed, Apr 8, 2015 at 10:43 AM, Aditya Auradkar aaurad...@linkedin.com.invalid wrote:

[jira] [Updated] (KAFKA-2057) DelayedOperationTest.testRequestExpiry transient failure

2015-04-09 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram updated KAFKA-2057: -- Assignee: Rajini Sivaram Status: Patch Available (was: Open)

[jira] [Updated] (KAFKA-2036) Consumer and broker have different networks

2015-04-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2036: --- Status: Patch Available (was: Open) Consumer and broker have different networks

[jira] [Commented] (KAFKA-2089) MetadataTest transient failure

2015-04-09 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487550#comment-14487550 ] Rajini Sivaram commented on KAFKA-2089: --- There was a race condition in asyncFetch

[jira] [Updated] (KAFKA-1933) Fine-grained locking in log append

2015-04-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-1933: --- Assignee: Maxim Ivanov (was: Jay Kreps) Fine-grained locking in log append

Jenkins build is back to normal : Kafka-trunk #458

2015-04-09 Thread Apache Jenkins Server
See https://builds.apache.org/job/Kafka-trunk/458/changes

Review Request 33028: Patch for KAFKA-2112

2015-04-09 Thread Yasuhiro Matsuda
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33028/ --- Review request for kafka. Bugs: KAFKA-2112

[jira] [Updated] (KAFKA-2112) make overflowWheel volatile

2015-04-09 Thread Yasuhiro Matsuda (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yasuhiro Matsuda updated KAFKA-2112: Assignee: Yasuhiro Matsuda (was: Joel Koshy) Status: Patch Available (was: Open)

[jira] [Commented] (KAFKA-2112) make overflowWheel volatile

2015-04-09 Thread Yasuhiro Matsuda (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487830#comment-14487830 ] Yasuhiro Matsuda commented on KAFKA-2112: - Created reviewboard

Review Request 33027: Fix timing issue in DelayedOperationTest

2015-04-09 Thread Rajini Sivaram
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33027/ --- Review request for kafka. Bugs: KAFKA-2057

Re: [DISCUSS] KIP-18 - JBOD Support

2015-04-09 Thread Todd Palino
I think this is a good start. We've been discussing JBOD internally, so it's good to see a discussion going externally about it as well. The other big blocker to using JBOD is the lack of intelligent partition assignment logic, and the lack of tools to adjust it. The controller is not smart

[jira] [Commented] (KAFKA-2077) Add ability to specify a TopicPicker class for KafkaLog4jApender

2015-04-09 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487557#comment-14487557 ] Benoy Antony commented on KAFKA-2077: - Yes. Add ability to specify a TopicPicker

[jira] [Commented] (KAFKA-2077) Add ability to specify a TopicPicker class for KafkaLog4jApender

2015-04-09 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487555#comment-14487555 ] Benoy Antony commented on KAFKA-2077: - Use case is as below : We are using a system

[jira] [Updated] (KAFKA-2112) make overflowWheel volatile

2015-04-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2112: --- Resolution: Fixed Fix Version/s: 0.8.3 Status: Resolved (was: Patch Available) Thanks for

[jira] [Updated] (KAFKA-2057) DelayedOperationTest.testRequestExpiry transient failure

2015-04-09 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram updated KAFKA-2057: -- Attachment: KAFKA-2057.patch DelayedOperationTest.testRequestExpiry transient failure

[jira] [Commented] (KAFKA-2057) DelayedOperationTest.testRequestExpiry transient failure

2015-04-09 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487785#comment-14487785 ] Rajini Sivaram commented on KAFKA-2057: --- Created reviewboard

[jira] [Updated] (KAFKA-2077) Add ability to specify a TopicPicker class for KafkaLog4jApender

2015-04-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2077: --- Reviewer: Gwen Shapira Add ability to specify a TopicPicker class for KafkaLog4jApender