[jira] [Commented] (KAFKA-1150) Fetch on a replicated topic does not return as soon as possible

2014-07-24 Thread Simon Cooper (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073025#comment-14073025 ] Simon Cooper commented on KAFKA-1150: - Yes, I built a replicated system with the

Gradle hanging on unit test run against ProducerFailureHangingTest-testBrokerFailure

2014-07-24 Thread David Corley
Hey all, I'm trying my hand at writing some patches for open issues, but I'm running into issues with running gradlew test. It hangs every time when trying to run testBrokerFailure in the ProducerFailureHangingTest suite. It was working for a time, but I updated to trunk HEAD and it's no longer

[jira] [Commented] (KAFKA-1150) Fetch on a replicated topic does not return as soon as possible

2014-07-24 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073276#comment-14073276 ] Guozhang Wang commented on KAFKA-1150: -- Awesome! Fetch on a replicated topic does

Re: Review Request 23858: Patch for KAFKA-1544

2014-07-24 Thread Manikumar Reddy O
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23858/ --- (Updated July 24, 2014, 3:11 p.m.) Review request for kafka. Bugs:

[jira] [Updated] (KAFKA-1544) LogCleaner may take a long time to shutdown

2014-07-24 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy updated KAFKA-1544: --- Attachment: KAFKA-1544_2014-07-24_20:38:52.patch LogCleaner may take a long time to

[jira] [Commented] (KAFKA-1544) LogCleaner may take a long time to shutdown

2014-07-24 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073282#comment-14073282 ] Manikumar Reddy commented on KAFKA-1544: Updated reviewboard

Re: Review Request 23858: Patch for KAFKA-1544

2014-07-24 Thread Manikumar Reddy O
On July 23, 2014, 4:56 p.m., Jay Kreps wrote: Is this better than using a condition? I was imagining replacing sleep with shutdownCondition.await(backoffMs, TimeUnit.MILLISECONDS) and then in shutdown() we call shutdownCondition.signal(). Jay Kreps wrote: Actually a condition

[jira] [Updated] (KAFKA-42) Support rebalancing the partitions with replication

2014-07-24 Thread Ivan Lyutov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-42?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Lyutov updated KAFKA-42: - Attachment: KAFKA-42_2014-07-24_15:36:04.patch Support rebalancing the partitions with replication

[jira] [Updated] (KAFKA-1419) cross build for scala 2.11

2014-07-24 Thread Ivan Lyutov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Lyutov updated KAFKA-1419: --- Attachment: KAFKA-1419.patch cross build for scala 2.11 --

[jira] [Commented] (KAFKA-1419) cross build for scala 2.11

2014-07-24 Thread Ivan Lyutov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073300#comment-14073300 ] Ivan Lyutov commented on KAFKA-1419: Created reviewboard against branch apache/0.8.1

[jira] [Commented] (KAFKA-42) Support rebalancing the partitions with replication

2014-07-24 Thread Ivan Lyutov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-42?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073298#comment-14073298 ] Ivan Lyutov commented on KAFKA-42: -- Updated reviewboard against branch apache/0.8.1

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-07-24 Thread Sudarshan Kadambi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073326#comment-14073326 ] Sudarshan Kadambi commented on KAFKA-1555: -- Neha and Jun: I want to make sure we

Review Request 23895: Patch for KAFKA-1419

2014-07-24 Thread Ivan Lyutov
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23895/ --- Review request for kafka. Bugs: KAFKA-1419

[jira] [Commented] (KAFKA-1419) cross build for scala 2.11

2014-07-24 Thread Ivan Lyutov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073337#comment-14073337 ] Ivan Lyutov commented on KAFKA-1419: Created reviewboard

[jira] [Commented] (KAFKA-1211) Hold the produce request with ack 1 in purgatory until replicas' HW has larger than the produce offset

2014-07-24 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073346#comment-14073346 ] Jun Rao commented on KAFKA-1211: Yes, this is a potential problem. Waiting for HW to be

[jira] [Resolved] (KAFKA-1150) Fetch on a replicated topic does not return as soon as possible

2014-07-24 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps resolved KAFKA-1150. -- Resolution: Duplicate Fetch on a replicated topic does not return as soon as possible

[jira] [Comment Edited] (KAFKA-1211) Hold the produce request with ack 1 in purgatory until replicas' HW has larger than the produce offset

2014-07-24 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073346#comment-14073346 ] Jun Rao edited comment on KAFKA-1211 at 7/24/14 4:30 PM: - Yes,

[jira] [Comment Edited] (KAFKA-1211) Hold the produce request with ack 1 in purgatory until replicas' HW has larger than the produce offset

2014-07-24 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073346#comment-14073346 ] Jun Rao edited comment on KAFKA-1211 at 7/24/14 4:32 PM: - Yes,

[jira] [Comment Edited] (KAFKA-1211) Hold the produce request with ack 1 in purgatory until replicas' HW has larger than the produce offset

2014-07-24 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073346#comment-14073346 ] Jun Rao edited comment on KAFKA-1211 at 7/24/14 4:34 PM: - Yes,

[jira] [Commented] (KAFKA-1476) Get a list of consumer groups

2014-07-24 Thread Balaji Seshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073374#comment-14073374 ] Balaji Seshadri commented on KAFKA-1476: Hi [~neha.narkh...@gmail.com], Looks

[jira] [Comment Edited] (KAFKA-1476) Get a list of consumer groups

2014-07-24 Thread Balaji Seshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073374#comment-14073374 ] Balaji Seshadri edited comment on KAFKA-1476 at 7/24/14 4:50 PM:

[jira] [Commented] (KAFKA-42) Support rebalancing the partitions with replication

2014-07-24 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-42?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073383#comment-14073383 ] Jun Rao commented on KAFKA-42: -- This jira is already closed. Is the patch for this jira?

[jira] [Commented] (KAFKA-328) Write unit test for kafka server startup and shutdown API

2014-07-24 Thread Balaji Seshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073391#comment-14073391 ] Balaji Seshadri commented on KAFKA-328: --- [~nehanarkhede] can you please advise on my

[jira] [Commented] (KAFKA-42) Support rebalancing the partitions with replication

2014-07-24 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-42?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073394#comment-14073394 ] Guozhang Wang commented on KAFKA-42: I think this is just due to the review-tool, which

[jira] [Updated] (KAFKA-1211) Hold the produce request with ack 1 in purgatory until replicas' HW has larger than the produce offset

2014-07-24 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-1211: --- Fix Version/s: 0.9.0 Hold the produce request with ack 1 in purgatory until replicas' HW has larger than

[jira] [Commented] (KAFKA-1211) Hold the produce request with ack 1 in purgatory until replicas' HW has larger than the produce offset

2014-07-24 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073422#comment-14073422 ] Guozhang Wang commented on KAFKA-1211: -- Jun, I think in your review of KAFKA-1430's

[jira] [Commented] (KAFKA-1211) Hold the produce request with ack 1 in purgatory until replicas' HW has larger than the produce offset

2014-07-24 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073449#comment-14073449 ] Jun Rao commented on KAFKA-1211: The issue is that this problem not only affects ack1, but

[jira] [Commented] (KAFKA-1211) Hold the produce request with ack 1 in purgatory until replicas' HW has larger than the produce offset

2014-07-24 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073478#comment-14073478 ] Guozhang Wang commented on KAFKA-1211: -- What I meant is that the ack=-1 should be

[jira] Subscription: outstanding kafka patches

2014-07-24 Thread jira
Issue Subscription Filter: outstanding kafka patches (111 issues) The list of outstanding kafka patches Subscriber: kafka-mailing-list Key Summary KAFKA-1550 Patch review tool should use git format-patch to generate patch https://issues.apache.org/jira/browse/KAFKA-1550

[jira] [Commented] (KAFKA-1070) Auto-assign node id

2014-07-24 Thread Clark Haskins (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073563#comment-14073563 ] Clark Haskins commented on KAFKA-1070: -- We currently have node IDs in the 0-1

[jira] [Commented] (KAFKA-1419) cross build for scala 2.11

2014-07-24 Thread Joe Crobak (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073651#comment-14073651 ] Joe Crobak commented on KAFKA-1419: --- I tried out this patch earlier today, and I have a

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-24 Thread Anton Karamanov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073649#comment-14073649 ] Anton Karamanov commented on KAFKA-1414: So what about the last version of a patch

[jira] [Commented] (KAFKA-1399) Drop Scala 2.8.x support

2014-07-24 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073661#comment-14073661 ] Joe Stein commented on KAFKA-1399: -- +1 to drop scala 2.8 support, lets do it in the

[jira] [Comment Edited] (KAFKA-1070) Auto-assign node id

2014-07-24 Thread Jon Bringhurst (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073665#comment-14073665 ] Jon Bringhurst edited comment on KAFKA-1070 at 7/24/14 9:16 PM:

[jira] [Commented] (KAFKA-1070) Auto-assign node id

2014-07-24 Thread Jon Bringhurst (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073665#comment-14073665 ] Jon Bringhurst commented on KAFKA-1070: --- [~clarkhaskins], [~sriharsha], having

[jira] [Commented] (KAFKA-1419) cross build for scala 2.11

2014-07-24 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073666#comment-14073666 ] Joe Stein commented on KAFKA-1419: -- Thanks [~joecrobak] for the feedback/review. Yes, we

[jira] [Comment Edited] (KAFKA-1419) cross build for scala 2.11

2014-07-24 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073666#comment-14073666 ] Joe Stein edited comment on KAFKA-1419 at 7/24/14 9:15 PM: ---

Review Request 23905: Patch for KAFKA-1527

2014-07-24 Thread Raul Castro Fernandez
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23905/ --- Review request for kafka. Bugs: KAFKA-1527

[jira] [Commented] (KAFKA-1527) SimpleConsumer should be transaction-aware

2014-07-24 Thread Raul Castro Fernandez (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073830#comment-14073830 ] Raul Castro Fernandez commented on KAFKA-1527: -- Created reviewboard

[jira] [Updated] (KAFKA-1527) SimpleConsumer should be transaction-aware

2014-07-24 Thread Raul Castro Fernandez (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Castro Fernandez updated KAFKA-1527: - Attachment: KAFKA-1527.patch SimpleConsumer should be transaction-aware

[jira] [Resolved] (KAFKA-1544) LogCleaner may take a long time to shutdown

2014-07-24 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps resolved KAFKA-1544. -- Resolution: Fixed Fix Version/s: 0.8.2 Committed, thanks! LogCleaner may take a long time to

[jira] [Resolved] (KAFKA-1483) Split Brain about Leader Partitions

2014-07-24 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede resolved KAFKA-1483. -- Resolution: Fixed Assignee: Sriharsha Chintalapani (was: Neha Narkhede) Sorry about the

Build failed in Jenkins: Kafka-trunk #232

2014-07-24 Thread Apache Jenkins Server
See https://builds.apache.org/job/Kafka-trunk/232/changes Changes: [jay.kreps] KAFKA-1544 Log cleaner takes a long time to shut down. Patch from Manikumar Reddy. [neha.narkhede] KAFKA-1483 Split Brain about Leader Partitions; reviewed by Guozhang, Jun and Neha

[jira] [Created] (KAFKA-1556) Sorry it's Just Test

2014-07-24 Thread sungjubong (JIRA)
sungjubong created KAFKA-1556: - Summary: Sorry it's Just Test Key: KAFKA-1556 URL: https://issues.apache.org/jira/browse/KAFKA-1556 Project: Kafka Issue Type: Test Components: core

Re: Review Request 23702: Patch for KAFKA-1070

2014-07-24 Thread Sriharsha Chintalapani
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23702/ --- (Updated July 25, 2014, 3:58 a.m.) Review request for kafka. Bugs:

[jira] [Updated] (KAFKA-1070) Auto-assign node id

2014-07-24 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-1070: -- Attachment: KAFKA-1070_2014-07-24_20:58:17.patch Auto-assign node id

[jira] [Commented] (KAFKA-1070) Auto-assign node id

2014-07-24 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14074028#comment-14074028 ] Sriharsha Chintalapani commented on KAFKA-1070: --- Updated reviewboard

Re: Review Request 23702: Patch for KAFKA-1070

2014-07-24 Thread Sriharsha Chintalapani
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23702/ --- (Updated July 25, 2014, 4:05 a.m.) Review request for kafka. Bugs:

Re: Review Request 23702: Patch for KAFKA-1070

2014-07-24 Thread Sriharsha Chintalapani
On July 24, 2014, 1:21 a.m., Neha Narkhede wrote: core/src/main/scala/kafka/utils/ZkUtils.scala, line 133 https://reviews.apache.org/r/23702/diff/3/?file=639483#file639483line133 It will be good to refer to 1000 as a static variable inside KafkaConfig eg.

[jira] [Updated] (KAFKA-1070) Auto-assign node id

2014-07-24 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-1070: -- Attachment: KAFKA-1070_2014-07-24_21:05:33.patch Auto-assign node id

[jira] [Commented] (KAFKA-1070) Auto-assign node id

2014-07-24 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14074036#comment-14074036 ] Sriharsha Chintalapani commented on KAFKA-1070: --- Updated reviewboard

Re: Review Request 23702: Patch for KAFKA-1070

2014-07-24 Thread Sriharsha Chintalapani
On July 24, 2014, 1:41 a.m., Jun Rao wrote: core/src/main/scala/kafka/server/KafkaServer.scala, lines 359-369 https://reviews.apache.org/r/23702/diff/3/?file=639482#file639482line359 Does this cover the case for metaBrokerIdSet.size == 1 and brokerId 0? In this case, we should

[jira] [Commented] (KAFKA-1211) Hold the produce request with ack 1 in purgatory until replicas' HW has larger than the produce offset

2014-07-24 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14074064#comment-14074064 ] Jun Rao commented on KAFKA-1211: Not quite. The case that I described above could happen

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-07-24 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14074070#comment-14074070 ] Jun Rao commented on KAFKA-1555: Sudarshan, Our replication guarantees are the following.

[jira] [Commented] (KAFKA-1029) Zookeeper leader election stuck in ephemeral node retry loop

2014-07-24 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14074081#comment-14074081 ] Jun Rao commented on KAFKA-1029: I think the proposed fix in KAFKA-1451 will fix this