[jira] [Created] (KAFKA-2273) Add rebalance with a minimal number of reassignments to server-defined strategy list

2015-06-16 Thread Olof Johansson (JIRA)
Olof Johansson created KAFKA-2273: - Summary: Add rebalance with a minimal number of reassignments to server-defined strategy list Key: KAFKA-2273 URL: https://issues.apache.org/jira/browse/KAFKA-2273

[jira] [Updated] (KAFKA-2273) Add rebalance with a minimal number of reassignments to server-defined strategy list

2015-06-16 Thread Olof Johansson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olof Johansson updated KAFKA-2273: -- Reviewer: Guozhang Wang Add rebalance with a minimal number of reassignments to server-defined

[jira] [Comment Edited] (KAFKA-2078) Getting Selector [WARN] Error in I/O with host java.io.EOFException

2015-06-16 Thread Sayat Satybaldiyev (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588083#comment-14588083 ] Sayat Satybaldiyev edited comment on KAFKA-2078 at 6/16/15 2:15 PM:

[jira] [Commented] (KAFKA-2078) Getting Selector [WARN] Error in I/O with host java.io.EOFException

2015-06-16 Thread Sayat Satybaldiyev (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588195#comment-14588195 ] Sayat Satybaldiyev commented on KAFKA-2078: --- I made a bench one more time and

[jira] [Updated] (KAFKA-2270) incorrect package name in unit tests

2015-06-16 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2270: --- Assignee: Proneet Verma incorrect package name in unit tests

RE: Guozhang Wang elected to Kafka PMC

2015-06-16 Thread Aditya Auradkar
Congrats Guozhang! From: Ashish Singh [asi...@cloudera.com] Sent: Monday, June 15, 2015 10:53 PM To: dev@kafka.apache.org Cc: Jun Rao Subject: Re: Guozhang Wang elected to Kafka PMC Congrats Guozhang! On Mon, Jun 15, 2015 at 10:20 PM, Sriharsha

Re: Review Request 34789: Patch for KAFKA-2168

2015-06-16 Thread Jason Gustafson
On June 15, 2015, 6:09 p.m., Jun Rao wrote: clients/src/main/java/org/apache/kafka/clients/consumer/KafkaConsumer.java, line 1199 https://reviews.apache.org/r/34789/diff/9/?file=983137#file983137line1199 Doesn't this cause poll() to block for the backoff time? Generally it

Re: Please add me to the contributor list

2015-06-16 Thread Jun Rao
Added. Thanks, Jun On Tue, Jun 16, 2015 at 3:07 AM, Proneet Verma pronee...@gmail.com wrote: Hi, I am a junior undergrad from India, where I am currently working on developing streaming apps with kafka and spark. After working with it for a while, I fell I'd love to contribute to the

[jira] [Commented] (KAFKA-2270) incorrect package name in unit tests

2015-06-16 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588109#comment-14588109 ] Jun Rao commented on KAFKA-2270: Thanks for the patch. Got a bunch of compilation errors

Review Request 35524: KAFKA-2092: New partitioning for better load balancing

2015-06-16 Thread Gianmarco De Francisci Morales
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35524/ --- Review request for kafka. Bugs: KAFKA-2092

Re: Review Request 34415: Patch for KAFKA-2195

2015-06-16 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34415/#review88074 --- Thanks for the latest patch. A couple more minor comments.

[jira] [Commented] (KAFKA-1646) Improve consumer read performance for Windows

2015-06-16 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588170#comment-14588170 ] Jun Rao commented on KAFKA-1646: [~waldenchen], thanks for the latest patch. A couple of

[jira] [Updated] (KAFKA-2270) incorrect package name in unit tests

2015-06-16 Thread Proneet Verma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Proneet Verma updated KAFKA-2270: - Attachment: fix-kafka-2270-v2.patch I compiled 'unit.kafka'. Gave no errors with this patch. Let

[jira] [Updated] (KAFKA-2254) The shell script should be optimized , even kafka-run-class.sh has a syntax error.

2015-06-16 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-2254: - Fix Version/s: (was: 0.8.2.1) 0.8.3 The shell script should be optimized , even

Re: Review Request 35454: Patch for KAFKA-2159

2015-06-16 Thread Joel Koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35454/#review88106 --- core/src/main/scala/kafka/server/KafkaConfig.scala (line 242)

Re: Guozhang Wang elected to Kafka PMC

2015-06-16 Thread Guozhang Wang
Thank you folks! Very glad to be onboard to PMC. Guozhang On Tue, Jun 16, 2015 at 9:59 AM, Dong Lin lindon...@gmail.com wrote: Congrats Guozhang! Dong On Tue, Jun 16, 2015 at 9:57 AM, Timothy Chen tnac...@gmail.com wrote: Congrats Guozhang!! Tim On Tue, Jun 16, 2015 at 8:19 AM,

Re: Guozhang Wang elected to Kafka PMC

2015-06-16 Thread Gwen Shapira
Congrats Guozhang! Thanks for your contributions :) On Mon, Jun 15, 2015 at 9:59 PM, Jun Rao j...@confluent.io wrote: Hi, Everyone, Guozhang Wang has been active in the Kafka community since he became a Kafka committer about 7 months ago. I am glad to announce that Guozhang is now a member

[jira] [Commented] (KAFKA-2159) offsets.topic.segment.bytes and offsets.topic.retention.minutes are ignored

2015-06-16 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588522#comment-14588522 ] Joel Koshy commented on KAFKA-2159: --- Yes. offsets.topic.segment.bytes and

[jira] [Updated] (KAFKA-2270) incorrect package name in unit tests

2015-06-16 Thread Proneet Verma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Proneet Verma updated KAFKA-2270: - Attachment: fix-kafka-2270.patch incorrect package name in unit tests

[jira] [Resolved] (KAFKA-1000) Inbuilt consumer offset management feature for kakfa

2015-06-16 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein resolved KAFKA-1000. -- Resolution: Fixed Inbuilt consumer offset management feature for kakfa

[jira] [Updated] (KAFKA-2207) The testCannotSendToInternalTopic test method in ProducerFailureHandlingTest fails consistently with the following exception:

2015-06-16 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-2207: - Fix Version/s: (was: 0.8.2.1) 0.8.3 The testCannotSendToInternalTopic test method

[jira] [Commented] (KAFKA-2092) New partitioning for better load balancing

2015-06-16 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588420#comment-14588420 ] Jay Kreps commented on KAFKA-2092: -- Hmm, not sure if I follow this. My understanding of

[jira] [Updated] (KAFKA-1326) New consumer checklist

2015-06-16 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1326: - Fix Version/s: 0.8.3 New consumer checklist -- Key: KAFKA-1326

[jira] [Assigned] (KAFKA-1782) Junit3 Misusage

2015-06-16 Thread Alexander Pakulov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Pakulov reassigned KAFKA-1782: Assignee: Alexander Pakulov (was: Jeff Holoman) Junit3 Misusage ---

Re: Guozhang Wang elected to Kafka PMC

2015-06-16 Thread Dong Lin
Congrats Guozhang! Dong On Tue, Jun 16, 2015 at 9:57 AM, Timothy Chen tnac...@gmail.com wrote: Congrats Guozhang!! Tim On Tue, Jun 16, 2015 at 8:19 AM, Aditya Auradkar aaurad...@linkedin.com.invalid wrote: Congrats Guozhang! From: Ashish

[jira] [Updated] (KAFKA-2045) Memory Management on the consumer

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2045: - Component/s: consumer Memory Management on the consumer -

[jira] [Resolved] (KAFKA-2195) Add versionId to AbstractRequest.getErrorResponse and AbstractRequest.getRequest

2015-06-16 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-2195. Resolution: Fixed Thanks for the latest patch. +1 and committed to trunk. Add versionId to

[jira] [Assigned] (KAFKA-2195) Add versionId to AbstractRequest.getErrorResponse and AbstractRequest.getRequest

2015-06-16 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao reassigned KAFKA-2195: -- Assignee: Andrii Biletskyi (was: Jun Rao) Add versionId to AbstractRequest.getErrorResponse and

[jira] [Created] (KAFKA-2277) New producer treats requests to a disconnected broker as acks=0.

2015-06-16 Thread Jiangjie Qin (JIRA)
Jiangjie Qin created KAFKA-2277: --- Summary: New producer treats requests to a disconnected broker as acks=0. Key: KAFKA-2277 URL: https://issues.apache.org/jira/browse/KAFKA-2277 Project: Kafka

Re: Kafka KIP hangout June 16

2015-06-16 Thread Jun Rao
The following are my notes for today's call. KIP-12: SSL patch is still in progress. KIP-23: Agreed to deprecate the old ConsumerOffsetChecker. new consumer: Guozhang will mark sub-tasks intended for 0.8.3 in KAFKA-1326. Thanks, Jun On Mon, Jun 15, 2015 at 3:16 PM, Jun Rao j...@confluent.io

[jira] [Updated] (KAFKA-2270) incorrect package name in unit tests

2015-06-16 Thread Proneet Verma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Proneet Verma updated KAFKA-2270: - Attachment: (was: fix-kafka-2270-v2.patch) incorrect package name in unit tests

[jira] [Updated] (KAFKA-2270) incorrect package name in unit tests

2015-06-16 Thread Proneet Verma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Proneet Verma updated KAFKA-2270: - Attachment: (was: fix-kafka-2270.patch) incorrect package name in unit tests

[jira] [Updated] (KAFKA-2159) offsets.topic.segment.bytes and offsets.topic.retention.minutes are ignored

2015-06-16 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-2159: -- Reviewer: Joel Koshy offsets.topic.segment.bytes and offsets.topic.retention.minutes are ignored

[jira] [Comment Edited] (KAFKA-2270) incorrect package name in unit tests

2015-06-16 Thread Proneet Verma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588313#comment-14588313 ] Proneet Verma edited comment on KAFKA-2270 at 6/16/15 6:41 PM:

[jira] [Created] (KAFKA-2278) JmxTool should support querying all objects when object-name is omitted

2015-06-16 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-2278: --- Summary: JmxTool should support querying all objects when object-name is omitted Key: KAFKA-2278 URL: https://issues.apache.org/jira/browse/KAFKA-2278 Project: Kafka

[jira] [Updated] (KAFKA-2272) listeners endpoint parsing fails if the hostname has capital letter

2015-06-16 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2272: --- Resolution: Fixed Fix Version/s: 0.8.3 Status: Resolved (was: Patch Available) Thanks for

[jira] [Resolved] (KAFKA-2277) New producer treats requests to a disconnected broker as acks=0.

2015-06-16 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved KAFKA-2277. - Resolution: Not A Problem Never mind... New producer treats requests to a disconnected broker

[GitHub] kafka pull request: Kafka 2276

2015-06-16 Thread granders
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/70 Kafka 2276 Initial patch for KIP-25 Note that to install ducktape, do *not* use pip to install ducktape. Instead: ``` $ git clone g...@github.com:confluentinc/ducktape.git

New Consumer First Release Tasks

2015-06-16 Thread Guozhang Wang
As we have discussed in today's KIP, here is the list of tasks that is left before we can cut the first release of new consumer (and hence 0.8.3): project = KAFKA AND resolution = Unresolved AND fixVersion = 0.8.3 AND component = consumer in https://issues.apache.org/jira/issues/?jql= There

[jira] [Updated] (KAFKA-2278) JmxTool should support querying all objects when object-name is omitted

2015-06-16 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-2278: Status: Patch Available (was: Open) JmxTool should support querying all objects when object-name is

[jira] [Updated] (KAFKA-2278) JmxTool should support querying all objects when object-name is omitted

2015-06-16 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-2278: Attachment: KAFKA-2278.patch JmxTool should support querying all objects when object-name is omitted

[jira] [Commented] (KAFKA-2278) JmxTool should support querying all objects when object-name is omitted

2015-06-16 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588865#comment-14588865 ] Dong Lin commented on KAFKA-2278: - Created reviewboard

Review Request 35540: Patch for KAFKA-2278

2015-06-16 Thread Dong Lin
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35540/ --- Review request for kafka. Bugs: KAFKA-2278

[jira] [Resolved] (KAFKA-2270) incorrect package name in unit tests

2015-06-16 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-2270. Resolution: Fixed Thanks for the patch. +1. Committed to trunk after removing {} on single class imports.

[jira] [Updated] (KAFKA-1329) Add metadata fetch and refresh functionality to the consumer

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1329: - Fix Version/s: 0.8.3 Add metadata fetch and refresh functionality to the consumer

[jira] [Updated] (KAFKA-1331) Add ability to commit offsets to the new consumer

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1331: - Affects Version/s: (was: 0.9.0) Add ability to commit offsets to the new consumer

[jira] [Updated] (KAFKA-1331) Add ability to commit offsets to the new consumer

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1331: - Fix Version/s: 0.8.3 Add ability to commit offsets to the new consumer

[jira] [Updated] (KAFKA-1331) Add ability to commit offsets to the new consumer

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1331: - Assignee: Jay Kreps Add ability to commit offsets to the new consumer

[jira] [Updated] (KAFKA-1330) Implement subscribe(TopicPartition...partitions) and pool(timeout) in the consumer

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1330: - Affects Version/s: (was: 0.9.0) Implement subscribe(TopicPartition...partitions) and

[jira] [Created] (KAFKA-2276) Initial patch for KIP-25

2015-06-16 Thread Geoffrey Anderson (JIRA)
Geoffrey Anderson created KAFKA-2276: Summary: Initial patch for KIP-25 Key: KAFKA-2276 URL: https://issues.apache.org/jira/browse/KAFKA-2276 Project: Kafka Issue Type: Bug

[jira] [Commented] (KAFKA-2195) Add versionId to AbstractRequest.getErrorResponse and AbstractRequest.getRequest

2015-06-16 Thread Andrii Biletskyi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588607#comment-14588607 ] Andrii Biletskyi commented on KAFKA-2195: - Updated reviewboard

[jira] [Updated] (KAFKA-1335) Add rebalancing logic to the coordinator / consumer

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1335: - Fix Version/s: 0.8.3 Add rebalancing logic to the coordinator / consumer

[jira] [Updated] (KAFKA-1333) Add consumer co-ordinator module to the server

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1333: - Fix Version/s: 0.8.3 Add consumer co-ordinator module to the server

[jira] [Updated] (KAFKA-1330) Implement subscribe(TopicPartition...partitions) and pool(timeout) in the consumer

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1330: - Fix Version/s: 0.8.3 Implement subscribe(TopicPartition...partitions) and pool(timeout) in the

[jira] [Updated] (KAFKA-2123) Make new consumer offset commit API use callback + future

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2123: - Issue Type: Sub-task (was: Improvement) Parent: KAFKA-1326 Make new consumer offset

[jira] [Updated] (KAFKA-2123) Make new consumer offset commit API use callback + future

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2123: - Priority: Critical (was: Major) Make new consumer offset commit API use callback + future

[jira] [Created] (KAFKA-2275) Add a ListTopic() API to the new consumer

2015-06-16 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-2275: Summary: Add a ListTopic() API to the new consumer Key: KAFKA-2275 URL: https://issues.apache.org/jira/browse/KAFKA-2275 Project: Kafka Issue Type: Sub-task

Re: Review Request 34415: Patch for KAFKA-2195

2015-06-16 Thread Andrii Biletskyi
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34415/ --- (Updated June 16, 2015, 7:28 p.m.) Review request for kafka. Bugs:

[jira] [Updated] (KAFKA-2195) Add versionId to AbstractRequest.getErrorResponse and AbstractRequest.getRequest

2015-06-16 Thread Andrii Biletskyi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrii Biletskyi updated KAFKA-2195: Attachment: KAFKA-2195_2015-06-16_22:28:19.patch Add versionId to

[jira] [Updated] (KAFKA-1328) Add new consumer APIs

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1328: - Affects Version/s: (was: 0.8.1) (was: 0.8.0) Add new consumer

[jira] [Updated] (KAFKA-1316) Refactor Sender

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1316: - Fix Version/s: (was: 0.8.2.0) 0.8.3 Refactor Sender ---

[jira] [Updated] (KAFKA-1328) Add new consumer APIs

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1328: - Fix Version/s: (was: 0.8.2.0) 0.8.3 Add new consumer APIs

[jira] [Updated] (KAFKA-1740) Merge Offset manager into Coordinator

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1740: - Fix Version/s: (was: 0.9.0) 0.8.3 Merge Offset manager into Coordinator

[jira] [Updated] (KAFKA-2168) New consumer poll() can block other calls like position(), commit(), and close() indefinitely

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2168: - Fix Version/s: 0.8.3 New consumer poll() can block other calls like position(), commit(), and

[jira] [Updated] (KAFKA-2168) New consumer poll() can block other calls like position(), commit(), and close() indefinitely

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2168: - Issue Type: Sub-task (was: Bug) Parent: KAFKA-1326 New consumer poll() can block other

[jira] [Updated] (KAFKA-2168) New consumer poll() can block other calls like position(), commit(), and close() indefinitely

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2168: - Priority: Critical (was: Major) New consumer poll() can block other calls like position(),

[jira] [Updated] (KAFKA-2273) Add rebalance with a minimal number of reassignments to server-defined strategy list

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2273: - Labels: newbie++ (was: ) Add rebalance with a minimal number of reassignments to server-defined

[jira] [Updated] (KAFKA-1895) Investigate moving deserialization and decompression out of KafkaConsumer

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1895: - Fix Version/s: 0.9.0 Investigate moving deserialization and decompression out of KafkaConsumer

[jira] [Updated] (KAFKA-2239) Allow coordinator to aggresively remove group when it is no longer owning the group

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2239: - Fix Version/s: 0.9.0 Allow coordinator to aggresively remove group when it is no longer owning

[jira] [Updated] (KAFKA-2273) Add rebalance with a minimal number of reassignments to server-defined strategy list

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2273: - Assignee: (was: Neha Narkhede) Add rebalance with a minimal number of reassignments to

[jira] [Updated] (KAFKA-1334) Coordinator should detect consumer failures

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1334: - Fix Version/s: 0.8.3 Coordinator should detect consumer failures

[jira] [Updated] (KAFKA-1740) Merge Offset manager into Coordinator

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1740: - Priority: Critical (was: Major) Merge Offset manager into Coordinator

[jira] [Updated] (KAFKA-1332) Add functionality to the offsetsBeforeTime() API

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1332: - Fix Version/s: 0.9.0 Add functionality to the offsetsBeforeTime() API

[jira] [Updated] (KAFKA-1893) Allow regex subscriptions in the new consumer

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1893: - Fix Version/s: 0.8.3 Allow regex subscriptions in the new consumer

[jira] [Updated] (KAFKA-1893) Allow regex subscriptions in the new consumer

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1893: - Priority: Critical (was: Major) Allow regex subscriptions in the new consumer

[jira] [Updated] (KAFKA-1894) Avoid long or infinite blocking in the consumer

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1894: - Fix Version/s: 0.9.0 Avoid long or infinite blocking in the consumer

[jira] [Updated] (KAFKA-2245) Add response tests for ConsumerCoordinator

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2245: - Fix Version/s: 0.8.3 Add response tests for ConsumerCoordinator

subscribe kafka

2015-06-16 Thread Jin Wang

Re: Review Request 34415: Patch for KAFKA-2195

2015-06-16 Thread Andrii Biletskyi
On June 16, 2015, 3:52 p.m., Jun Rao wrote: clients/src/main/java/org/apache/kafka/common/requests/ConsumerMetadataRequest.java, lines 49-50 https://reviews.apache.org/r/34415/diff/3/?file=984580#file984580line49 Perhaps it's better to include the request name in the error

[jira] [Updated] (KAFKA-2273) Add rebalance with a minimal number of reassignments to server-defined strategy list

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2273: - Fix Version/s: 0.9.0 Add rebalance with a minimal number of reassignments to server-defined

[jira] [Updated] (KAFKA-2017) Persist Coordinator State for Coordinator Failover

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2017: - Fix Version/s: 0.9.0 Persist Coordinator State for Coordinator Failover

[jira] [Created] (KAFKA-2274) Add integration test for consumer coordinator

2015-06-16 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-2274: Summary: Add integration test for consumer coordinator Key: KAFKA-2274 URL: https://issues.apache.org/jira/browse/KAFKA-2274 Project: Kafka Issue Type:

Build failed in Jenkins: Kafka-trunk #512

2015-06-16 Thread Apache Jenkins Server
See https://builds.apache.org/job/Kafka-trunk/512/changes Changes: [junrao] kafka-2195; Add versionId to AbstractRequest.getErrorResponse and AbstractRequest.getRequest; patched by Andrii Biletskyi; reviewed by Jun Rao [junrao] kafka-2270; incorrect package name in unit tests; patched by

[jira] [Updated] (KAFKA-2235) LogCleaner offset map overflow

2015-06-16 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2235: --- Reviewer: Jun Rao (was: Jay Kreps) Status: In Progress (was: Patch Available) Thanks for the patch.

Build failed in Jenkins: KafkaPreCommit #124

2015-06-16 Thread Apache Jenkins Server
See https://builds.apache.org/job/KafkaPreCommit/124/changes Changes: [junrao] kafka-2195; Add versionId to AbstractRequest.getErrorResponse and AbstractRequest.getRequest; patched by Andrii Biletskyi; reviewed by Jun Rao [junrao] kafka-2270; incorrect package name in unit tests; patched by

[jira] [Updated] (KAFKA-2264) SESSION_TIMEOUT_MS_CONFIG in ConsumerConfig should be int

2015-06-16 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2264: --- Resolution: Fixed Fix Version/s: 0.8.3 Status: Resolved (was: Patch Available) Thanks for

[jira] [Updated] (KAFKA-2262) LogSegmentSize validation should be consistent

2015-06-16 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2262: --- Resolution: Fixed Fix Version/s: 0.8.3 Status: Resolved (was: Patch Available) Thanks for

[jira] [Created] (KAFKA-2279) add a main method in LogConfig to generate topic level configs in html

2015-06-16 Thread Jun Rao (JIRA)
Jun Rao created KAFKA-2279: -- Summary: add a main method in LogConfig to generate topic level configs in html Key: KAFKA-2279 URL: https://issues.apache.org/jira/browse/KAFKA-2279 Project: Kafka

[jira] [Created] (KAFKA-2280) Measurement of bytesInRate and bytesOutRate in BrokerTopicMetrics should be consistent

2015-06-16 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-2280: --- Summary: Measurement of bytesInRate and bytesOutRate in BrokerTopicMetrics should be consistent Key: KAFKA-2280 URL: https://issues.apache.org/jira/browse/KAFKA-2280 Project:

Re: [DISCUSS] KIP-26 - Add Copycat, a connector framework for data import/export

2015-06-16 Thread Ewen Cheslack-Postava
Oops, linked the wrong thing. Here's the correct one: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=58851767 -Ewen On Tue, Jun 16, 2015 at 4:32 PM, Ewen Cheslack-Postava e...@confluent.io wrote: Hi all, I just posted KIP-26 - Add Copycat, a connector framework for data

[DISCUSS] KIP-26 - Add Copycat, a connector framework for data import/export

2015-06-16 Thread Ewen Cheslack-Postava
Hi all, I just posted KIP-26 - Add Copycat, a connector framework for data import/export here: https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals This is a large KIP compared to what we've had so far, and is a bit different from most. We're proposing the addition of a

Re: Review Request 34805: Patch for KAFKA-2213

2015-06-16 Thread Joel Koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34805/#review88148 --- Thanks for the patch.

Jenkins build is back to normal : KafkaPreCommit #125

2015-06-16 Thread Apache Jenkins Server
See https://builds.apache.org/job/KafkaPreCommit/125/changes

duplicate messages at consumer

2015-06-16 Thread Kris K
Hi, While testing message delivery using kafka, I realized that few duplicate messages got delivered by the consumers in the same consumer group (two consumers got the same message with few milli-seconds difference). However, I do not see any redundancy at the producer or broker. One more

[jira] [Commented] (KAFKA-2255) Missing documentation for max.in.flight.requests.per.connection

2015-06-16 Thread Patrick Lucas (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589206#comment-14589206 ] Patrick Lucas commented on KAFKA-2255: -- +1, documentation for this option would be

[jira] [Commented] (KAFKA-369) remove ZK dependency on producer

2015-06-16 Thread Jiahongchao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589225#comment-14589225 ] Jiahongchao commented on KAFKA-369: --- So In producer we need a metadata.broker.list:

Re: [DISCUSS] KIP-26 - Add Copycat, a connector framework for data import/export

2015-06-16 Thread Joe Stein
Hey Ewen, very interesting! I like the idea of the connector and making one side always being Kafka for all the reasons you mentioned. It makes having to build consumers (over and over and over (and over)) again for these type of tasks much more consistent for everyone. Some initial comments

Review Request 35493: Improve 1646 fix by add log.preallocate

2015-06-16 Thread Honghai Chen
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35493/ --- Review request for kafka. Bugs: KAFKA-1646

[jira] [Commented] (KAFKA-1646) Improve consumer read performance for Windows

2015-06-16 Thread Honghai Chen (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587601#comment-14587601 ] Honghai Chen commented on KAFKA-1646: - Created reviewboard

[jira] [Updated] (KAFKA-1646) Improve consumer read performance for Windows

2015-06-16 Thread Honghai Chen (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Honghai Chen updated KAFKA-1646: Attachment: KAFKA-1646_20150616_FixFormat.patch Improve consumer read performance for Windows

  1   2   >