[jira] [Updated] (KAFKA-2159) offsets.topic.segment.bytes and offsets.topic.retention.minutes are ignored

2015-06-16 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy updated KAFKA-2159: --- Attachment: KAFKA-2159_2015-06-17_11:44:03.patch > offsets.topic.segment.bytes and offsets.top

[jira] [Commented] (KAFKA-2159) offsets.topic.segment.bytes and offsets.topic.retention.minutes are ignored

2015-06-16 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589362#comment-14589362 ] Manikumar Reddy commented on KAFKA-2159: Updated reviewboard https://reviews.apach

Re: Review Request 35454: Patch for KAFKA-2159

2015-06-16 Thread Manikumar Reddy O
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35454/ --- (Updated June 17, 2015, 6:19 a.m.) Review request for kafka. Bugs: KAFKA-2159

duplicate messages at consumer

2015-06-16 Thread Kris K
Hi, While testing message delivery using kafka, I realized that few duplicate messages got delivered by the consumers in the same consumer group (two consumers got the same message with few milli-seconds difference). However, I do not see any redundancy at the producer or broker. One more observat

[jira] [Commented] (KAFKA-369) remove ZK dependency on producer

2015-06-16 Thread Jiahongchao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589225#comment-14589225 ] Jiahongchao commented on KAFKA-369: --- So In producer we need a "metadata.broker.list: stri

[jira] [Commented] (KAFKA-2255) Missing documentation for max.in.flight.requests.per.connection

2015-06-16 Thread Patrick Lucas (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589206#comment-14589206 ] Patrick Lucas commented on KAFKA-2255: -- +1, documentation for this option would be us

Jenkins build is back to normal : KafkaPreCommit #125

2015-06-16 Thread Apache Jenkins Server
See

Jenkins build is back to normal : Kafka-trunk #513

2015-06-16 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-26 - Add Copycat, a connector framework for data import/export

2015-06-16 Thread Ewen Cheslack-Postava
On Tue, Jun 16, 2015 at 5:00 PM, Joe Stein wrote: > Hey Ewen, very interesting! > > I like the idea of the connector and making one side always being Kafka for > all the reasons you mentioned. It makes having to build consumers (over and > over and over (and over)) again for these type of tasks m

[jira] [Commented] (KAFKA-2078) Getting Selector [WARN] Error in I/O with host java.io.EOFException

2015-06-16 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589079#comment-14589079 ] Jun Rao commented on KAFKA-2078: The producer will retry on connection failure (if retry i

Re: [DISCUSS] KIP-26 - Add Copycat, a connector framework for data import/export

2015-06-16 Thread Joe Stein
Hey Ewen, very interesting! I like the idea of the connector and making one side always being Kafka for all the reasons you mentioned. It makes having to build consumers (over and over and over (and over)) again for these type of tasks much more consistent for everyone. Some initial comments (wil

Re: [DISCUSS] KIP-26 - Add Copycat, a connector framework for data import/export

2015-06-16 Thread Ewen Cheslack-Postava
Oops, linked the wrong thing. Here's the correct one: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=58851767 -Ewen On Tue, Jun 16, 2015 at 4:32 PM, Ewen Cheslack-Postava wrote: > Hi all, > > I just posted KIP-26 - Add Copycat, a connector framework for data > import/export he

[DISCUSS] KIP-26 - Add Copycat, a connector framework for data import/export

2015-06-16 Thread Ewen Cheslack-Postava
Hi all, I just posted KIP-26 - Add Copycat, a connector framework for data import/export here: https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals This is a large KIP compared to what we've had so far, and is a bit different from most. We're proposing the addition of a f

Build failed in Jenkins: KafkaPreCommit #124

2015-06-16 Thread Apache Jenkins Server
See Changes: [junrao] kafka-2195; Add versionId to AbstractRequest.getErrorResponse and AbstractRequest.getRequest; patched by Andrii Biletskyi; reviewed by Jun Rao [junrao] kafka-2270; incorrect package name in unit tests; patched by P

[jira] [Updated] (KAFKA-2235) LogCleaner offset map overflow

2015-06-16 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2235: --- Reviewer: Jun Rao (was: Jay Kreps) Status: In Progress (was: Patch Available) Thanks for the patch. Ni

Build failed in Jenkins: Kafka-trunk #512

2015-06-16 Thread Apache Jenkins Server
See Changes: [junrao] kafka-2195; Add versionId to AbstractRequest.getErrorResponse and AbstractRequest.getRequest; patched by Andrii Biletskyi; reviewed by Jun Rao [junrao] kafka-2270; incorrect package name in unit tests; patched by Pron

[jira] [Updated] (KAFKA-2213) Log cleaner should write compacted messages using configured compression type

2015-06-16 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-2213: -- Status: In Progress (was: Patch Available) > Log cleaner should write compacted messages using configur

Re: Review Request 34805: Patch for KAFKA-2213

2015-06-16 Thread Joel Koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34805/#review88148 --- Thanks for the patch. clients/src/main/java/org/apache/kafka/commo

[jira] [Created] (KAFKA-2280) Measurement of bytesInRate and bytesOutRate in BrokerTopicMetrics should be consistent

2015-06-16 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-2280: --- Summary: Measurement of bytesInRate and bytesOutRate in BrokerTopicMetrics should be consistent Key: KAFKA-2280 URL: https://issues.apache.org/jira/browse/KAFKA-2280 Project: K

[jira] [Created] (KAFKA-2279) add a main method in LogConfig to generate topic level configs in html

2015-06-16 Thread Jun Rao (JIRA)
Jun Rao created KAFKA-2279: -- Summary: add a main method in LogConfig to generate topic level configs in html Key: KAFKA-2279 URL: https://issues.apache.org/jira/browse/KAFKA-2279 Project: Kafka Iss

[jira] [Updated] (KAFKA-2262) LogSegmentSize validation should be consistent

2015-06-16 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2262: --- Resolution: Fixed Fix Version/s: 0.8.3 Status: Resolved (was: Patch Available) Thanks for t

[jira] [Updated] (KAFKA-2252) Socket connection closing is logged, but not corresponding opening of socket

2015-06-16 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2252: --- Resolution: Fixed Fix Version/s: 0.8.3 Status: Resolved (was: Patch Available) Thanks for t

[jira] [Updated] (KAFKA-2264) SESSION_TIMEOUT_MS_CONFIG in ConsumerConfig should be int

2015-06-16 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2264: --- Resolution: Fixed Fix Version/s: 0.8.3 Status: Resolved (was: Patch Available) Thanks for t

[jira] [Updated] (KAFKA-2272) listeners endpoint parsing fails if the hostname has capital letter

2015-06-16 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-2272: --- Resolution: Fixed Fix Version/s: 0.8.3 Status: Resolved (was: Patch Available) Thanks for t

Re: Kafka KIP hangout June 16

2015-06-16 Thread Jun Rao
The following are my notes for today's call. KIP-12: SSL patch is still in progress. KIP-23: Agreed to deprecate the old ConsumerOffsetChecker. new consumer: Guozhang will mark sub-tasks intended for 0.8.3 in KAFKA-1326. Thanks, Jun On Mon, Jun 15, 2015 at 3:16 PM, Jun Rao wrote: > Hi, Everyo

[jira] [Assigned] (KAFKA-2195) Add versionId to AbstractRequest.getErrorResponse and AbstractRequest.getRequest

2015-06-16 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao reassigned KAFKA-2195: -- Assignee: Andrii Biletskyi (was: Jun Rao) > Add versionId to AbstractRequest.getErrorResponse and > A

[jira] [Resolved] (KAFKA-2270) incorrect package name in unit tests

2015-06-16 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-2270. Resolution: Fixed Thanks for the patch. +1. Committed to trunk after removing {} on single class imports.

[jira] [Updated] (KAFKA-2278) JmxTool should support querying all objects when object-name is omitted

2015-06-16 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-2278: Status: Patch Available (was: Open) > JmxTool should support querying all objects when object-name is omitt

[jira] [Updated] (KAFKA-2278) JmxTool should support querying all objects when object-name is omitted

2015-06-16 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-2278: Attachment: KAFKA-2278.patch > JmxTool should support querying all objects when object-name is omitted > ---

[jira] [Commented] (KAFKA-2278) JmxTool should support querying all objects when object-name is omitted

2015-06-16 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588865#comment-14588865 ] Dong Lin commented on KAFKA-2278: - Created reviewboard https://reviews.apache.org/r/35540/

Review Request 35540: Patch for KAFKA-2278

2015-06-16 Thread Dong Lin
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35540/ --- Review request for kafka. Bugs: KAFKA-2278 https://issues.apache.org/jira/b

[jira] [Created] (KAFKA-2278) JmxTool should support querying all objects when object-name is omitted

2015-06-16 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-2278: --- Summary: JmxTool should support querying all objects when object-name is omitted Key: KAFKA-2278 URL: https://issues.apache.org/jira/browse/KAFKA-2278 Project: Kafka

New Consumer First Release Tasks

2015-06-16 Thread Guozhang Wang
As we have discussed in today's KIP, here is the list of tasks that is left before we can cut the first release of new consumer (and hence 0.8.3): "project = KAFKA AND resolution = Unresolved AND fixVersion = 0.8.3 AND component = consumer" in https://issues.apache.org/jira/issues/?jql= There a

[GitHub] kafka pull request: Kafka 2276

2015-06-16 Thread granders
GitHub user granders opened a pull request: https://github.com/apache/kafka/pull/70 Kafka 2276 Initial patch for KIP-25 Note that to install ducktape, do *not* use pip to install ducktape. Instead: ``` $ git clone g...@github.com:confluentinc/ducktape.git $

[jira] [Resolved] (KAFKA-2195) Add versionId to AbstractRequest.getErrorResponse and AbstractRequest.getRequest

2015-06-16 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-2195. Resolution: Fixed Thanks for the latest patch. +1 and committed to trunk. > Add versionId to AbstractReques

[jira] [Resolved] (KAFKA-2277) New producer treats requests to a disconnected broker as acks=0.

2015-06-16 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin resolved KAFKA-2277. - Resolution: Not A Problem Never mind... > New producer treats requests to a disconnected broker a

[jira] [Created] (KAFKA-2277) New producer treats requests to a disconnected broker as acks=0.

2015-06-16 Thread Jiangjie Qin (JIRA)
Jiangjie Qin created KAFKA-2277: --- Summary: New producer treats requests to a disconnected broker as acks=0. Key: KAFKA-2277 URL: https://issues.apache.org/jira/browse/KAFKA-2277 Project: Kafka

[jira] [Updated] (KAFKA-2045) Memory Management on the consumer

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2045: - Component/s: consumer > Memory Management on the consumer > - > >

[jira] [Created] (KAFKA-2276) Initial patch for KIP-25

2015-06-16 Thread Geoffrey Anderson (JIRA)
Geoffrey Anderson created KAFKA-2276: Summary: Initial patch for KIP-25 Key: KAFKA-2276 URL: https://issues.apache.org/jira/browse/KAFKA-2276 Project: Kafka Issue Type: Bug Re

[jira] [Created] (KAFKA-2275) Add a ListTopic() API to the new consumer

2015-06-16 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-2275: Summary: Add a ListTopic() API to the new consumer Key: KAFKA-2275 URL: https://issues.apache.org/jira/browse/KAFKA-2275 Project: Kafka Issue Type: Sub-task

[jira] [Updated] (KAFKA-2273) Add rebalance with a minimal number of reassignments to server-defined strategy list

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2273: - Labels: newbie++ (was: ) > Add rebalance with a minimal number of reassignments to server-defined

[jira] [Updated] (KAFKA-2273) Add rebalance with a minimal number of reassignments to server-defined strategy list

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2273: - Assignee: (was: Neha Narkhede) > Add rebalance with a minimal number of reassignments to serve

[jira] [Updated] (KAFKA-2045) Memory Management on the consumer

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2045: - Fix Version/s: 0.9.0 > Memory Management on the consumer > - > >

[jira] [Updated] (KAFKA-1895) Investigate moving deserialization and decompression out of KafkaConsumer

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1895: - Fix Version/s: 0.9.0 > Investigate moving deserialization and decompression out of KafkaConsumer >

[jira] [Updated] (KAFKA-2239) Allow coordinator to aggresively remove group when it is no longer owning the group

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2239: - Fix Version/s: 0.9.0 > Allow coordinator to aggresively remove group when it is no longer owning t

[jira] [Updated] (KAFKA-2273) Add rebalance with a minimal number of reassignments to server-defined strategy list

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2273: - Fix Version/s: 0.9.0 > Add rebalance with a minimal number of reassignments to server-defined > s

[jira] [Updated] (KAFKA-2017) Persist Coordinator State for Coordinator Failover

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2017: - Fix Version/s: 0.9.0 > Persist Coordinator State for Coordinator Failover > --

[jira] [Created] (KAFKA-2274) Add integration test for consumer coordinator

2015-06-16 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-2274: Summary: Add integration test for consumer coordinator Key: KAFKA-2274 URL: https://issues.apache.org/jira/browse/KAFKA-2274 Project: Kafka Issue Type: Sub-t

[jira] [Updated] (KAFKA-2168) New consumer poll() can block other calls like position(), commit(), and close() indefinitely

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2168: - Priority: Critical (was: Major) > New consumer poll() can block other calls like position(), comm

[jira] [Updated] (KAFKA-2168) New consumer poll() can block other calls like position(), commit(), and close() indefinitely

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2168: - Issue Type: Sub-task (was: Bug) Parent: KAFKA-1326 > New consumer poll() can block other

[jira] [Updated] (KAFKA-2168) New consumer poll() can block other calls like position(), commit(), and close() indefinitely

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2168: - Fix Version/s: 0.8.3 > New consumer poll() can block other calls like position(), commit(), and >

[jira] [Updated] (KAFKA-2123) Make new consumer offset commit API use callback + future

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2123: - Issue Type: Sub-task (was: Improvement) Parent: KAFKA-1326 > Make new consumer offset com

[jira] [Updated] (KAFKA-2123) Make new consumer offset commit API use callback + future

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2123: - Priority: Critical (was: Major) > Make new consumer offset commit API use callback + future > ---

[jira] [Updated] (KAFKA-1893) Allow regex subscriptions in the new consumer

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1893: - Fix Version/s: 0.8.3 > Allow regex subscriptions in the new consumer > ---

[jira] [Updated] (KAFKA-2245) Add response tests for ConsumerCoordinator

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2245: - Fix Version/s: 0.8.3 > Add response tests for ConsumerCoordinator > --

[jira] [Updated] (KAFKA-1893) Allow regex subscriptions in the new consumer

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1893: - Priority: Critical (was: Major) > Allow regex subscriptions in the new consumer > ---

[jira] [Updated] (KAFKA-2245) Add response tests for ConsumerCoordinator

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2245: - Priority: Critical (was: Major) > Add response tests for ConsumerCoordinator > --

[jira] [Updated] (KAFKA-1894) Avoid long or infinite blocking in the consumer

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1894: - Fix Version/s: 0.9.0 > Avoid long or infinite blocking in the consumer > -

[jira] [Updated] (KAFKA-1740) Merge Offset manager into Coordinator

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1740: - Fix Version/s: (was: 0.9.0) 0.8.3 > Merge Offset manager into Coordinator >

[jira] [Updated] (KAFKA-1740) Merge Offset manager into Coordinator

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1740: - Priority: Critical (was: Major) > Merge Offset manager into Coordinator > ---

[jira] [Updated] (KAFKA-1334) Coordinator should detect consumer failures

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1334: - Fix Version/s: 0.8.3 > Coordinator should detect consumer failures > -

[jira] [Updated] (KAFKA-1332) Add functionality to the offsetsBeforeTime() API

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1332: - Fix Version/s: 0.9.0 > Add functionality to the offsetsBeforeTime() API >

[jira] [Updated] (KAFKA-1335) Add rebalancing logic to the coordinator / consumer

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1335: - Fix Version/s: 0.8.3 > Add rebalancing logic to the coordinator / consumer > -

[jira] [Updated] (KAFKA-1333) Add consumer co-ordinator module to the server

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1333: - Fix Version/s: 0.8.3 > Add consumer co-ordinator module to the server > --

[jira] [Updated] (KAFKA-1330) Implement subscribe(TopicPartition...partitions) and pool(timeout) in the consumer

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1330: - Fix Version/s: 0.8.3 > Implement subscribe(TopicPartition...partitions) and pool(timeout) in the

[jira] [Updated] (KAFKA-1329) Add metadata fetch and refresh functionality to the consumer

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1329: - Affects Version/s: (was: 0.9.0) > Add metadata fetch and refresh functionality to the consumer

[jira] [Updated] (KAFKA-1331) Add ability to commit offsets to the new consumer

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1331: - Fix Version/s: 0.8.3 > Add ability to commit offsets to the new consumer > ---

[jira] [Updated] (KAFKA-1316) Refactor Sender

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1316: - Component/s: (was: producer ) clients > Refactor Sender > --- > >

[jira] [Updated] (KAFKA-1331) Add ability to commit offsets to the new consumer

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1331: - Affects Version/s: (was: 0.9.0) > Add ability to commit offsets to the new consumer >

[jira] [Updated] (KAFKA-1329) Add metadata fetch and refresh functionality to the consumer

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1329: - Fix Version/s: 0.8.3 > Add metadata fetch and refresh functionality to the consumer >

[jira] [Updated] (KAFKA-1330) Implement subscribe(TopicPartition...partitions) and pool(timeout) in the consumer

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1330: - Affects Version/s: (was: 0.9.0) > Implement subscribe(TopicPartition...partitions) and pool(ti

[jira] [Updated] (KAFKA-1331) Add ability to commit offsets to the new consumer

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1331: - Assignee: Jay Kreps > Add ability to commit offsets to the new consumer >

[jira] [Updated] (KAFKA-1316) Refactor Sender

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1316: - Fix Version/s: (was: 0.8.2.0) 0.8.3 > Refactor Sender > --- > >

[jira] [Updated] (KAFKA-1328) Add new consumer APIs

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1328: - Affects Version/s: (was: 0.8.1) (was: 0.8.0) > Add new consumer API

[jira] [Updated] (KAFKA-1328) Add new consumer APIs

2015-06-16 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1328: - Fix Version/s: (was: 0.8.2.0) 0.8.3 > Add new consumer APIs > -

Re: Review Request 34415: Patch for KAFKA-2195

2015-06-16 Thread Andrii Biletskyi
> On June 16, 2015, 3:52 p.m., Jun Rao wrote: > > clients/src/main/java/org/apache/kafka/common/requests/ConsumerMetadataRequest.java, > > lines 49-50 > > > > > > Perhaps it's better to include the request name in the

[jira] [Updated] (KAFKA-2195) Add versionId to AbstractRequest.getErrorResponse and AbstractRequest.getRequest

2015-06-16 Thread Andrii Biletskyi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrii Biletskyi updated KAFKA-2195: Attachment: KAFKA-2195_2015-06-16_22:28:19.patch > Add versionId to AbstractRequest.getError

Re: Review Request 34415: Patch for KAFKA-2195

2015-06-16 Thread Andrii Biletskyi
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34415/ --- (Updated June 16, 2015, 7:28 p.m.) Review request for kafka. Bugs: KAFKA-2195

[jira] [Commented] (KAFKA-2195) Add versionId to AbstractRequest.getErrorResponse and AbstractRequest.getRequest

2015-06-16 Thread Andrii Biletskyi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588607#comment-14588607 ] Andrii Biletskyi commented on KAFKA-2195: - Updated reviewboard https://reviews.apa

subscribe kafka

2015-06-16 Thread Jin Wang

[jira] [Comment Edited] (KAFKA-2270) incorrect package name in unit tests

2015-06-16 Thread Proneet Verma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588313#comment-14588313 ] Proneet Verma edited comment on KAFKA-2270 at 6/16/15 6:41 PM: -

[jira] [Updated] (KAFKA-2270) incorrect package name in unit tests

2015-06-16 Thread Proneet Verma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Proneet Verma updated KAFKA-2270: - Attachment: fix-kafka-2270.patch > incorrect package name in unit tests >

Re: Review Request 35454: Patch for KAFKA-2159

2015-06-16 Thread Joel Koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35454/#review88106 --- core/src/main/scala/kafka/server/KafkaConfig.scala (line 242)

[jira] [Updated] (KAFKA-2159) offsets.topic.segment.bytes and offsets.topic.retention.minutes are ignored

2015-06-16 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-2159: -- Reviewer: Joel Koshy > offsets.topic.segment.bytes and offsets.topic.retention.minutes are ignored > ---

[jira] [Commented] (KAFKA-2159) offsets.topic.segment.bytes and offsets.topic.retention.minutes are ignored

2015-06-16 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588522#comment-14588522 ] Joel Koshy commented on KAFKA-2159: --- Yes. > offsets.topic.segment.bytes and offsets.top

[jira] [Updated] (KAFKA-2254) The shell script should be optimized , even kafka-run-class.sh has a syntax error.

2015-06-16 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-2254: - Fix Version/s: (was: 0.8.2.1) 0.8.3 > The shell script should be optimized , even k

[jira] [Updated] (KAFKA-2207) The testCannotSendToInternalTopic test method in ProducerFailureHandlingTest fails consistently with the following exception:

2015-06-16 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-2207: - Fix Version/s: (was: 0.8.2.1) 0.8.3 > The testCannotSendToInternalTopic test method

[jira] [Resolved] (KAFKA-1000) Inbuilt consumer offset management feature for kakfa

2015-06-16 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein resolved KAFKA-1000. -- Resolution: Fixed > Inbuilt consumer offset management feature for kakfa > -

[jira] [Updated] (KAFKA-1326) New consumer checklist

2015-06-16 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1326: - Fix Version/s: 0.8.3 > New consumer checklist > -- > > Key: KAFKA-1326

[jira] [Updated] (KAFKA-2270) incorrect package name in unit tests

2015-06-16 Thread Proneet Verma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Proneet Verma updated KAFKA-2270: - Attachment: (was: fix-kafka-2270.patch) > incorrect package name in unit tests > -

[jira] [Updated] (KAFKA-2270) incorrect package name in unit tests

2015-06-16 Thread Proneet Verma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Proneet Verma updated KAFKA-2270: - Attachment: (was: fix-kafka-2270-v2.patch) > incorrect package name in unit tests > --

Re: Guozhang Wang elected to Kafka PMC

2015-06-16 Thread Gwen Shapira
Congrats Guozhang! Thanks for your contributions :) On Mon, Jun 15, 2015 at 9:59 PM, Jun Rao wrote: > Hi, Everyone, > > Guozhang Wang has been active in the Kafka community since he became a > Kafka committer about 7 months ago. I am glad to announce that Guozhang is > now a member of Kafka PMC.

[jira] [Assigned] (KAFKA-1782) Junit3 Misusage

2015-06-16 Thread Alexander Pakulov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Pakulov reassigned KAFKA-1782: Assignee: Alexander Pakulov (was: Jeff Holoman) > Junit3 Misusage > --

[jira] [Commented] (KAFKA-2092) New partitioning for better load balancing

2015-06-16 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588420#comment-14588420 ] Jay Kreps commented on KAFKA-2092: -- Hmm, not sure if I follow this. My understanding of t

Re: Guozhang Wang elected to Kafka PMC

2015-06-16 Thread Guozhang Wang
Thank you folks! Very glad to be onboard to PMC. Guozhang On Tue, Jun 16, 2015 at 9:59 AM, Dong Lin wrote: > Congrats Guozhang! > > Dong > > On Tue, Jun 16, 2015 at 9:57 AM, Timothy Chen wrote: > > > Congrats Guozhang!! > > > > Tim > > > > On Tue, Jun 16, 2015 at 8:19 AM, Aditya Auradkar > >

Re: Guozhang Wang elected to Kafka PMC

2015-06-16 Thread Dong Lin
Congrats Guozhang! Dong On Tue, Jun 16, 2015 at 9:57 AM, Timothy Chen wrote: > Congrats Guozhang!! > > Tim > > On Tue, Jun 16, 2015 at 8:19 AM, Aditya Auradkar > wrote: > > Congrats Guozhang! > > > > > > From: Ashish Singh [asi...@cloudera.com] > > Sent

Re: Guozhang Wang elected to Kafka PMC

2015-06-16 Thread Timothy Chen
Congrats Guozhang!! Tim On Tue, Jun 16, 2015 at 8:19 AM, Aditya Auradkar wrote: > Congrats Guozhang! > > > From: Ashish Singh [asi...@cloudera.com] > Sent: Monday, June 15, 2015 10:53 PM > To: dev@kafka.apache.org > Cc: Jun Rao > Subject: Re: Guozhang Wan

Review Request 35524: KAFKA-2092: New partitioning for better load balancing

2015-06-16 Thread Gianmarco De Francisci Morales
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35524/ --- Review request for kafka. Bugs: KAFKA-2092 https://issues.apache.org/jira/b

Re: Review Request 34789: Patch for KAFKA-2168

2015-06-16 Thread Jason Gustafson
> On June 15, 2015, 6:09 p.m., Jun Rao wrote: > > clients/src/main/java/org/apache/kafka/clients/consumer/KafkaConsumer.java, > > line 1199 > > > > > > Doesn't this cause poll() to block for the backoff time? Genera

[jira] [Updated] (KAFKA-2270) incorrect package name in unit tests

2015-06-16 Thread Proneet Verma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Proneet Verma updated KAFKA-2270: - Attachment: fix-kafka-2270-v2.patch I compiled 'unit.kafka'. Gave no errors with this patch. Let m

  1   2   >