[jira] [Created] (KAFKA-2574) Add ducktape based ssl test for KafkaLog4jAppender

2015-09-22 Thread Ashish K Singh (JIRA)
Ashish K Singh created KAFKA-2574: - Summary: Add ducktape based ssl test for KafkaLog4jAppender Key: KAFKA-2574 URL: https://issues.apache.org/jira/browse/KAFKA-2574 Project: Kafka Issue Type

[jira] [Updated] (KAFKA-2531) Add Ducktape based tests for KafkaLog4jAppender

2015-09-22 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish K Singh updated KAFKA-2531: -- Description: Add ducktape based tests for KafkaLog4jAppender. (was: KAFKA-2447 adds support to

[jira] [Commented] (KAFKA-2531) Add Ducktape based tests for KafkaLog4jAppender

2015-09-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14904018#comment-14904018 ] ASF GitHub Bot commented on KAFKA-2531: --- GitHub user SinghAsDev opened a pull reques

[GitHub] kafka pull request: KAFKA-2531: Add Ducktape based tests for Kafka...

2015-09-22 Thread SinghAsDev
GitHub user SinghAsDev opened a pull request: https://github.com/apache/kafka/pull/235 KAFKA-2531: Add Ducktape based tests for KafkaLog4jAppender You can merge this pull request into a Git repository by running: $ git pull https://github.com/SinghAsDev/kafka KAFKA-2531 Alter

[jira] [Updated] (KAFKA-2573) Mirror maker system test hangs and eventually fails

2015-09-22 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish K Singh updated KAFKA-2573: -- Status: Patch Available (was: Open) > Mirror maker system test hangs and eventually fails > ---

[GitHub] kafka pull request: KAFKA-2573: Mirror maker system test hangs and...

2015-09-22 Thread SinghAsDev
GitHub user SinghAsDev opened a pull request: https://github.com/apache/kafka/pull/234 KAFKA-2573: Mirror maker system test hangs and eventually fails You can merge this pull request into a Git repository by running: $ git pull https://github.com/SinghAsDev/kafka KAFKA-2573 A

[jira] [Commented] (KAFKA-2573) Mirror maker system test hangs and eventually fails

2015-09-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14904012#comment-14904012 ] ASF GitHub Bot commented on KAFKA-2573: --- GitHub user SinghAsDev opened a pull reques

[jira] [Created] (KAFKA-2573) Mirror maker system test hangs and eventually fails

2015-09-22 Thread Ashish K Singh (JIRA)
Ashish K Singh created KAFKA-2573: - Summary: Mirror maker system test hangs and eventually fails Key: KAFKA-2573 URL: https://issues.apache.org/jira/browse/KAFKA-2573 Project: Kafka Issue Typ

Re: [jira] [Commented] (KAFKA-2569) Kafka should write its metrics to a Kafka topic

2015-09-22 Thread Prabhjot Bharaj
Hi, I have setup a Ganglia host to get all the stats from my 5 node kafka cluster. I run jmxtrans on Kafka nodes which export to Ganglia. I have exposed all of the available stats to Ganglia and have grouped them as under:- Kafka Cluster Stats metrics (18)Kafka Consumer Stats metrics (208)Kafka C

Re: Mapping a consumer in a consumer group to a partition in a topic

2015-09-22 Thread Sharninder
As far as I know, with a consumer group implementation you cannot pin consumers to partitions. That logic is taken care of by the high level API on its own. > On 23-Sep-2015, at 6:38 AM, Spandan Harithas Karamchedu > wrote: > > Hi, > > We created a topic with 3 partitions and a replication f

[jira] [Commented] (KAFKA-2569) Kafka should write its metrics to a Kafka topic

2015-09-22 Thread James Cheng (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14903904#comment-14903904 ] James Cheng commented on KAFKA-2569: Yes, although I didn't realize that was a rare th

[jira] [Commented] (KAFKA-2569) Kafka should write its metrics to a Kafka topic

2015-09-22 Thread Otis Gospodnetic (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14903876#comment-14903876 ] Otis Gospodnetic commented on KAFKA-2569: - bq. This would allow monitoring of Kafk

[jira] [Comment Edited] (KAFKA-1686) Implement SASL/Kerberos

2015-09-22 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14903836#comment-14903836 ] Sriharsha Chintalapani edited comment on KAFKA-1686 at 9/23/15 2:27 AM:

[jira] [Commented] (KAFKA-1686) Implement SASL/Kerberos

2015-09-22 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14903836#comment-14903836 ] Sriharsha Chintalapani commented on KAFKA-1686: --- [~junrao] need a 2 days wil

[jira] [Commented] (KAFKA-1686) Implement SASL/Kerberos

2015-09-22 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14903804#comment-14903804 ] Jun Rao commented on KAFKA-1686: [~sriharsha], when do you think your updated PR will be r

Mapping a consumer in a consumer group to a partition in a topic

2015-09-22 Thread Spandan Harithas Karamchedu
Hi, We created a topic with 3 partitions and a replication factor of 3. We are able to implement a consumer to get the data from a specific partition in a topic but we are struck in implementing a consumer within a specified consumer group to be mapped to single partition of a topic and get the da

[jira] [Updated] (KAFKA-2572) zk connection instability

2015-09-22 Thread John Firth (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Firth updated KAFKA-2572: -- Description: On two occasions, we've seen our process enter a cycle of: zk session expiry; new session

[jira] [Updated] (KAFKA-2572) zk connection instability

2015-09-22 Thread John Firth (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Firth updated KAFKA-2572: -- Description: On two occasions, we've seen our process enter a cycle of: zk session expiry; new session

[jira] [Commented] (KAFKA-2419) Allow certain Sensors to be garbage collected after inactivity

2015-09-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14903731#comment-14903731 ] ASF GitHub Bot commented on KAFKA-2419: --- GitHub user auradkar opened a pull request:

[GitHub] kafka pull request: KAFKA-2419; Garbage collect unused sensors

2015-09-22 Thread auradkar
GitHub user auradkar opened a pull request: https://github.com/apache/kafka/pull/233 KAFKA-2419; Garbage collect unused sensors As discussed in KAFKA-2419 - I've added a time based sensor retention config to Sensor. Sensors that have not been "recorded" for 'n' seconds are eligible

[GitHub] kafka pull request: Should stop offset backing store in Copycat Wo...

2015-09-22 Thread Ishiihara
Github user Ishiihara closed the pull request at: https://github.com/apache/kafka/pull/232 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is en

[jira] [Updated] (KAFKA-2572) zk connection instability

2015-09-22 Thread John Firth (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Firth updated KAFKA-2572: -- Description: On two occasions, we've seen our process enter a cycle of: zk session expiry; new session

[jira] [Updated] (KAFKA-2572) zk connection instability

2015-09-22 Thread John Firth (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Firth updated KAFKA-2572: -- Summary: zk connection instability (was: zk connection instability, perhaps precipitated by zk client t

[jira] [Updated] (KAFKA-2572) zk connection instability, perhaps precipitated by zk client timeout during rebalance

2015-09-22 Thread John Firth (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Firth updated KAFKA-2572: -- Description: On two occasions, have seen zk session expiry, followed by a timeout during a consumer reb

[GitHub] kafka pull request: Should stop offset backing store in Worker's s...

2015-09-22 Thread Ishiihara
GitHub user Ishiihara opened a pull request: https://github.com/apache/kafka/pull/232 Should stop offset backing store in Worker's stop method You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka bug-fix Alternativ

[jira] [Updated] (KAFKA-2572) zk connection instability, perhaps precipitated by zk client timeout during rebalance

2015-09-22 Thread John Firth (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Firth updated KAFKA-2572: -- Attachment: 091115-full.log.zip > zk connection instability, perhaps precipitated by zk client timeout d

[jira] [Updated] (KAFKA-2572) zk connection instability, perhaps precipitated by zk client timeout during rebalance

2015-09-22 Thread John Firth (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Firth updated KAFKA-2572: -- Description: On two occasions, have seen zk session expiry, followed by a timeout during a consumer reb

[jira] [Updated] (KAFKA-2572) zk connection instability, perhaps precipitated by zk client timeout during rebalance

2015-09-22 Thread John Firth (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Firth updated KAFKA-2572: -- Description: On two occasions, have seen zk session expiry, followed by a timeout during a consumer reb

[jira] [Updated] (KAFKA-2572) zk connection instability, perhaps precipitated by zk client timeout during rebalance

2015-09-22 Thread John Firth (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Firth updated KAFKA-2572: -- Attachment: (was: 091115-full.log.zip) > zk connection instability, perhaps precipitated by zk clien

[jira] [Updated] (KAFKA-2572) zk connection instability, perhaps precipitated by zk client timeout during rebalance

2015-09-22 Thread John Firth (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Firth updated KAFKA-2572: -- Attachment: 091115-full.log.zip 091115-digest.log 090815-full.log

[jira] [Created] (KAFKA-2572) zk connection instability, perhaps precipitated by zk client timeout during rebalance

2015-09-22 Thread John Firth (JIRA)
John Firth created KAFKA-2572: - Summary: zk connection instability, perhaps precipitated by zk client timeout during rebalance Key: KAFKA-2572 URL: https://issues.apache.org/jira/browse/KAFKA-2572 Project

[jira] [Commented] (KAFKA-2571) KafkaLog4jAppender dies while specifying "acks" config

2015-09-22 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14903655#comment-14903655 ] Ashish K Singh commented on KAFKA-2571: --- PR: https://github.com/apache/kafka/pull/23

[jira] [Updated] (KAFKA-2571) KafkaLog4jAppender dies while specifying "acks" config

2015-09-22 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish K Singh updated KAFKA-2571: -- Status: Patch Available (was: Open) > KafkaLog4jAppender dies while specifying "acks" config >

[GitHub] kafka pull request: KafkaLog4jAppender dies while specifying acks ...

2015-09-22 Thread SinghAsDev
GitHub user SinghAsDev opened a pull request: https://github.com/apache/kafka/pull/231 KafkaLog4jAppender dies while specifying acks config You can merge this pull request into a Git repository by running: $ git pull https://github.com/SinghAsDev/kafka KAFKA-2571 Alternativel

[jira] [Updated] (KAFKA-2571) KafkaLog4jAppender dies while specifying "acks" config

2015-09-22 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish K Singh updated KAFKA-2571: -- Description: KafkaLog4jAppender specifies "acks" config's value as int, however KafkaProducer e

[jira] [Created] (KAFKA-2571) KafkaLog4jAppender dies while specifying "acks" config

2015-09-22 Thread Ashish K Singh (JIRA)
Ashish K Singh created KAFKA-2571: - Summary: KafkaLog4jAppender dies while specifying "acks" config Key: KAFKA-2571 URL: https://issues.apache.org/jira/browse/KAFKA-2571 Project: Kafka Issue

[jira] [Created] (KAFKA-2570) New consumer should commit before every rebalance when auto-commit is enabled

2015-09-22 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-2570: -- Summary: New consumer should commit before every rebalance when auto-commit is enabled Key: KAFKA-2570 URL: https://issues.apache.org/jira/browse/KAFKA-2570 Proje

Jenkins build is back to normal : Kafka-trunk #629

2015-09-22 Thread Apache Jenkins Server
See

[jira] [Commented] (KAFKA-2212) KafkaAuthorizer: Add CLI for Acl management.

2015-09-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14903549#comment-14903549 ] ASF GitHub Bot commented on KAFKA-2212: --- GitHub user Parth-Brahmbhatt opened a pull

[jira] [Updated] (KAFKA-2212) KafkaAuthorizer: Add CLI for Acl management.

2015-09-22 Thread Parth Brahmbhatt (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Parth Brahmbhatt updated KAFKA-2212: Status: In Progress (was: Patch Available) > KafkaAuthorizer: Add CLI for Acl management.

[GitHub] kafka pull request: KAFKA-2212: Authorizer CLI implementation.

2015-09-22 Thread Parth-Brahmbhatt
GitHub user Parth-Brahmbhatt opened a pull request: https://github.com/apache/kafka/pull/230 KAFKA-2212: Authorizer CLI implementation. You can merge this pull request into a Git repository by running: $ git pull https://github.com/Parth-Brahmbhatt/kafka KAFKA-2212 Alternativ

[jira] [Commented] (KAFKA-2566) Improve Jenkins set-up

2015-09-22 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14903485#comment-14903485 ] Guozhang Wang commented on KAFKA-2566: -- +1 on the proposal, and also +1 on javadoc to

[jira] [Commented] (KAFKA-2557) Separate RebalanceInProgress from IllegalGeneration Error Code

2015-09-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14903470#comment-14903470 ] ASF GitHub Bot commented on KAFKA-2557: --- Github user asfgit closed the pull request

[jira] [Resolved] (KAFKA-2557) Separate RebalanceInProgress from IllegalGeneration Error Code

2015-09-22 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-2557. -- Resolution: Fixed > Separate RebalanceInProgress from IllegalGeneration Error Code > ---

[GitHub] kafka pull request: KAFKA-2557: separate REBALANCE_IN_PROGRESS and...

2015-09-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/222 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (KAFKA-1387) Kafka getting stuck creating ephemeral node it has already created when two zookeeper sessions are established in a very short period of time

2015-09-22 Thread Flavio Junqueira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14903437#comment-14903437 ] Flavio Junqueira commented on KAFKA-1387: - hey [~guozhang] bq. Will the mixing us

[jira] [Created] (KAFKA-2569) Kafka should write its metrics to a Kafka topic

2015-09-22 Thread James Cheng (JIRA)
James Cheng created KAFKA-2569: -- Summary: Kafka should write its metrics to a Kafka topic Key: KAFKA-2569 URL: https://issues.apache.org/jira/browse/KAFKA-2569 Project: Kafka Issue Type: New Fea

[jira] [Created] (KAFKA-2568) New consumer hangs indefinitely when broker list is misconfigured

2015-09-22 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-2568: -- Summary: New consumer hangs indefinitely when broker list is misconfigured Key: KAFKA-2568 URL: https://issues.apache.org/jira/browse/KAFKA-2568 Project: Kafka

Re: [VOTE] KIP-28 - Add a processor client for stream data processing

2015-09-22 Thread Edward Ribeiro
+1 (non-binding) On Tue, Sep 22, 2015 at 3:37 PM, Ashish Singh wrote: > +1 (non-binding) > > On Tue, Sep 22, 2015 at 10:12 AM, Ismael Juma wrote: > > > +1 (non-binding) > > > > On Tue, Sep 22, 2015 at 6:10 PM, Jason Gustafson > > wrote: > > > > > +1 (non-binding) > > > > > > On Mon, Sep 21, 20

Fwd: Useful metric to check slow ISR catchup

2015-09-22 Thread Prabhjot Bharaj
Hi Dev Folks, Request your expertise on this doubt of mine Thanks, Prabhjot -- Forwarded message -- From: Prabhjot Bharaj Date: Mon, Sep 21, 2015 at 2:59 PM Subject: Re: Useful metric to check slow ISR catchup To: us...@kafka.apache.org Hi, Attaching a screenshot of bytes/sec

Re: Kafka KIP meeting Sep. 22 at 11:00am PST

2015-09-22 Thread Jun Rao
The following are the notes from today's KIP discussion. KIP-31: Need to figure out how to evolve inter.broker.protocol.version with multiple protocol changes within the same release, mostly for people who are deploying from trunk. Bucket will update the wiki. KIP-32/KIP-33: Having both CreateTime

[jira] [Updated] (KAFKA-2387) Improve KafkaConsumer API

2015-09-22 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2387: - Fix Version/s: (was: 0.10.0.0) 0.9.0.0 > Improve KafkaConsumer API > --

[jira] [Commented] (KAFKA-1379) Partition reassignment resets clock for time-based retention

2015-09-22 Thread JIRA
[ https://issues.apache.org/jira/browse/KAFKA-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14903212#comment-14903212 ] Xavier Léauté commented on KAFKA-1379: -- This is a huge issue for us as well, since it

[jira] [Commented] (KAFKA-2409) Have KafkaConsumer.committed() return null when there is no committed offset

2015-09-22 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14903206#comment-14903206 ] Jason Gustafson commented on KAFKA-2409: [~onurkaraman] I would vote to include it

[jira] [Commented] (KAFKA-2409) Have KafkaConsumer.committed() return null when there is no committed offset

2015-09-22 Thread Onur Karaman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14903179#comment-14903179 ] Onur Karaman commented on KAFKA-2409: - [~junrao], [~becket_qin], [~hachikuji] Do we wa

[jira] [Updated] (KAFKA-2409) Have KafkaConsumer.committed() return null when there is no committed offset

2015-09-22 Thread Onur Karaman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Onur Karaman updated KAFKA-2409: Fix Version/s: 0.9.0.0 > Have KafkaConsumer.committed() return null when there is no committed offse

Re: [VOTE] KIP-28 - Add a processor client for stream data processing

2015-09-22 Thread Ashish Singh
+1 (non-binding) On Tue, Sep 22, 2015 at 10:12 AM, Ismael Juma wrote: > +1 (non-binding) > > On Tue, Sep 22, 2015 at 6:10 PM, Jason Gustafson > wrote: > > > +1 (non-binding) > > > > On Mon, Sep 21, 2015 at 11:39 PM, Ewen Cheslack-Postava < > e...@confluent.io > > > > > wrote: > > > > > +1 (non-

[jira] [Commented] (KAFKA-2566) Improve Jenkins set-up

2015-09-22 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14903124#comment-14903124 ] Ismael Juma commented on KAFKA-2566: One open question is whether we want to run run t

[jira] [Commented] (KAFKA-2567) throttle-time shouldn't be NaN

2015-09-22 Thread Aditya Auradkar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14903101#comment-14903101 ] Aditya Auradkar commented on KAFKA-2567: [~junrao] - I'l fix this in my next patch

[jira] [Assigned] (KAFKA-2567) throttle-time shouldn't be NaN

2015-09-22 Thread Aditya Auradkar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Auradkar reassigned KAFKA-2567: -- Assignee: Aditya Auradkar > throttle-time shouldn't be NaN > --

[jira] [Updated] (KAFKA-2567) throttle-time shouldn't be NaN

2015-09-22 Thread Aditya Auradkar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Auradkar updated KAFKA-2567: --- Labels: quotas (was: ) > throttle-time shouldn't be NaN > -- > >

[jira] [Created] (KAFKA-2567) throttle-time shouldn't be NaN

2015-09-22 Thread Jun Rao (JIRA)
Jun Rao created KAFKA-2567: -- Summary: throttle-time shouldn't be NaN Key: KAFKA-2567 URL: https://issues.apache.org/jira/browse/KAFKA-2567 Project: Kafka Issue Type: Bug Reporter: Jun Ra

[jira] [Comment Edited] (KAFKA-1911) Log deletion on stopping replicas should be async

2015-09-22 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14903046#comment-14903046 ] Joel Koshy edited comment on KAFKA-1911 at 9/22/15 5:34 PM: Th

[jira] [Commented] (KAFKA-1911) Log deletion on stopping replicas should be async

2015-09-22 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14903046#comment-14903046 ] Joel Koshy commented on KAFKA-1911: --- The original motivation in this ticket was to avoid

Re: [ANNOUNCE] New Committer Sriharsha Chintalapani

2015-09-22 Thread Joel Koshy
Congrats Sriharsha! Joel On Tue, Sep 22, 2015 at 9:52 AM, Neha Narkhede wrote: > Congrats Sriharsha. Glad to have you on the team. > > On Tue, Sep 22, 2015 at 8:44 AM, wrote: > >> Congrats Sriharsha! >> >> Thanks, >> >> Mayuresh >> >> Sent from my iPhone >> >> > On Sep 22, 2015, at 8:27 AM, Jay

Re: [VOTE] KIP-28 - Add a processor client for stream data processing

2015-09-22 Thread Ismael Juma
+1 (non-binding) On Tue, Sep 22, 2015 at 6:10 PM, Jason Gustafson wrote: > +1 (non-binding) > > On Mon, Sep 21, 2015 at 11:39 PM, Ewen Cheslack-Postava > > wrote: > > > +1 (non-binding) > > > > On Mon, Sep 21, 2015 at 6:57 PM, Jay Kreps wrote: > > > > > +1 > > > > > > -Jay > > > > > > On Mon,

Re: [VOTE] KIP-28 - Add a processor client for stream data processing

2015-09-22 Thread Jason Gustafson
+1 (non-binding) On Mon, Sep 21, 2015 at 11:39 PM, Ewen Cheslack-Postava wrote: > +1 (non-binding) > > On Mon, Sep 21, 2015 at 6:57 PM, Jay Kreps wrote: > > > +1 > > > > -Jay > > > > On Mon, Sep 21, 2015 at 6:28 PM, Guozhang Wang > wrote: > > > > > Hello all, > > > > > > I would like to start

[jira] [Created] (KAFKA-2566) Improve Jenkins set-up

2015-09-22 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-2566: -- Summary: Improve Jenkins set-up Key: KAFKA-2566 URL: https://issues.apache.org/jira/browse/KAFKA-2566 Project: Kafka Issue Type: Task Reporter: Ismae

Re: [ANNOUNCE] New Committer Sriharsha Chintalapani

2015-09-22 Thread Neha Narkhede
Congrats Sriharsha. Glad to have you on the team. On Tue, Sep 22, 2015 at 8:44 AM, wrote: > Congrats Sriharsha! > > Thanks, > > Mayuresh > > Sent from my iPhone > > > On Sep 22, 2015, at 8:27 AM, Jay Kreps wrote: > > > > Congrats Sriharsha! > > > > -Jay > > > >> On Mon, Sep 21, 2015 at 9:10 PM,

[jira] [Updated] (KAFKA-2146) adding partition did not find the correct startIndex

2015-09-22 Thread chenshangan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenshangan updated KAFKA-2146: --- Attachment: (was: KAFKA-2146.2) > adding partition did not find the correct startIndex >

[jira] [Commented] (KAFKA-2561) Optionally support OpenSSL for SSL/TLS

2015-09-22 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14902896#comment-14902896 ] Ismael Juma commented on KAFKA-2561: In order to implement this properly (as opposed t

Re: Offset Commit is not working if multiple consumers try to commit the offset

2015-09-22 Thread Guozhang Wang
Sreeni, Offsets of different partitions are stored in different ZK path, so there should not be any synchronization issue on ZK. Which Kafka version are you running? And did you see any error logs on the consumer that was trying to commit to partition1? Guozhang On Tue, Sep 22, 2015 at 3:49 AM,

[jira] [Updated] (KAFKA-2146) adding partition did not find the correct startIndex

2015-09-22 Thread chenshangan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenshangan updated KAFKA-2146: --- Attachment: KAFKA-2146.2.patch > adding partition did not find the correct startIndex > -

[jira] [Updated] (KAFKA-2146) adding partition did not find the correct startIndex

2015-09-22 Thread chenshangan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenshangan updated KAFKA-2146: --- Attachment: KAFKA-2146.2 updated patch. > adding partition did not find the correct startIndex > ---

[jira] [Commented] (KAFKA-1566) Kafka environment configuration (kafka-env.sh)

2015-09-22 Thread Kevin Risden (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14902900#comment-14902900 ] Kevin Risden commented on KAFKA-1566: - Since this patch hasn't been committed it shoul

[GitHub] kafka pull request: Update DelayedFetch.scala

2015-09-22 Thread arcz
Github user arcz closed the pull request at: https://github.com/apache/kafka/pull/44 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled

Re: [ANNOUNCE] New Committer Sriharsha Chintalapani

2015-09-22 Thread gharatmayuresh15
Congrats Sriharsha! Thanks, Mayuresh Sent from my iPhone > On Sep 22, 2015, at 8:27 AM, Jay Kreps wrote: > > Congrats Sriharsha! > > -Jay > >> On Mon, Sep 21, 2015 at 9:10 PM, Jun Rao wrote: >> >> I am pleased to announce that the Apache Kafka PMC has voted to >> invite Sriharsha Chintala

Re: [ANNOUNCE] New Committer Sriharsha Chintalapani

2015-09-22 Thread Edward Ribeiro
Congrats, Harsha! On Tue, Sep 22, 2015 at 12:27 PM, Jay Kreps wrote: > Congrats Sriharsha! > > -Jay > > On Mon, Sep 21, 2015 at 9:10 PM, Jun Rao wrote: > > > I am pleased to announce that the Apache Kafka PMC has voted to > > invite Sriharsha Chintalapani as a committer and Sriharsha has accept

[jira] [Commented] (KAFKA-2236) offset request reply racing with segment rolling

2015-09-22 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14902803#comment-14902803 ] Robert Metzger commented on KAFKA-2236: --- I've seen this error as well in the integra

Re: [ANNOUNCE] New Committer Sriharsha Chintalapani

2015-09-22 Thread Jay Kreps
Congrats Sriharsha! -Jay On Mon, Sep 21, 2015 at 9:10 PM, Jun Rao wrote: > I am pleased to announce that the Apache Kafka PMC has voted to > invite Sriharsha Chintalapani as a committer and Sriharsha has accepted. > > Sriharsha has contributed numerous patches to Kafka. The most significant > o

Re: [ANNOUNCE] New Committer Sriharsha Chintalapani

2015-09-22 Thread Gwen Shapira
Congratulations Harsha. Very well deserved. Gwen On Sep 21, 2015 9:10 PM, "Jun Rao" wrote: > I am pleased to announce that the Apache Kafka PMC has voted to > invite Sriharsha Chintalapani as a committer and Sriharsha has accepted. > > Sriharsha has contributed numerous patches to Kafka. The mos

Re: [ANNOUNCE] New Committer Sriharsha Chintalapani

2015-09-22 Thread Grant Henke
Congratulations Harsha! On Tue, Sep 22, 2015 at 8:30 AM, Sriharsha Chintalapani < harsh...@fastmail.fm> wrote: > Thanks Everyone :). > > Thanks, > Harsha > > > On September 22, 2015 at 4:17:05 AM, Ismael Juma (ism...@juma.me.uk) > wrote: > > Congratulations Harsha! > > Ismael > > On Tue, Sep 22,

Re: [ANNOUNCE] New Committer Sriharsha Chintalapani

2015-09-22 Thread Sriharsha Chintalapani
Thanks Everyone :). Thanks, Harsha On September 22, 2015 at 4:17:05 AM, Ismael Juma (ism...@juma.me.uk) wrote: Congratulations Harsha! Ismael On Tue, Sep 22, 2015 at 5:10 AM, Jun Rao wrote: > I am pleased to announce that the Apache Kafka PMC has voted to > invite Sriharsha Chintalapani

[jira] [Updated] (KAFKA-2203) Get gradle build to work with Java 8

2015-09-22 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-2203: --- Reviewer: Jun Rao Fix Version/s: (was: 0.8.1.2) 0.9.0.0 Jun, maybe you

Re: [ANNOUNCE] New Committer Sriharsha Chintalapani

2015-09-22 Thread Ismael Juma
Congratulations Harsha! Ismael On Tue, Sep 22, 2015 at 5:10 AM, Jun Rao wrote: > I am pleased to announce that the Apache Kafka PMC has voted to > invite Sriharsha Chintalapani as a committer and Sriharsha has accepted. > > Sriharsha has contributed numerous patches to Kafka. The most significa

Offset Commit is not working if multiple consumers try to commit the offset

2015-09-22 Thread Sreenivasulu Nallapati
Hello, We are seeing some strange behaviour with commitOffsets() method of kafka.javaapi.consumer.ConsumerConnector. We committing the offsets to zookeeper at the end of the consumer batch. We are running multiple consumers for the same topic. Test details: 1. Created a topic with three partition

[jira] [Commented] (KAFKA-2565) Offset Commit is not working if multiple consumers try to commit the offset

2015-09-22 Thread Sreenivasulu Nallapati (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14902366#comment-14902366 ] Sreenivasulu Nallapati commented on KAFKA-2565: --- Earliest Offset after all c

[jira] [Created] (KAFKA-2565) Offset Commit is not working if multiple consumers try to commit the offset

2015-09-22 Thread Sreenivasulu Nallapati (JIRA)
Sreenivasulu Nallapati created KAFKA-2565: - Summary: Offset Commit is not working if multiple consumers try to commit the offset Key: KAFKA-2565 URL: https://issues.apache.org/jira/browse/KAFKA-2565

Re: [DISCUSS] KIP-31 - Message format change proposal

2015-09-22 Thread Jiangjie Qin
Thanks for the explanation, Jay. Agreed. We have to keep the offset to be the offset of last inner message. Jiangjie (Becket) Qin On Mon, Sep 21, 2015 at 6:21 PM, Jay Kreps wrote: > For (3) I don't think we can change the offset in the outer message from > what it is today as it is relied upon

Re: [DISCUSS] KIP-31 - Message format change proposal

2015-09-22 Thread Jiangjie Qin
Hi Jun, Thanks a lot for the comments. Please see the inline reply. I will update the KIP page accordingly. On Mon, Sep 21, 2015 at 5:17 PM, Jun Rao wrote: > Jiangjie, > > Thanks for the writeup. A few comments below. > > 1. We will need to be a bit careful with fetch requests from the follower