[jira] [Assigned] (KAFKA-2544) Replication tools wiki page needs to be updated

[ https://issues.apache.org/jira/browse/KAFKA-2544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jin xing reassigned KAFKA-2544: --- Assignee: jin xing > Replication tools wiki page needs to be updated > --

[jira] [Assigned] (KAFKA-2551) Unclean leader election docs outdated

[ https://issues.apache.org/jira/browse/KAFKA-2551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jin xing reassigned KAFKA-2551: --- Assignee: jin xing > Unclean leader election docs outdated > - >

[jira] [Updated] (KAFKA-2544) Replication tools wiki page needs to be updated

[ https://issues.apache.org/jira/browse/KAFKA-2544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jin xing updated KAFKA-2544: Assignee: (was: jin xing) > Replication tools wiki page needs to be updated > --

[jira] [Commented] (KAFKA-1451) Broker stuck due to leader election race

[ https://issues.apache.org/jira/browse/KAFKA-1451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14791763#comment-14791763 ] dude commented on KAFKA-1451: - Also occurred in 3 node kafka 0.8.2.1 cluster > Broker stuck d

[jira] [Commented] (KAFKA-2120) Add a request timeout to NetworkClient

[ https://issues.apache.org/jira/browse/KAFKA-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14803215#comment-14803215 ] Mayuresh Gharat commented on KAFKA-2120: I am not sure if the failures are related

[jira] [Comment Edited] (KAFKA-2120) Add a request timeout to NetworkClient

[ https://issues.apache.org/jira/browse/KAFKA-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14803215#comment-14803215 ] Mayuresh Gharat edited comment on KAFKA-2120 at 9/17/15 5:01 PM: ---

[jira] [Commented] (KAFKA-2120) Add a request timeout to NetworkClient

[ https://issues.apache.org/jira/browse/KAFKA-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14803247#comment-14803247 ] Ismael Juma commented on KAFKA-2120: [~mgharat], are you getting consistent failures o

[jira] [Commented] (KAFKA-2120) Add a request timeout to NetworkClient

[ https://issues.apache.org/jira/browse/KAFKA-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14803251#comment-14803251 ] Joel Koshy commented on KAFKA-2120: --- [~mgharat] yes I'm seeing the same thing. i.e., I r

[jira] [Commented] (KAFKA-2120) Add a request timeout to NetworkClient

[ https://issues.apache.org/jira/browse/KAFKA-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14803252#comment-14803252 ] Ismael Juma commented on KAFKA-2120: Also, it doesn't look like there's any significan

[jira] [Commented] (KAFKA-2120) Add a request timeout to NetworkClient

[ https://issues.apache.org/jira/browse/KAFKA-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14803291#comment-14803291 ] Joel Koshy commented on KAFKA-2120: --- I see test failures on b7d4043d8da1d296519faf321e9f

[jira] [Commented] (KAFKA-2120) Add a request timeout to NetworkClient

[ https://issues.apache.org/jira/browse/KAFKA-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14803304#comment-14803304 ] Mayuresh Gharat commented on KAFKA-2120: [~ijuma] failures are consistent. I ran i

[jira] [Commented] (KAFKA-2120) Add a request timeout to NetworkClient

[ https://issues.apache.org/jira/browse/KAFKA-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14803310#comment-14803310 ] Ismael Juma commented on KAFKA-2120: Tests pass for me when I run b658e25207174578c26e

[jira] [Comment Edited] (KAFKA-2120) Add a request timeout to NetworkClient

[ https://issues.apache.org/jira/browse/KAFKA-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14803310#comment-14803310 ] Ismael Juma edited comment on KAFKA-2120 at 9/17/15 6:00 PM: -

[jira] [Commented] (KAFKA-2120) Add a request timeout to NetworkClient

[ https://issues.apache.org/jira/browse/KAFKA-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14803312#comment-14803312 ] Ismael Juma commented on KAFKA-2120: Also, there are already failures in the system te

Re: Unreasonably high CPU from Kafka (0.8.2.1)

Sending this to the dev list since the Kafka dev team might have more inputs on this one. Can someone please take a look at the issue noted below and whether the suggested change makes sense? -Jaikiran On Tuesday 15 September 2015 12:03 AM, Jaikiran Pai wrote: We have been using Kafka for a whi

[jira] [Commented] (KAFKA-2120) Add a request timeout to NetworkClient

[ https://issues.apache.org/jira/browse/KAFKA-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14803338#comment-14803338 ] Mayuresh Gharat commented on KAFKA-2120: "Looking at the code, I noticed that we a

[jira] [Comment Edited] (KAFKA-2120) Add a request timeout to NetworkClient

[ https://issues.apache.org/jira/browse/KAFKA-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14803338#comment-14803338 ] Mayuresh Gharat edited comment on KAFKA-2120 at 9/17/15 6:18 PM: ---

[jira] [Commented] (KAFKA-2120) Add a request timeout to NetworkClient

[ https://issues.apache.org/jira/browse/KAFKA-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14803415#comment-14803415 ] Ismael Juma commented on KAFKA-2120: [~mgharat], it is hard to tell for sure given the

[jira] [Commented] (KAFKA-2452) enable new consumer in mirror maker

[ https://issues.apache.org/jira/browse/KAFKA-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14804276#comment-14804276 ] venkata yerubandi commented on KAFKA-2452: -- Any update on this ? Looks like the d

Re: 0.9.0.0 remaining jiras

Hey Jun, Should we also include https://issues.apache.org/jira/browse/KAFKA-2390 in 0.9.0? Becket told me that this is one of those patches ( https://issues.apache.org/jira/browse/KAFKA-2387) needed for new consumer API. Thanks, Dong On Tue, Sep 15, 2015 at 11:01 PM, Jason Rosenberg wrote: > I

Re: [DISCUSS] KIP-31 - Message format change proposal

Hi folks, Thanks a lot for the feedback on KIP-31 - move to use relative offset. (Not including timestamp and index discussion). I updated the migration plan section as we discussed on KIP hangout. I think it is the only concern raised so far. Please let me know if there are further comments abou

[jira] [Commented] (KAFKA-2552) Certain admin commands such as partition assignment fail on large clusters

[ https://issues.apache.org/jira/browse/KAFKA-2552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14804560#comment-14804560 ] Abhishek Nigam commented on KAFKA-2552: --- Essentially a generic approach to this whic

[jira] [Commented] (KAFKA-2078) Getting Selector [WARN] Error in I/O with host java.io.EOFException

[ https://issues.apache.org/jira/browse/KAFKA-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14804569#comment-14804569 ] Tom Waterhouse commented on KAFKA-2078: --- I have seen this message numerous times. I

[jira] [Commented] (KAFKA-2120) Add a request timeout to NetworkClient

[ https://issues.apache.org/jira/browse/KAFKA-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14804570#comment-14804570 ] Joel Koshy commented on KAFKA-2120: --- Actually some of the confusion on my side is becaus

[jira] [Commented] (KAFKA-2552) Certain admin commands such as partition assignment fail on large clusters

[ https://issues.apache.org/jira/browse/KAFKA-2552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14804600#comment-14804600 ] Joel Koshy commented on KAFKA-2552: --- Reported in KAFKA-1599 as well? > Certain admin co

[jira] [Created] (KAFKA-2555) Infinite recursive function call occurs when ConsumerRebalanceCallback.onPartitionRevoked() calls commitSync()

Jiangjie Qin created KAFKA-2555: --- Summary: Infinite recursive function call occurs when ConsumerRebalanceCallback.onPartitionRevoked() calls commitSync() Key: KAFKA-2555 URL: https://issues.apache.org/jira/browse/KA

[jira] [Assigned] (KAFKA-2555) Infinite recursive function call occurs when ConsumerRebalanceCallback.onPartitionRevoked() calls commitSync()

[ https://issues.apache.org/jira/browse/KAFKA-2555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin reassigned KAFKA-2555: --- Assignee: Jiangjie Qin > Infinite recursive function call occurs when > ConsumerRebalanceCal

Jenkins build is back to normal : Kafka-trunk #624

See

Re: Unreasonably high CPU from Kafka (0.8.2.1)

The selector is probably not the issue. If there is no incoming traffic, selector.select(300) won't return until after 300ms. Thanks, Jun On Thu, Sep 17, 2015 at 1:13 PM, Jaikiran Pai wrote: > Sending this to the dev list since the Kafka dev team might have more > inputs on this one. Can someo

Add To Contributor List

Hi. I have checked out the code and I am interested in contributing.I saw some scope of re-factoring test cases.Gradually I will get an insight of the code. Can you please add me to the contributor list..? -- *Dheeraj Sharma*

Re: Unreasonably high CPU from Kafka (0.8.2.1)

That's a good point, I missed that. Is there any other way to track down why it would consume this high CPU when it's idle? I can send the thread dumps (taken at intervals of a few seconds of each other), but each of them has not much interesting (IMO) than these specific repeated stacktraces.

Re: Unreasonably high CPU from Kafka (0.8.2.1)

If you are on Linux, you can use the following approach. 1) Get the pid 2) Find the largest consumer of CPU via: ps -L -p 3) Convert the LWP column to hex and then look for that value in the thread dump on the "nid=0x.." field of each thread. Cheers! Brock On Thu, Sep 17, 2015 at 3:58 PM, Jai

Re: Unreasonably high CPU from Kafka (0.8.2.1)

You can enable profiling in tools like jvisualvm and see which methods other select() show up high. Thanks, Jun On Thu, Sep 17, 2015 at 5:58 PM, Jaikiran Pai wrote: > That's a good point, I missed that. Is there any other way to track down > why it would consume this high CPU when it's idle? I

Re: Add To Contributor List

Hi, First, if you have work you plan on carrying out, can you open a JIRA for it? This way we can track the issue :) Second, what's your JIRA username? We need this to add you to the contributor list. Gwen On Thu, Sep 17, 2015 at 6:22 AM, Dheeraj Sharma wrote: > Hi. > > I have checked out the

Re: Unreasonably high CPU from Kafka (0.8.2.1)

Thanks Brock for that tip! I ran the ps -L -p command and this is trimmed version of it: PID LWP TTY TIME CMD 19524 19550 ?01:11:38 java 19524 19551 ?01:33:55 java 19524 19552 ?01:38:32 java 19524 19557 ?01:30:12 java 19524 is the process id and these

[jira] [Commented] (KAFKA-2552) Certain admin commands such as partition assignment fail on large clusters

[ https://issues.apache.org/jira/browse/KAFKA-2552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14804710#comment-14804710 ] Dong Lin commented on KAFKA-2552: - Yeah I believe this duplicates KAFKA-2552. > Certain a

[jira] [Commented] (KAFKA-2452) enable new consumer in mirror maker

[ https://issues.apache.org/jira/browse/KAFKA-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14804740#comment-14804740 ] Jiangjie Qin commented on KAFKA-2452: - [~raoyvn] I am working on this. Found some issu

[jira] [Commented] (KAFKA-1215) Rack-Aware replica assignment option

[ https://issues.apache.org/jira/browse/KAFKA-1215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14804835#comment-14804835 ] Joel Koshy commented on KAFKA-1215: --- [~allenxwang] you should have access now. > Rack-A

[jira] [Commented] (KAFKA-2419) Allow certain Sensors to be garbage collected after inactivity

[ https://issues.apache.org/jira/browse/KAFKA-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14804893#comment-14804893 ] Joel Koshy commented on KAFKA-2419: --- Re: the options in https://issues.apache.org/jira/