Re: [ANNOUNCE] New Committer: Manikumar Reddy

Congrats Mani. -Ray On 10/17/18 10:19 AM, Harsha wrote: Congrats Mani!! Very well deserved. --Harsha On Tue, Oct 16, 2018, at 5:20 PM, Attila Sasvari wrote: Congratulations Manikumar! Keep up the good work. On Tue, Oct 16, 2018 at 12:30 AM Jungtaek Lim wrote: Congrats Mani! On Tue, 16 Oct

Re: [ANNOUNCE] New committer: Colin McCabe

Nice job Colin! -Ray On 9/25/18 1:58 AM, Stanislav Kozlovski wrote: Congrats Colin! On Tue, Sep 25, 2018 at 9:51 AM Edoardo Comar wrote: Congratulations Colin ! -- Edoardo Comar IBM Event Streams IBM UK Ltd, Hursley Park, SO21 2JN From:

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

Congrats Dong! -Ray On 8/21/18 9:33 AM, Becket Qin wrote: Congrats, Dong! On Aug 21, 2018, at 11:03 PM, Eno Thereska wrote: Congrats Dong! Eno On Tue, Aug 21, 2018 at 7:05 AM, Ted Yu wrote: Congratulation Dong! On Tue, Aug 21, 2018 at 1:59 AM Viktor Somogyi-Vass < viktorsomo...@gmail.

Re: [DISCUSS] Applying scalafmt to core code

less invasive and hence preferable. Guozhang On Mon, Jul 30, 2018 at 1:20 PM, Ray Chiang wrote: I had started on KAFKA-2423 (was Scalastyle, now Expand scalafmt to core). As part of the cleanup, applying the "gradlew spotlessApply" command ended up affecting too many (435 out

Re: [VOTE] KIP-346 - Improve LogCleaner behavior on error

+1 (non-binding) -Ray On 8/7/18 9:26 AM, Ted Yu wrote: +1 On Tue, Aug 7, 2018 at 5:25 AM Thomas Becker wrote: +1 (non-binding) We've hit issues with the log cleaner in the past, and this would be a great improvement. On Tue, 2018-08-07 at 12:19 +0100, Stanislav Kozlovski wrote: Hey everyb

Re: [DISCUSS] KIP-346 - Limit blast radius of log compaction failure

, maybe it should be `max.uncleanable.partitions.per.logdir` ? On Thu, Aug 2, 2018 at 7:32 PM Ray Chiang wrote: One more thing occurred to me. Should the configuration property be named "max.uncleanable.partitions.per.disk" instead? -Ray On 8/1/18 9:11 AM, Stanislav Kozlovski wrote: Yes, good

[jira] [Resolved] (KAFKA-5153) KAFKA Cluster : 0.10.2.0 : Servers Getting disconnected : Service Impacting

[ https://issues.apache.org/jira/browse/KAFKA-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang resolved KAFKA-5153. --- Resolution: Information Provided Fix Version/s: 0.11.0.1 Upgrading fixed the problem based on

[jira] [Created] (KAFKA-7244) Add note about memory map kernel limits to documentation

Ray Chiang created KAFKA-7244: - Summary: Add note about memory map kernel limits to documentation Key: KAFKA-7244 URL: https://issues.apache.org/jira/browse/KAFKA-7244 Project: Kafka Issue Type

[jira] [Resolved] (KAFKA-3577) Partial cluster breakdown

[ https://issues.apache.org/jira/browse/KAFKA-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang resolved KAFKA-3577. --- Resolution: Duplicate > Partial cluster breakd

[jira] [Resolved] (KAFKA-3094) Kafka process 100% CPU when no message in topic

[ https://issues.apache.org/jira/browse/KAFKA-3094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang resolved KAFKA-3094. --- Resolution: Cannot Reproduce > Kafka process 100% CPU when no message in to

[jira] [Resolved] (KAFKA-4101) java.lang.IllegalStateException in org.apache.kafka.common.network.Selector.channelOrFail

[ https://issues.apache.org/jira/browse/KAFKA-4101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang resolved KAFKA-4101. --- Resolution: Duplicate > java.lang.IllegalStateException

Re: Discussion: New components in JIRA?

Great.  Thanks! -Ray On 8/2/18 12:28 PM, Guozhang Wang wrote: Hello Ray, I've added these two components. People should be able to use them creating / updating the JIRAs now. Guozhang On Wed, Aug 1, 2018 at 12:56 PM, Ray Chiang wrote: I haven't seen any comments. Let me kn

Re: [DISCUSS] KIP-346 - Limit blast radius of log compaction failure

uss. Best, Stanislav On Fri, Jul 27, 2018 at 11:05 PM Stanislav Kozlovski < stanis...@confluent.io> wrote: Hey, Ray Thanks for pointing that out, it's fixed now Best, Stanislav On Fri, Jul 27, 2018 at 9:43 PM Ray Chiang wrote: Thanks. Can you fix the link in the "KIPs under dis

Re: [DISCUSS] KIP-346 - Limit blast radius of log compaction failure

discuss. Best, Stanislav On Fri, Jul 27, 2018 at 11:05 PM Stanislav Kozlovski < stanis...@confluent.io> wrote: Hey, Ray Thanks for pointing that out, it's fixed now Best, Stanislav On Fri, Jul 27, 2018 at 9:43 PM Ray Chiang wrote: Thanks. Can you fix the link in the "KIPs unde

Re: Discussion: New components in JIRA?

d add them. Guozhang On Thu, Jul 26, 2018 at 1:50 PM, Ray Chiang wrote: Thanks Guozhang. I'm good with the way the documentation is now. Is there any other procedure to follow to get "logging" and "mirrormaker" added as components or can we just request a JIRA

Re: [DISCUSS] KIP-346 - Limit blast radius of log compaction failure

Stanislav Kozlovski wrote: Hey, Ray Thanks for pointing that out, it's fixed now Best, Stanislav On Fri, Jul 27, 2018 at 9:43 PM Ray Chiang wrote: Thanks. Can you fix the link in the "KIPs under discussion" table on the main KIP landing page < https://cwiki.apache.org/c

[DISCUSS] Applying scalafmt to core code

I had started on KAFKA-2423 (was Scalastyle, now Expand scalafmt to core).  As part of the cleanup, applying the "gradlew spotlessApply" command ended up affecting too many (435 out of 439) files.  Since this will affect every file, this sort of change does risk polluting the git logs. So, I'

Re: [DISCUSS] KIP-346 - Limit blast radius of log compaction failure

Thanks.  Can you fix the link in the "KIPs under discussion" table on the main KIP landing page ?  I tried, but the Wiki won't let me. -Ray On 7/26/18 2:01 PM, Stanislav Kozlovski wrote: Hey guys, @Colin - good

Re: Discussion: New components in JIRA?

e: I've just updated the web docs on http://kafka.apache.org/contributing accordingly. On Mon, Jul 23, 2018 at 3:30 PM, khaireddine Rezgui < khaireddine...@gmail.com> wrote: Good job Ray for the wiki, it's clear enough. Le 23 juil. 2018 10:17 PM, "Ray Chiang" a écrit :

Re: [DISCUSS] KIP-346 - Limit blast radius of log compaction failure

Thanks for creating this KIP Stanislav.  My observations: 1) I agree with Colin that threads automatically re-launching threads generally isn't a great idea.  Metrics and/or monitoring threads are generally much safer.  And there's always the issue of what happens if the re-launcher dies? 2)

Re: Discussion: New components in JIRA?

"Project information" page. -Ray On 7/23/18 11:28 AM, Ray Chiang wrote: Good point.  I'll look into adding some JIRA guidelines to the documentation/wiki. -Ray On 7/22/18 10:23 AM, Guozhang Wang wrote: Hello Ray, Thanks for brining this up. I'm generally +1 on the first two,

Re: Discussion: New components in JIRA?

does not really have a tradition to manage JIRA reports per-component, as the goal is to not "separate" the project into silos but recommending everyone to get hands on every aspect of the project. Guozhang On Fri, Jul 20, 2018 at 2:44 PM, Ray Chiang wrote: I've been doing a l

[jira] [Resolved] (KAFKA-6918) Kafka server fails to start with IBM JAVA

[ https://issues.apache.org/jira/browse/KAFKA-6918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang resolved KAFKA-6918. --- Resolution: Fixed Fix Version/s: 1.1.1 > Kafka server fails to start with IBM J

Discussion: New components in JIRA?

I've been doing a little bit of component cleanup in JIRA.  What do people think of adding one or more of the following components? - logging: For any consumer/producer/broker logging (i.e. log4j). This should help disambiguate from the "log" component (i.e. Kafka messages). - mirrormaker: Th

Re: [DISCUSS] KIP-253: Support in-order message delivery with partition expansion

My notes from today's meeting.  Sorry if I got anyone's name wrong. Plus I missed a few moments with noise at home and/or dropped video. -Ray = KIP-253 Discussion - Currently, adding partitions can cause keys to be read out-of-order.   This KIP is trying to preserve the key ordering when

Re: [DISCUSS] KIP-253: Support in-order message delivery with partition expansion

Hi Jun, please add me to the invitation as well.  If this is happening near Palo Alto, let me know if I can join in person. Thanks. -Ray On 4/4/18 1:34 PM, Jun Rao wrote: Hi, Jan, Dong, John, Guozhang, Perhaps it will be useful to have a KIP meeting to discuss this together as a group. Would

Re: Wiki edit permission request

Got it.  Thanks. -Ray On 4/6/18 12:03 PM, Matthias J. Sax wrote: Please keep it on the mailing list. Wiki permissions granted. -Matthias On 4/6/18 11:58 AM, Ray Chiang wrote: ID is rchiang. -Ray On 4/6/18 11:23 AM, Matthias J. Sax wrote: What is your wiki ID? -Matthias On 4/6/18 10

Wiki edit permission request

As best as I can tell, I currently don't have edit access. -Ray

Question about developer documentation

There is some documentation for developers at:   http://kafka.apache.org/project There's also another set of links at the bottom of this wiki page:   https://cwiki.apache.org/confluence/display/KAFKA/Index There's some minor duplication of information, but it's definitely not quite presented

Re: Eclipse or Intellij workspace setup

Here's what I did recently with OS X/IntelliJ.  I hadn't quite fleshed out all the instructions to put up an updated Wiki version yet: - Use Homebrew to install gradle/scala@2.11 (use --with-docs option)/sbt - git clone Kafka - Run gradle/gradlew commands as documented in https://cwiki.apache.o