Re: Permission to create a KIP
I just registered a new account with xiangzhang1...@gmail.com and my username is `iamabug`, not sure which one is id. Guozhang Wang 于2020年4月13日周一 下午1:51写道: > The id is for the apache's wiki space: > https://cwiki.apache.org/confluence/display/KAFKA > > If you already had one before, that will work; if not you can create one > under that space. > > > Guozhang > > On Sun, Apr 12, 2020 at 10:49 PM 张祥 wrote: > > > I am not sure that I have one, how can I find out this and how can I > create > > one ? Thanks. > > > > Guozhang Wang 于2020年4月13日周一 下午1:42写道: > > > > > Hello Xiang, > > > > > > What's your apache ID? > > > > > > > > > Guozhang > > > > > > On Sun, Apr 12, 2020 at 6:08 PM 张祥 wrote: > > > > > > > Hi, I am working on a ticket which requires modifying public APIs > that > > > are > > > > visible to users. Could somebody grant the KIP permission to me ? > > Thanks. > > > > > > > > > > > > > -- > > > -- Guozhang > > > > > > > > -- > -- Guozhang >
Re: Permission to create a KIP
The id is for the apache's wiki space: https://cwiki.apache.org/confluence/display/KAFKA If you already had one before, that will work; if not you can create one under that space. Guozhang On Sun, Apr 12, 2020 at 10:49 PM 张祥 wrote: > I am not sure that I have one, how can I find out this and how can I create > one ? Thanks. > > Guozhang Wang 于2020年4月13日周一 下午1:42写道: > > > Hello Xiang, > > > > What's your apache ID? > > > > > > Guozhang > > > > On Sun, Apr 12, 2020 at 6:08 PM 张祥 wrote: > > > > > Hi, I am working on a ticket which requires modifying public APIs that > > are > > > visible to users. Could somebody grant the KIP permission to me ? > Thanks. > > > > > > > > > -- > > -- Guozhang > > > -- -- Guozhang
Re: Permission to create a KIP
I am not sure that I have one, how can I find out this and how can I create one ? Thanks. Guozhang Wang 于2020年4月13日周一 下午1:42写道: > Hello Xiang, > > What's your apache ID? > > > Guozhang > > On Sun, Apr 12, 2020 at 6:08 PM 张祥 wrote: > > > Hi, I am working on a ticket which requires modifying public APIs that > are > > visible to users. Could somebody grant the KIP permission to me ? Thanks. > > > > > -- > -- Guozhang >
Re: Permission to create a KIP
Hello Xiang, What's your apache ID? Guozhang On Sun, Apr 12, 2020 at 6:08 PM 张祥 wrote: > Hi, I am working on a ticket which requires modifying public APIs that are > visible to users. Could somebody grant the KIP permission to me ? Thanks. > -- -- Guozhang
MessagesOutPerSec JMX metric
Hi, I am wondering why there isn't a metric called MessagesOutPerSec in Kafka JMX metrics to describe how many messages are consumed by clients and fetched by followers per second since there are already metrics like MessagesInPerSec, BytesInPerSec and BytesOutPerSec. Thanks.
Permission to create a KIP
Hi, I am working on a ticket which requires modifying public APIs that are visible to users. Could somebody grant the KIP permission to me ? Thanks.
回复:回复:回复:回复:回复:回复:回复:[Vote] KIP-571: Add option to force remove members in StreamsResetter
Thanks , John and Guochang! -- 发件人:Guozhang Wang 发送时间:2020年4月11日(星期六) 03:07 收件人:dev 主 题:Re: 回复:回复:回复:回复:回复:回复:[Vote] KIP-571: Add option to force remove members in StreamsResetter Thanks Feyman, I've looked at the update that you incorporated from Matthias and that LGTM too. I'm still +1 :) Guozhang On Fri, Apr 10, 2020 at 11:18 AM John Roesler wrote: > Hey Feyman, > > Just to remove any ambiguity, I've been casually following the discussion, > I've just looked at the KIP document again, and I'm still +1 (binding). > > Thanks, > -John > > On Fri, Apr 10, 2020, at 01:44, feyman2009 wrote: > > Hi, all > > KIP-571 has already collected 4 bind +1 (John, Guochang, Bill, > > Matthias) and 3 non-binding +1(Boyang, Sophie), I will mark it as > > approved and create a PR shortly. > > Thanks! > > > > Feyman > > -- > > 发件人:feyman2009 > > 发送时间:2020年4月8日(星期三) 14:21 > > 收件人:dev ; Boyang Chen > > 主 题:回复:回复:回复:回复:回复:回复:[Vote] KIP-571: Add option to force remove > > members in StreamsResetter > > > > Hi Boyang, > > Thanks for reminding me of that! > > I'm not sure about the convention, I thought it would need to > > re-collect votes if the KIP has changed~ > > Let's leave the vote thread here for 2 days, if no objection, I > > will take it as approved and update the PR accordingly. > > > > Thanks! > > Feyman > > > > > > > > -- > > 发件人:Boyang Chen > > 发送时间:2020年4月8日(星期三) 12:42 > > 收件人:dev ; feyman2009 > > 主 题:Re: 回复:回复:回复:回复:回复:[Vote] KIP-571: Add option to force remove > > members in StreamsResetter > > > > You should already get enough votes if I'm counting correctly > > (Guozhang, John, Matthias) > > On Tue, Apr 7, 2020 at 6:59 PM feyman2009 > > wrote: > > Hi, Boyang > > I think Matthias's proposal makes sense, but we can use the admin > > tool for this scenario as Boyang mentioned or follow up later, so I > > prefer to keep this KIP unchanged to minimize the scope. > > Calling for vote ~ > > > > Thanks! > > Feyman > > > > -- > > 发件人:Boyang Chen > > 发送时间:2020年4月8日(星期三) 02:15 > > 收件人:dev > > 主 题:Re: 回复:回复:回复:回复:回复:[Vote] KIP-571: Add option to force remove > > members in StreamsResetter > > > > Hey Feyman, > > > > I think Matthias' suggestion is optional, and we could just use admin > tool > > to remove single static members as well. > > > > Boyang > > > > On Tue, Apr 7, 2020 at 11:00 AM Matthias J. Sax > wrote: > > > > > > Would you mind to elaborate why we still need that > > > > > > Sure. > > > > > > For static memership, the session timeout it usually set quite high. > > > This make scaling in an application tricky: if you shut down one > > > instance, no rebalance would happen until `session.timeout.ms` hits. > > > This is specific to Kafka Streams, because when a Kafka Stream > > client is > > > closed, it does _not_ send a `LeaveGroupRequest`. Hence, the > > > corresponding partitions would not be processed for a long time and > > > thus, fall back. > > > > > > Given that each instance will have a unique `instance.id` provided by > > > the user, we could allow users to remove the instance they want to > > > decommission from the consumer group without the need to wait for > > > `session.timeout.ms`. > > > > > > Hence, it's not an application reset scenario for which one wants to > > > remove all members, but a scaling-in scenario. For dynamic > > membership, > > > this issue usually does not occur because the `session.timeout.ms` is > > > set to a fairly low value and a rebalance would happen quickly after > > an > > > instance is decommissioned. > > > > > > Does this make sense? > > > > > > As said before, we may or may not include this in this KIP. It's up > > to > > > you if you want to address it or not. > > > > > > > > > -Matthias > > > > > > > > > > > > On 4/7/20 7:12 AM, feyman2009 wrote: > > > > Hi, Matthias > > > > Thanks a lot! > > > > So you do not plan so support removing a _single static_ > > member via > > > `StreamsResetter`? > > > > => > > > > Would you mind to elaborate why we still need that if we > > are > > > able to batch remove active members with adminClient? > > > > > > > > Thanks! > > > > > > > > Feyman > > > > -- > > > > 发件人:Matthias J. Sax > > > > 发送时间:2020年4月7日(星期二) 08:25 > > > > 收件人:dev > > > > 主 题:Re: 回复:回复:回复:回复:[Vote] KIP-571: Add option to force remove > > members > > > in StreamsResetter > > > > > > > > Overall LGTM. > > > > > > > > +1 (binding) > > > > > > > > So you do not plan so support removing a _single static_ member via > > > > `StreamsResetter`? We can of course still add this as a follow up > > but it > > > > might be
[jira] [Created] (KAFKA-9855) dont waste memory allocating Struct and values objects for Schemas with no fields
radai rosenblatt created KAFKA-9855: --- Summary: dont waste memory allocating Struct and values objects for Schemas with no fields Key: KAFKA-9855 URL: https://issues.apache.org/jira/browse/KAFKA-9855 Project: Kafka Issue Type: Improvement Components: core Affects Versions: 2.4.1, 2.4.0 Reporter: radai rosenblatt Assignee: radai rosenblatt at the time of this writing there are 6 schemas in kafka APIs with no fields - 3 versions each of LIST_GROUPS and API_VERSIONS. under some workloads this may result in the creation of a lot of Struct objects with an Object[0] for values when deserializing those requests from the wire. in one particular heap dump we've found a significant amount of heap space wasted on creating such objects. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KAFKA-9854) Re-authenticating causes mismatched parse of response
Chia-Ping Tsai created KAFKA-9854: - Summary: Re-authenticating causes mismatched parse of response Key: KAFKA-9854 URL: https://issues.apache.org/jira/browse/KAFKA-9854 Project: Kafka Issue Type: Bug Reporter: Chia-Ping Tsai Assignee: Chia-Ping Tsai the schema of LIST_OFFSETS consists of # throttle_time_ms:INT32 and # responses:ARRAY If both are zero, its binary is compatible to schema of SASL_HANDSHAKE composed of # error_code:INT16 and # mechanisms:ARRAY(STRING) Hence, there is no Schema error when SASL_HANDSHAKE tries to parse response of LIST_OFFSETS but the check of correction id throws IllegalStateException due to mismatched error. The IllegalStateException is NOT caught and the mismatched response is not sent back to Selector so the cascading error happens that all following responses are parsed by incorrect Schema. -- This message was sent by Atlassian Jira (v8.3.4#803005)