Re: Permission to create a KIP

2020-04-12 Thread 张祥
 I just registered a new account with xiangzhang1...@gmail.com and my
username is `iamabug`, not sure which one is id.

Guozhang Wang  于2020年4月13日周一 下午1:51写道:

> The id is for the apache's wiki space:
> https://cwiki.apache.org/confluence/display/KAFKA
>
> If you already had one before, that will work; if not you can create one
> under that space.
>
>
> Guozhang
>
> On Sun, Apr 12, 2020 at 10:49 PM 张祥  wrote:
>
> > I am not sure that I have one, how can I find out this and how can I
> create
> > one ? Thanks.
> >
> > Guozhang Wang  于2020年4月13日周一 下午1:42写道:
> >
> > > Hello Xiang,
> > >
> > > What's your apache ID?
> > >
> > >
> > > Guozhang
> > >
> > > On Sun, Apr 12, 2020 at 6:08 PM 张祥  wrote:
> > >
> > > > Hi, I am working on a ticket which requires modifying public APIs
> that
> > > are
> > > > visible to users. Could somebody grant the KIP permission to me ?
> > Thanks.
> > > >
> > >
> > >
> > > --
> > > -- Guozhang
> > >
> >
>
>
> --
> -- Guozhang
>


Re: Permission to create a KIP

2020-04-12 Thread Guozhang Wang
The id is for the apache's wiki space:
https://cwiki.apache.org/confluence/display/KAFKA

If you already had one before, that will work; if not you can create one
under that space.


Guozhang

On Sun, Apr 12, 2020 at 10:49 PM 张祥  wrote:

> I am not sure that I have one, how can I find out this and how can I create
> one ? Thanks.
>
> Guozhang Wang  于2020年4月13日周一 下午1:42写道:
>
> > Hello Xiang,
> >
> > What's your apache ID?
> >
> >
> > Guozhang
> >
> > On Sun, Apr 12, 2020 at 6:08 PM 张祥  wrote:
> >
> > > Hi, I am working on a ticket which requires modifying public APIs that
> > are
> > > visible to users. Could somebody grant the KIP permission to me ?
> Thanks.
> > >
> >
> >
> > --
> > -- Guozhang
> >
>


-- 
-- Guozhang


Re: Permission to create a KIP

2020-04-12 Thread 张祥
I am not sure that I have one, how can I find out this and how can I create
one ? Thanks.

Guozhang Wang  于2020年4月13日周一 下午1:42写道:

> Hello Xiang,
>
> What's your apache ID?
>
>
> Guozhang
>
> On Sun, Apr 12, 2020 at 6:08 PM 张祥  wrote:
>
> > Hi, I am working on a ticket which requires modifying public APIs that
> are
> > visible to users. Could somebody grant the KIP permission to me ? Thanks.
> >
>
>
> --
> -- Guozhang
>


Re: Permission to create a KIP

2020-04-12 Thread Guozhang Wang
Hello Xiang,

What's your apache ID?


Guozhang

On Sun, Apr 12, 2020 at 6:08 PM 张祥  wrote:

> Hi, I am working on a ticket which requires modifying public APIs that are
> visible to users. Could somebody grant the KIP permission to me ? Thanks.
>


-- 
-- Guozhang


MessagesOutPerSec JMX metric

2020-04-12 Thread 张祥
Hi,

I am wondering why there isn't a metric called MessagesOutPerSec in Kafka
JMX metrics to describe how many messages are consumed by clients and
fetched by followers per second since there are already metrics like
MessagesInPerSec, BytesInPerSec and BytesOutPerSec. Thanks.


Permission to create a KIP

2020-04-12 Thread 张祥
Hi, I am working on a ticket which requires modifying public APIs that are
visible to users. Could somebody grant the KIP permission to me ? Thanks.


回复:回复:回复:回复:回复:回复:回复:[Vote] KIP-571: Add option to force remove members in StreamsResetter

2020-04-12 Thread feyman2009
Thanks , John and Guochang!
--
发件人:Guozhang Wang 
发送时间:2020年4月11日(星期六) 03:07
收件人:dev 
主 题:Re: 回复:回复:回复:回复:回复:回复:[Vote] KIP-571: Add option to force remove members in 
StreamsResetter

Thanks Feyman,

I've looked at the update that you incorporated from Matthias and that LGTM
too. I'm still +1 :)

Guozhang

On Fri, Apr 10, 2020 at 11:18 AM John Roesler  wrote:

> Hey Feyman,
>
> Just to remove any ambiguity, I've been casually following the discussion,
> I've just looked at the KIP document again, and I'm still +1 (binding).
>
> Thanks,
> -John
>
> On Fri, Apr 10, 2020, at 01:44, feyman2009 wrote:
> > Hi, all
> > KIP-571 has already collected 4 bind +1 (John, Guochang, Bill,
> > Matthias) and 3 non-binding +1(Boyang, Sophie), I will mark it as
> > approved and create a PR shortly.
> > Thanks!
> >
> > Feyman
> > --
> > 发件人:feyman2009 
> > 发送时间:2020年4月8日(星期三) 14:21
> > 收件人:dev ; Boyang Chen 
> > 主 题:回复:回复:回复:回复:回复:回复:[Vote] KIP-571: Add option to force remove
> > members in StreamsResetter
> >
> > Hi Boyang,
> > Thanks for reminding me of that!
> > I'm not sure about the convention, I thought it would need to
> > re-collect votes if the KIP has changed~
> > Let's leave the vote thread here for 2 days, if no objection, I
> > will take it as approved and update the PR accordingly.
> >
> > Thanks!
> > Feyman
> >
> >
> >
> > --
> > 发件人:Boyang Chen 
> > 发送时间:2020年4月8日(星期三) 12:42
> > 收件人:dev ; feyman2009 
> > 主 题:Re: 回复:回复:回复:回复:回复:[Vote] KIP-571: Add option to force remove
> > members in StreamsResetter
> >
> > You should already get enough votes if I'm counting correctly
> > (Guozhang, John, Matthias)
> > On Tue, Apr 7, 2020 at 6:59 PM feyman2009
> >  wrote:
> > Hi, Boyang
> >  I think Matthias's proposal makes sense, but we can use the admin
> > tool for this scenario as Boyang mentioned or follow up later, so I
> > prefer to keep this KIP unchanged to minimize the scope.
> >  Calling for vote ~
> >
> >  Thanks!
> >  Feyman
> >
> >  --
> >  发件人:Boyang Chen 
> >  发送时间:2020年4月8日(星期三) 02:15
> >  收件人:dev 
> >  主 题:Re: 回复:回复:回复:回复:回复:[Vote] KIP-571: Add option to force remove
> > members in StreamsResetter
> >
> >  Hey Feyman,
> >
> >  I think Matthias' suggestion is optional, and we could just use admin
> tool
> >  to remove single static members as well.
> >
> >  Boyang
> >
> >  On Tue, Apr 7, 2020 at 11:00 AM Matthias J. Sax 
> wrote:
> >
> >  > > Would you mind to elaborate why we still need that
> >  >
> >  > Sure.
> >  >
> >  > For static memership, the session timeout it usually set quite high.
> >  > This make scaling in an application tricky: if you shut down one
> >  > instance, no rebalance would happen until `session.timeout.ms` hits.
> >  > This is specific to Kafka Streams, because when a Kafka Stream
> > client is
> >  > closed, it does _not_ send a `LeaveGroupRequest`. Hence, the
> >  > corresponding partitions would not be processed for a long time and
> >  > thus, fall back.
> >  >
> >  > Given that each instance will have a unique `instance.id` provided by
> >  > the user, we could allow users to remove the instance they want to
> >  > decommission from the consumer group without the need to wait for
> >  > `session.timeout.ms`.
> >  >
> >  > Hence, it's not an application reset scenario for which one wants to
> >  > remove all members, but a scaling-in scenario. For dynamic
> > membership,
> >  > this issue usually does not occur because the `session.timeout.ms` is
> >  > set to a fairly low value and a rebalance would happen quickly after
> > an
> >  > instance is decommissioned.
> >  >
> >  > Does this make sense?
> >  >
> >  > As said before, we may or may not include this in this KIP. It's up
> > to
> >  > you if you want to address it or not.
> >  >
> >  >
> >  > -Matthias
> >  >
> >  >
> >  >
> >  > On 4/7/20 7:12 AM, feyman2009 wrote:
> >  > > Hi, Matthias
> >  > > Thanks a lot!
> >  > > So you do not plan so support removing a _single static_
> > member via
> >  > `StreamsResetter`?
> >  > > =>
> >  > > Would you mind to elaborate why we still need that if we
> > are
> >  > able to batch remove active members with adminClient?
> >  > >
> >  > > Thanks!
> >  > >
> >  > > Feyman
> >  > >  --
> >  > > 发件人:Matthias J. Sax 
> >  > > 发送时间:2020年4月7日(星期二) 08:25
> >  > > 收件人:dev 
> >  > > 主 题:Re: 回复:回复:回复:回复:[Vote] KIP-571: Add option to force remove
> > members
> >  > in StreamsResetter
> >  > >
> >  > > Overall LGTM.
> >  > >
> >  > > +1 (binding)
> >  > >
> >  > > So you do not plan so support removing a _single static_ member via
> >  > > `StreamsResetter`? We can of course still add this as a follow up
> > but it
> >  > > might be 

[jira] [Created] (KAFKA-9855) dont waste memory allocating Struct and values objects for Schemas with no fields

2020-04-12 Thread radai rosenblatt (Jira)
radai rosenblatt created KAFKA-9855:
---

 Summary: dont waste memory allocating Struct and values objects 
for Schemas with no fields
 Key: KAFKA-9855
 URL: https://issues.apache.org/jira/browse/KAFKA-9855
 Project: Kafka
  Issue Type: Improvement
  Components: core
Affects Versions: 2.4.1, 2.4.0
Reporter: radai rosenblatt
Assignee: radai rosenblatt


at the time of this writing there are 6 schemas in kafka APIs with no fields - 
3 versions each of LIST_GROUPS and API_VERSIONS.

under some workloads this may result in the creation of a lot of Struct objects 
with an Object[0] for values when deserializing those requests from the wire.

in one particular heap dump we've found a significant amount of heap space 
wasted on creating such objects.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (KAFKA-9854) Re-authenticating causes mismatched parse of response

2020-04-12 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-9854:
-

 Summary: Re-authenticating causes mismatched parse of response
 Key: KAFKA-9854
 URL: https://issues.apache.org/jira/browse/KAFKA-9854
 Project: Kafka
  Issue Type: Bug
Reporter: Chia-Ping Tsai
Assignee: Chia-Ping Tsai


the schema of LIST_OFFSETS consists of  # throttle_time_ms:INT32 and 
 # responses:ARRAY

 
If both are zero, its binary is compatible to schema of SASL_HANDSHAKE composed 
of # error_code:INT16 and 
 # mechanisms:ARRAY(STRING)

 
Hence, there is no Schema error when SASL_HANDSHAKE tries to parse response of 
LIST_OFFSETS but the check of correction id throws IllegalStateException due to 
mismatched error. The IllegalStateException is NOT caught and the mismatched 
response is not sent back to Selector so the cascading error happens that all 
following responses are parsed by incorrect Schema.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)