Re: [VOTE] KIP-714: Client Metrics and Observability

2021-10-18 Thread Ryanne Dolan
-1 Ryanne On Mon, Oct 18, 2021, 4:30 AM Magnus Edenhill wrote: > Hi all, > > I'd like to start a vote on KIP-714. > https://cwiki.apache.org/confluence/x/2xRRCg > > Discussion thread: > https://www.mail-archive.com/dev@kafka.apache.org/msg119000.html > > Thanks, > Magnus >

Re: [VOTE] KIP-714: Client Metrics and Observability

2021-10-18 Thread Anna McDonald
Hi MagnUs, Thanks for the KIP. +1 (non-binding) Cheers, Anna On Mon, Oct 18, 2021, 5:30 AM Magnus Edenhill wrote: > Hi all, > > I'd like to start a vote on KIP-714. > https://cwiki.apache.org/confluence/x/2xRRCg > > Discussion thread: >

[jira] [Created] (KAFKA-13383) Consumer Group partition management across clusters (Active-Active)

2021-10-18 Thread NEERAJ VAIDYA (Jira)
NEERAJ VAIDYA created KAFKA-13383: - Summary: Consumer Group partition management across clusters (Active-Active) Key: KAFKA-13383 URL: https://issues.apache.org/jira/browse/KAFKA-13383 Project: Kafka

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #528

2021-10-18 Thread Apache Jenkins Server
See Changes: -- [...truncated 491396 lines...] [2021-10-18T22:40:06.264Z] AclAuthorizerTest > testEmptyAclThrowsException() STARTED [2021-10-18T22:40:06.264Z]

Re: [DISCUSS] Add TaskId field to StreamsException

2021-10-18 Thread Sophie Blee-Goldman
Ah, thanks. I've updated the KIP On Mon, Oct 18, 2021 at 3:36 PM Matthias J. Sax wrote: > Sophie, > > I think we also need to pass in a `TaskId` into the constructor, which > are also part of the public API. > > Otherwise LGTM. > > -Matthias > > On 10/17/21 9:03 PM, Sophie Blee-Goldman wrote: >

Re: [DISCUSS] Add TaskId field to StreamsException

2021-10-18 Thread Matthias J. Sax
Sophie, I think we also need to pass in a `TaskId` into the constructor, which are also part of the public API. Otherwise LGTM. -Matthias On 10/17/21 9:03 PM, Sophie Blee-Goldman wrote: Hey all, I'd like to propose a very small KIP to add a TaskId field to the StreamsException class. I

Re: [VOTE] Add TaskId field to StreamsException

2021-10-18 Thread John Roesler
Thanks, Sophie, +1 from me. I was a little apprehensive about the potential to break exception handler logic, but I agree with your comment in the "compatibility" section: Identifying the causes of exceptions is always kind of chaotic and this seems like more of an improvement than anything.

Re: [VOTE] Add TaskId field to StreamsException

2021-10-18 Thread Walker Carlson
Hey Sophie, +1 for me, I think that is would only help. Walker On Mon, Oct 18, 2021 at 1:45 AM Luke Chen wrote: > Hi Sophie, > Add taskId to make the exception much clear is a good improvement. > + 1 (non-binding) > > Thank you. > Luke > > On Mon, Oct 18, 2021 at 12:10 PM Sophie Blee-Goldman

Re: Request to add me to the KAFKA discussions mailing lists.

2021-10-18 Thread Mickael Maison
Hi Sarat, To subscribe to the dev mailing list, just follow the instructions on https://kafka.apache.org/contact Note that if you only want to reply to an old thread, you can do it via mail-archive.com or lists.apache.org [0]. 0:

Request to add me to the KAFKA discussions mailing lists.

2021-10-18 Thread Sarat Kakarla
Hi, I am Sarat Kakarla working as Staff Software Engineer at Confluent. I would like to take part of the following discussion thread: https://www.mail-archive.com/dev@kafka.apache.org/msg119000.html Would you please add me to the above thread so that I can post my comments. Thanks Sarat

Re: [VOTE] KIP-768: Extend SASL/OAUTHBEARER with Support for OIDC

2021-10-18 Thread Kirk True
Hi all, With four binding +1 votes (Manikumar Reddy, Rajini Sivaram, David Jacot, and Ismael Juma) and one non-binding +1 vote (Ron Dagostino), the vote passes. Thanks everyone! Kirk On Fri, Oct 15, 2021, at 10:40 AM, Ismael Juma wrote: > Thanks Kirk, I'm overall +1 (binding). I think the

[DISCUSS] KIP-784: Add top-level error code field to DescribeLogDirsResponse

2021-10-18 Thread Mickael Maison
Hi, I wrote a very minor KIP that proposes adding a top-level error code field to DescribeLogDirsResponse: https://cwiki.apache.org/confluence/display/KAFKA/KIP-784%3A+Add+top-level+error+code+field+to+DescribeLogDirsResponse Please let me know if you have any feedback. Thanks

[DISCUSS] KIP-785 Automatic storage formatting

2021-10-18 Thread Igor Soarez
Hi all, I'd like to propose that we simplify the operation of KRaft servers a bit by removing the requirement to run kafka-storage.sh for new storage directories. Please take a look at the KIP and provide your feedback:

[jira] [Created] (KAFKA-13382) Automatic storage formatting

2021-10-18 Thread Igor Soarez (Jira)
Igor Soarez created KAFKA-13382: --- Summary: Automatic storage formatting Key: KAFKA-13382 URL: https://issues.apache.org/jira/browse/KAFKA-13382 Project: Kafka Issue Type: Improvement

[jira] [Resolved] (KAFKA-13372) failed authentication due to: SSL handshake failed

2021-10-18 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-13372. --- Resolution: Resolved > failed authentication due to: SSL handshake failed >

Re: [DISCUSS] KIP-779: Allow Source Tasks to Handle Producer Exceptions

2021-10-18 Thread Christopher Shannon
I also would find this feature useful to handle errors better, does anyone have any comments or feedback? On Mon, Oct 11, 2021 at 8:52 AM Knowles Atchison Jr wrote: > Good morning, > > Bumping this for visibility. I would like this to go into the next release. > KIP freeze is Friday. > > Any

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #527

2021-10-18 Thread Apache Jenkins Server
See Changes: -- [...truncated 493442 lines...] [2021-10-18T12:01:22.914Z] AclCommandTest > testAclsOnPrefixedResourcesWithAuthorizer() PASSED [2021-10-18T12:01:22.914Z]

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #526

2021-10-18 Thread Apache Jenkins Server
See Changes: -- [...truncated 494759 lines...] [2021-10-18T10:16:06.700Z] [2021-10-18T10:16:06.700Z] AclAuthorizerTest > testChangeListenerTiming() STARTED

[VOTE] KIP-714: Client Metrics and Observability

2021-10-18 Thread Magnus Edenhill
Hi all, I'd like to start a vote on KIP-714. https://cwiki.apache.org/confluence/x/2xRRCg Discussion thread: https://www.mail-archive.com/dev@kafka.apache.org/msg119000.html Thanks, Magnus

Re: [VOTE] KIP-764 Configurable backlog size for creating Acceptor

2021-10-18 Thread Haruki Okada
Hi Lucas. Thanks for the vote. As far as I understand, it should be enough to adjust `net.core.somaxconn` and `net.ipv4.tcp_max_syn_backlog` accordingly for allocating sufficient backlog size. 2021年10月18日(月) 17:37 Lucas Bradstreet : > The other related kernel config that I can recall is >

Re: [VOTE] KIP-764 Configurable backlog size for creating Acceptor

2021-10-18 Thread Lucas Bradstreet
The other related kernel config that I can recall is net.ipv4.tcp_max_syn_backlog. On Mon, Oct 18, 2021 at 4:32 PM Lucas Bradstreet wrote: > Thank you for the KIP. +1 (non-binding) > > For the implementation can we ensure that any kernel parameters that may > need to also be adjusted are

Re: [VOTE] KIP-764 Configurable backlog size for creating Acceptor

2021-10-18 Thread Lucas Bradstreet
Thank you for the KIP. +1 (non-binding) For the implementation can we ensure that any kernel parameters that may need to also be adjusted are documented in the config documentation (e.g. net.core.somaxconn)? On Mon, Oct 18, 2021 at 4:23 PM Haruki Okada wrote: > Hi Luke. > > Thank you for the

Re: [VOTE] KIP-764 Configurable backlog size for creating Acceptor

2021-10-18 Thread Rajini Sivaram
Hi Haruki Okada, +1 (binding) Thanks for the KIP! Regards, Rajini On Mon, Oct 18, 2021 at 9:23 AM Haruki Okada wrote: > Hi Luke. > > Thank you for the vote. > Updated KIP to link to ServerSocket#bind javadoc. > > > 2021年10月18日(月) 17:00 Luke Chen : > > > Hi Okada, > > Thanks for the KIP. >

Re: [VOTE] KIP-764 Configurable backlog size for creating Acceptor

2021-10-18 Thread Haruki Okada
Hi Luke. Thank you for the vote. Updated KIP to link to ServerSocket#bind javadoc. 2021年10月18日(月) 17:00 Luke Chen : > Hi Okada, > Thanks for the KIP. > +1 (non-binding) > > One thing to add is that you should add ServerSocket#bind java doc link > into the KIP. > I don't think everyone is

[jira] [Resolved] (KAFKA-13284) Use sftp protocol in release.py to upload release candidate artifacts

2021-10-18 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-13284. Resolution: Fixed > Use sftp protocol in release.py to upload release candidate artifacts

Re: [VOTE] KIP-764 Configurable backlog size for creating Acceptor

2021-10-18 Thread Luke Chen
Hi Okada, Thanks for the KIP. +1 (non-binding) One thing to add is that you should add ServerSocket#bind java doc link into the KIP. I don't think everyone is familiar with the definition of the method parameters. Thank you. Luke On Mon, Oct 18, 2021 at 3:43 PM Haruki Okada wrote: > Hi Kafka.

Re: [DISCUSS] Apache Kafka 3.1.0 release

2021-10-18 Thread David Jacot
Hi team, KIP freeze for the next major release of Apache Kafka was reached last week. I have updated the release plan with all the adopted KIPs which are considered for AK 3.1.0. Please, verify the plan and let me know if any KIP should be added to or removed from the release plan. For the KIPs

Re: [VOTE] KIP-764 Configurable backlog size for creating Acceptor

2021-10-18 Thread Haruki Okada
Hi Kafka. Let me bump this VOTE thread for the KIP. We applied proposed changes in the KIP to our large Kafka cluster by building patched Kafka internally and confirmed it's working well. Please feel free to give your feedback if there's any points to be clarified in the KIP. Thanks,

Re: [DISCUSS] KIP-780: Support fine-grained compression options

2021-10-18 Thread Dongjin Lee
Hi Ismael, do you have any opinion on this approach and benchmark results? Thanks, Dongjin On Wed, Oct 13, 2021 at 8:09 PM Dongjin Lee wrote: > Hi Chen, > > > It said, available value is [10, 22], but default is a value out of that > range, which should be wrong. > > Oh yes, it was a mistake!

Re: [VOTE] Add TaskId field to StreamsException

2021-10-18 Thread Luke Chen
Hi Sophie, Add taskId to make the exception much clear is a good improvement. + 1 (non-binding) Thank you. Luke On Mon, Oct 18, 2021 at 12:10 PM Sophie Blee-Goldman wrote: > Hey all, > > I'd like to kick off the vote on this small KIP which adds a TaskId field > to the StreamsException class.

Re: [DISCUSS] KIP-782: Expandable batch size in producer

2021-10-18 Thread Luke Chen
Hi Ismael, Thanks for your comments. 1. Why do we have to reallocate the buffer? We can keep a list of buffers instead and avoid reallocation. -> Do you mean we allocate multiple buffers with "buffer.initial.size", and link them together (with linked list)? ex: a. We allocate 4KB initial buffer |