[GitHub] [kafka-site] ankit-kumar-25 commented on pull request #220: KAFKA-8360: Docs do not mention RequestQueueSize JMX metric

2020-09-21 Thread GitBox
ankit-kumar-25 commented on pull request #220: URL: https://github.com/apache/kafka-site/pull/220#issuecomment-696188603 Hey @viktorsomogyi, Thank you for the pointers, I have created a PR against the ops.html available in the Kafka project:

[jira] [Created] (KAFKA-10510) Reassigning partitions should not allow increasing RF of a partition unless configured with it

2020-09-21 Thread Stanislav Kozlovski (Jira)
Stanislav Kozlovski created KAFKA-10510: --- Summary: Reassigning partitions should not allow increasing RF of a partition unless configured with it Key: KAFKA-10510 URL:

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #78

2020-09-21 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10459: Document IQ APIs where order does not hold between stores (#9251) -- [...truncated 3.29 MB...]

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #76

2020-09-21 Thread Apache Jenkins Server
See Changes: [github] MINOR: Use `Map.forKeyValue` to avoid tuple allocation in Scala 2.13 (#9299) -- [...truncated 6.53 MB...]

Jenkins build is back to normal : Kafka » kafka-trunk-jdk11 #77

2020-09-21 Thread Apache Jenkins Server
See

[GitHub] [kafka-site] viktorsomogyi edited a comment on pull request #220: KAFKA-8360: Docs do not mention RequestQueueSize JMX metric

2020-09-21 Thread GitBox
viktorsomogyi edited a comment on pull request #220: URL: https://github.com/apache/kafka-site/pull/220#issuecomment-696132637 Otherwise it looks good, I can approve it once you create the PR in the kafka repo (and perhaps get someone to merge it).

[GitHub] [kafka-site] viktorsomogyi commented on pull request #220: KAFKA-8360: Docs do not mention RequestQueueSize JMX metric

2020-09-21 Thread GitBox
viktorsomogyi commented on pull request #220: URL: https://github.com/apache/kafka-site/pull/220#issuecomment-696132637 Otherwise it looks good, I can approve it once you create the PR in the kafka repo. This is an

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #77

2020-09-21 Thread Apache Jenkins Server
See Changes: [github] MINOR: Use `Map.forKeyValue` to avoid tuple allocation in Scala 2.13 (#9299) -- [...truncated 6.58 MB...]

[jira] [Created] (KAFKA-10509) Add metric to track throttle time due to hitting connection rate quota

2020-09-21 Thread Anna Povzner (Jira)
Anna Povzner created KAFKA-10509: Summary: Add metric to track throttle time due to hitting connection rate quota Key: KAFKA-10509 URL: https://issues.apache.org/jira/browse/KAFKA-10509 Project:

[jira] [Resolved] (KAFKA-10458) Need a way to update quota for TokenBucket registered with Sensor

2020-09-21 Thread Anna Povzner (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anna Povzner resolved KAFKA-10458. -- Resolution: Fixed > Need a way to update quota for TokenBucket registered with Sensor >

Jenkins build is back to normal : Kafka » kafka-trunk-jdk8 #75

2020-09-21 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #76

2020-09-21 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10401; Ensure `currentStateTimeStamp` is set correctly by group coordinator (#9202) -- [...truncated 6.58 MB...]

Re: [DISCUSS] KIP-631: The Quorum-based Kafka Controller

2020-09-21 Thread Jun Rao
Hi, Colin, Sorry for the late reply. A few more comments below. 50. Configurations 50.1 controller.listeners: It seems that a controller just needs one listener. Why do we need to have a list here? Also, could you provide an example of how this is set and what's its relationship with existing

Build failed in Jenkins: Kafka » kafka-2.5-jdk8 #8

2020-09-21 Thread Apache Jenkins Server
See Changes: [Jason Frantz] KAFKA-10401; Ensure `currentStateTimeStamp` is set correctly by group coordinator (#9202) -- [...truncated 2.93 MB...]

Build failed in Jenkins: Kafka » kafka-2.4-jdk8 #5

2020-09-21 Thread Apache Jenkins Server
See Changes: [Jason Frantz] KAFKA-10401; Ensure `currentStateTimeStamp` is set correctly by group coordinator (#9202) -- [...truncated 2.77 MB...]

Build failed in Jenkins: Kafka » kafka-2.3-jdk8 #4

2020-09-21 Thread Apache Jenkins Server
See Changes: [Jason Frantz] KAFKA-10401; Ensure `currentStateTimeStamp` is set correctly by group coordinator (#9202) -- [...truncated 1.70 MB...]

Build failed in Jenkins: Kafka » kafka-2.6-jdk8 #16

2020-09-21 Thread Apache Jenkins Server
See Changes: [Jason Frantz] KAFKA-10401; Ensure `currentStateTimeStamp` is set correctly by group coordinator (#9202) -- [...truncated 3.15 MB...]

Re: [VOTE] KIP-666: Add Instant-based methods to ReadOnlySessionStore

2020-09-21 Thread John Roesler
Thanks, Jorge! I’m +1 (binding) -John On Mon, Sep 21, 2020, at 12:35, Sophie Blee-Goldman wrote: > Thanks for pointing out the vote in the discussion thread, this email > somehow skipped my inbox ¯\_(ツ)_/¯ > > I'm +1 (non-binding) > > -Sophie > > On Mon, Sep 7, 2020 at 4:18 AM Jorge Esteban

Re: [VOTE] KIP-663: API to Start and Shut Down Stream Threads and to Request Closing of Kafka Streams Clients

2020-09-21 Thread John Roesler
I’m +1 also. Thanks, Bruno! -John On Mon, Sep 21, 2020, at 17:08, Guozhang Wang wrote: > Thanks Bruno. I'm +1 on the KIP. > > On Mon, Sep 21, 2020 at 2:49 AM Bruno Cadonna wrote: > > > Hi, > > > > I would like to restart from zero the voting on KIP-663 that proposes to > > add methods to the

Re: [DISCUSS] KIP-671: Shutdown Streams Application when appropriate exception is thrown

2020-09-21 Thread Walker Carlson
The error code right now is the assignor error, 2 is coded for shutdown but it could be expanded to encode the causes or for other errors that need to be communicated. For example we can add error code 3 to close the thread but leave the client in an error state if we choose to do so in the

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #76

2020-09-21 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10401; Ensure `currentStateTimeStamp` is set correctly by group coordinator (#9202) -- [...truncated 3.29 MB...]

Re: [DISCUSS] KIP-671: Shutdown Streams Application when appropriate exception is thrown

2020-09-21 Thread Boyang Chen
Thanks for the KIP Walker. In the KIP we mentioned "In order to communicate the shutdown request from one client to the others we propose to update the SubcriptionInfoData to include a short field which will encode an error code.", is there a dedicated error code that we should define here, or it

Re: [DISCUSS] Apache Kafka 2.7.0 release

2020-09-21 Thread Boyang Chen
Hey Bill, unfortunately KIP-590 will not be in 2.7 release, could you move it to postponed KIPs? Best, Boyang On Thu, Sep 10, 2020 at 2:41 PM Bill Bejeck wrote: > Hi Gary, > > It's been added. > > Regards, > Bill > > On Thu, Sep 10, 2020 at 4:14 PM Gary Russell wrote: > > > Can someone add a

Re: [VOTE] KIP-663: API to Start and Shut Down Stream Threads and to Request Closing of Kafka Streams Clients

2020-09-21 Thread Guozhang Wang
Thanks Bruno. I'm +1 on the KIP. On Mon, Sep 21, 2020 at 2:49 AM Bruno Cadonna wrote: > Hi, > > I would like to restart from zero the voting on KIP-663 that proposes to > add methods to the Kafka Streams client to add and remove stream threads > during execution. > > >

[jira] [Created] (KAFKA-10508) Consider moving ForwardRequestHandler to a separate class

2020-09-21 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-10508: --- Summary: Consider moving ForwardRequestHandler to a separate class Key: KAFKA-10508 URL: https://issues.apache.org/jira/browse/KAFKA-10508 Project: Kafka

Re: [VOTE] KIP-671: Add method to Shutdown entire Streams Application

2020-09-21 Thread Guozhang Wang
Thanks for finalizing the KIP. +1 (binding) Guozhang On Mon, Sep 21, 2020 at 1:38 PM Walker Carlson wrote: > Hello all, > > I would like to start a thread to vote for KIP-671 to add a method to close > all clients in a kafka streams application. > > KIP: > >

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #75

2020-09-21 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10438: Lazy initialization of record header to reduce memory usage (#9223) -- [...truncated 6.58 MB...]

Re: [DISCUSS] KIP-516: Topic Identifiers

2020-09-21 Thread Justine Olshan
Hi all, After thinking about it, I've decided to remove the topic name from the Fetch Request and Response after all. Since there are so many of these requests per second, it is worth removing the extra information. I've updated the KIP to reflect this change. Please let me know if there is

[VOTE] KIP-671: Add method to Shutdown entire Streams Application

2020-09-21 Thread Walker Carlson
Hello all, I would like to start a thread to vote for KIP-671 to add a method to close all clients in a kafka streams application. KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-671%3A+Shutdown+Streams+Application+when+appropriate+exception+is+thrown Discussion thread: *here

Re: [DISCUSS] KIP-671: Shutdown Streams Application when appropriate exception is thrown

2020-09-21 Thread Walker Carlson
I am changing the name to "Add method to Shutdown entire Streams Application" since we are no longer using an Exception, it seems more appropriate. Also it looks like the discussion is pretty much finished so I will be calling it to a vote. thanks, Walker On Sat, Sep 19, 2020 at 7:49 PM

[jira] [Created] (KAFKA-10507) Limit the set of APIs returned in pre-authentication ApiVersions

2020-09-21 Thread Jason Gustafson (Jira)
Jason Gustafson created KAFKA-10507: --- Summary: Limit the set of APIs returned in pre-authentication ApiVersions Key: KAFKA-10507 URL: https://issues.apache.org/jira/browse/KAFKA-10507 Project:

Re: [VOTE] KIP-664: Provide tooling to detect and abort hanging transactions

2020-09-21 Thread Jason Gustafson
Thanks everyone! The vote passes. Here is the tally: +3 (binding): Me, Guozhang Wang, Boyang Chen +2 (non-binding): Robert Barrett, Ron Dagostino -Jason On Fri, Sep 18, 2020 at 6:42 PM Boyang Chen wrote: > Thanks Jason, +1 (binding) from me > > Boyang > > On Fri, Sep 11, 2020 at 10:12 AM

Re: [VOTE] KIP-666: Add Instant-based methods to ReadOnlySessionStore

2020-09-21 Thread Sophie Blee-Goldman
Thanks for pointing out the vote in the discussion thread, this email somehow skipped my inbox ¯\_(ツ)_/¯ I'm +1 (non-binding) -Sophie On Mon, Sep 7, 2020 at 4:18 AM Jorge Esteban Quilcate Otoya < quilcate.jo...@gmail.com> wrote: > Hi everyone, > > I'd like to start a thread to vote for

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #74

2020-09-21 Thread Apache Jenkins Server
See Changes: [github] MINOR: Replace Java 14 with Java 15 in the README (#9298) [github] KAFKA-10438: Lazy initialization of record header to reduce memory usage (#9223)

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #75

2020-09-21 Thread Apache Jenkins Server
See Changes: [github] MINOR: Replace Java 14 with Java 15 in the README (#9298) [github] KAFKA-10438: Lazy initialization of record header to reduce memory usage (#9223)

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #74

2020-09-21 Thread Apache Jenkins Server
See Changes: [github] MINOR: Replace Java 14 with Java 15 in the README (#9298) -- [...truncated 3.29 MB...]

[GitHub] [kafka-site] ankit-kumar-25 commented on pull request #220: KAFKA-8360: Docs do not mention RequestQueueSize JMX metric

2020-09-21 Thread GitBox
ankit-kumar-25 commented on pull request #220: URL: https://github.com/apache/kafka-site/pull/220#issuecomment-696188603 Hey @viktorsomogyi, Thank you for the pointers, I have created a PR against the ops.html available in the Kafka project:

Re: [DISCUSS] KIP-508: Make Suppression State Queriable - rebooted.

2020-09-21 Thread Dongjin Lee
Hi John, I updated the PR applying the API changes we discussed above. I am now updating the KIP document. Thanks, Dongjin On Sat, Sep 19, 2020 at 10:42 AM John Roesler wrote: > Hi Dongjin, > > Yes, that’s right. My the time of KIP-307, we had no choice but to add a > second name. But we do

[GitHub] [kafka-site] viktorsomogyi commented on pull request #220: KAFKA-8360: Docs do not mention RequestQueueSize JMX metric

2020-09-21 Thread GitBox
viktorsomogyi commented on pull request #220: URL: https://github.com/apache/kafka-site/pull/220#issuecomment-696132637 Otherwise it looks good, I can approve it once you create the PR in the kafka repo. This is an

[GitHub] [kafka-site] viktorsomogyi edited a comment on pull request #220: KAFKA-8360: Docs do not mention RequestQueueSize JMX metric

2020-09-21 Thread GitBox
viktorsomogyi edited a comment on pull request #220: URL: https://github.com/apache/kafka-site/pull/220#issuecomment-696132637 Otherwise it looks good, I can approve it once you create the PR in the kafka repo (and perhaps get someone to merge it).

Re: [DISCUSS] KIP-665 Kafka Connect Hash SMT

2020-09-21 Thread Brandon Brown
Hi Tom, The reason I went fix was so that we could simplify the configuration for example you can say sha256 instead of having to remember that it’s SHA-256. Admittedly if other formats become implemented then it would require updating this as well. I’m flexible on changing it to a string

Re: [DISCUSS] KIP-567: Kafka Cluster Audit (new discussion)

2020-09-21 Thread Viktor Somogyi-Vass
Hi Daniel, > If the auditor needs access to the details of the action, one could argue that even the response should be passed down to the auditor. At this point I don't think we need to include responses into the interface but if you have a use-case we can consider doing that. > Is it feasible

Re: [DISCUSSION] Upgrade system tests to python 3

2020-09-21 Thread Nikolay Izhikov
Hello. I fixed two system tests that fails in trunk, also. streams_upgrade_test.py::StreamsUpgradeTest.test_version_probing_upgrade streams_static_membership_test.py Please, take a look at my PR [1] [1] https://github.com/apache/kafka/pull/9312 > 20 сент. 2020 г., в 06:11, Guozhang Wang

Re: [VOTE] KIP-663: API to Start and Shut Down Stream Threads and to Request Closing of Kafka Streams Clients

2020-09-21 Thread Bruno Cadonna
Hi, I would like to restart from zero the voting on KIP-663 that proposes to add methods to the Kafka Streams client to add and remove stream threads during execution. https://cwiki.apache.org/confluence/display/KAFKA/KIP-663%3A+API+to+Start+and+Shut+Down+Stream+Threads Matthias, if you are

[jira] [Created] (KAFKA-10506) Ssl connectors and tasks have incorrect statuses

2020-09-21 Thread Lobashin Denis (Jira)
Lobashin Denis created KAFKA-10506: -- Summary: Ssl connectors and tasks have incorrect statuses Key: KAFKA-10506 URL: https://issues.apache.org/jira/browse/KAFKA-10506 Project: Kafka Issue

Re: [DISCUSS] KIP-660: Pluggable ReplicaAssignor

2020-09-21 Thread Tom Bentley
Hi Mickael, A few thoughts about the ReplicaAssignor contract: 1. What happens if a ReplicaAssignor impl returns a Map where some assignments don't meet the given replication factor? 2. Fixing the signature of assignReplicasToBrokers() as you have would make it hard to pass extra information in

[jira] [Created] (KAFKA-10505) [SystemTests] streams_static_membership.py and streams_upgradet_test.py fails

2020-09-21 Thread Nikolay Izhikov (Jira)
Nikolay Izhikov created KAFKA-10505: --- Summary: [SystemTests] streams_static_membership.py and streams_upgradet_test.py fails Key: KAFKA-10505 URL: https://issues.apache.org/jira/browse/KAFKA-10505

Re: [DISCUSS] KIP-666: Add Instant-based methods to ReadOnlySessionStore

2020-09-21 Thread Jorge Esteban Quilcate Otoya
Thanks John! PS. vote thread started https://lists.apache.org/thread.html/r5863299712063d4cb4be139ce4ab0533ce66efe04c1f7e993666b09c%40%3Cdev.kafka.apache.org%3E On Sat, Sep 19, 2020 at 2:46 AM John Roesler wrote: > Thanks for the KIP, Jorge! > > Sorry it took me so long. I just reviewed the

Re: [VOTE] KIP-578: Add configuration to limit number of partitions

2020-09-21 Thread Gokul Ramanan Subramanian
Hi, at this point, this KIP has one binding vote from Harsha. Does anyone else have an opinion on this KIP? Do you think we should go forward with this KIP once we release Kafka 3.0, since there wouldn't be the ZK backdoor in 3.0, making the partition limits properly enforceable? Thanks. On

Re: [DISCUSS] KIP-665 Kafka Connect Hash SMT

2020-09-21 Thread Tom Bentley
Hi Brandon and Mickael, Is it necessary to fix the supported digest? We could just support whatever the JVM's MessageDigest supports? Kind regards, Tom On Fri, Sep 18, 2020 at 6:00 PM Brandon Brown wrote: > Thanks Michael! So proposed hash functions would be MD5, SHA1, SHA256. > > I can

Re: Contributor access

2020-09-21 Thread Mickael Maison
Done! Welcome to the Kafka community On Sun, Sep 20, 2020 at 7:51 AM Piotr Rżysko wrote: > > Hello, > > I would like to contribute to Kafka. Can you please add me to the > contributor list? > My JIRA username: piotr.rzysko > > Best regards, > Piotr Rżysko