Build failed in Jenkins: kafka-trunk-jdk11 #1556

See Changes: [github] KAFKA-9716; Clarify meaning of compression rate metrics (#8664) [github] KAFKA-9849: Fix issue with worker.unsync.backoff.ms creating zombie --

Jenkins build is back to normal : kafka-trunk-jdk8 #4629

See

Re: [DISCUSS] KIP-614: Add Prefix Scan support for State Stores

Hi John, You rightly pointed out, the devil is in the detail :). I will start with the implementation to get a sense. Here are my thoughts on the core challenge that you pointed out. The key value store abstractions that have been exposed via the state store DSL APIs, make it possible for the

Re: [VOTE] KIP-572: Improve timeouts and retires in Kafka Streams

Sounds fair to me. I'm +1 on the KIP. On Thu, Jun 4, 2020 at 5:26 PM Matthias J. Sax wrote: > Guozhang, > > what you propose makes sense, but this seems to get into implementation > detail territory already? > > Thus, if there are nor further change requests to the KIP wiki page > itself, I

[jira] [Created] (KAFKA-10135) Extract Task#executeAndMaybeSwallow to be a general utility function into TaskManager

Boyang Chen created KAFKA-10135: --- Summary: Extract Task#executeAndMaybeSwallow to be a general utility function into TaskManager Key: KAFKA-10135 URL: https://issues.apache.org/jira/browse/KAFKA-10135

Jenkins build is back to normal : kafka-trunk-jdk14 #204

See

Build failed in Jenkins: kafka-2.5-jdk8 #148

See Changes: [konstantine] KAFKA-9849: Fix issue with worker.unsync.backoff.ms creating zombie -- [...truncated 3.18 MB...]

Build failed in Jenkins: kafka-trunk-jdk8 #4628

See Changes: [github] KAFKA-9849: Fix issue with worker.unsync.backoff.ms creating zombie -- [...truncated 6.26 MB...] org.apache.kafka.streams.test.OutputVerifierTest >

Re: [VOTE] KIP-599: Throttle Create Topic, Create Partition and Delete Topic Operations

Hi, Colin, Good point. Maybe sth like THROTTLING_QUOTA_VIOLATED will make this clear. Hi, David, We added a new quota name in the KIP. You chose not to bump up the version of DESCRIBE_CLIENT_QUOTAS and ALTER_CLIENT_QUOTAS, which seems ok since the quota name is represented as a string. However,

Re: [DISCUSS] KIP-590: Redirect Zookeeper Mutation Protocols to The Controller

Hi, Boyang, Thanks for the KIP. Just a few comments on the metrics. 1. It would be useful to document the full JMX metric names (package, type, etc) of the new metrics. Also, for rates on the server side, we typically use Yammer Meter. 2. For num-messages-redirected-rate, would

[jira] [Created] (KAFKA-10134) High CPU issue during rebalance in Kafka consumer after upgrading to 2.5

Sean Guo created KAFKA-10134: Summary: High CPU issue during rebalance in Kafka consumer after upgrading to 2.5 Key: KAFKA-10134 URL: https://issues.apache.org/jira/browse/KAFKA-10134 Project: Kafka

[jira] [Created] (KAFKA-10133) Cannot compress messages in destination cluster with MM2

Steve Jacobs created KAFKA-10133: Summary: Cannot compress messages in destination cluster with MM2 Key: KAFKA-10133 URL: https://issues.apache.org/jira/browse/KAFKA-10133 Project: Kafka

Build failed in Jenkins: kafka-2.5-jdk8 #147

See Changes: [konstantine] KAFKA-9848: Avoid triggering scheduled rebalance delay when task -- [...truncated 5.92 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

Re: [VOTE] KIP-599: Throttle Create Topic, Create Partition and Delete Topic Operations

On Tue, Jun 9, 2020, at 05:06, David Jacot wrote: > Hi Colin, > > Thank you for your feedback. > > Jun has summarized the situation pretty well. Thanks Jun! I would like to > complement it with the following points: > > 1. Indeed, when the quota is exceeded, the broker will reject the topic >

Build failed in Jenkins: kafka-trunk-jdk14 #203

See Changes: [github] KAFKA-9716; Clarify meaning of compression rate metrics (#8664) [github] KAFKA-9849: Fix issue with worker.unsync.backoff.ms creating zombie --

[jira] [Created] (KAFKA-10132) Kafka Connect JMX MBeans with String values have type double

Tom Malaher created KAFKA-10132: --- Summary: Kafka Connect JMX MBeans with String values have type double Key: KAFKA-10132 URL: https://issues.apache.org/jira/browse/KAFKA-10132 Project: Kafka

Jenkins build is back to normal : kafka-2.6-jdk8 #31

See

[jira] [Created] (KAFKA-10131) Minimize use of --zookeeper flag in ducktape tests

Vinoth Chandar created KAFKA-10131: -- Summary: Minimize use of --zookeeper flag in ducktape tests Key: KAFKA-10131 URL: https://issues.apache.org/jira/browse/KAFKA-10131 Project: Kafka Issue

Build failed in Jenkins: kafka-trunk-jdk8 #4627

See Changes: [github] KAFKA-9716; Clarify meaning of compression rate metrics (#8664) -- [...truncated 3.13 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

Re: [VOTE] KIP-599: Throttle Create Topic, Create Partition and Delete Topic Operations

Hi, David, Sounds good then. Thanks, Jun On Tue, Jun 9, 2020 at 10:59 AM David Jacot wrote: > Hi Jun, > > Both are already in the KIP, see "New Broker Configurations" chapter. I > think > that we need them in order to be able to define different burst for the new > quota. > > Best, > David >

Re: [DISCUSS] KIP-614: Add Prefix Scan support for State Stores

Hi Sagar, Thanks for the reply. I agree that your UUID example illustrates the problem I was pointing out. Yes, I think that experimenting with the API in the PR is probably the best way to make progress (as opposed to just thinking in terms of design on the wiki) because with this kind of

Build failed in Jenkins: kafka-trunk-jdk8 #4626

See Changes: [github] KAFKA-9848: Avoid triggering scheduled rebalance delay when task -- [...truncated 3.13 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

Re: [VOTE] KIP-599: Throttle Create Topic, Create Partition and Delete Topic Operations

Hi Jun, Both are already in the KIP, see "New Broker Configurations" chapter. I think that we need them in order to be able to define different burst for the new quota. Best, David On Tue, Jun 9, 2020 at 7:48 PM Jun Rao wrote: > Hi, David, > > Another thing. Should we add

Re: [VOTE] KIP-599: Throttle Create Topic, Create Partition and Delete Topic Operations

Hi, David, Another thing. Should we add controller.quota.window.size.seconds and controller.quota.window.num or just reuse the existing quota.window.size.seconds and quota.window.num that are used for other types of quotas? Thanks, Jun On Tue, Jun 9, 2020 at 10:30 AM Jun Rao wrote: > Hi,

[jira] [Created] (KAFKA-10130) Rewrite ZkData struct with auto-generated protocol

Boyang Chen created KAFKA-10130: --- Summary: Rewrite ZkData struct with auto-generated protocol Key: KAFKA-10130 URL: https://issues.apache.org/jira/browse/KAFKA-10130 Project: Kafka Issue Type:

Re: [VOTE] KIP-599: Throttle Create Topic, Create Partition and Delete Topic Operations

Hi, David, Thanks for the KIP. The name QUOTA_VIOLATED sounds reasonable to me. +1 on the KIP. Jun On Tue, Jun 9, 2020 at 5:07 AM David Jacot wrote: > Hi Colin, > > Thank you for your feedback. > > Jun has summarized the situation pretty well. Thanks Jun! I would like to > complement it with

Re: KIP-599: Throttle Create Topic, Create Partition and Delete Topic Operations

Hi, David, Thanks for the explanation. The KIP looks good to me now. Jun On Tue, Jun 9, 2020 at 4:27 AM David Jacot wrote: > Hi Jun, > > 40. Yes, ThrottleTimeMs is set when the error code is set to QuotaViolated. > This > is required to let the client know how long it must wait. This is

Re: [DISCUSS] KIP-614: Add Prefix Scan support for State Stores

Hi John, Thanks for the response. For starters, for our use case, we tweaked our keys etc to avoid prefix scans. So, we are good there. Regarding the KIP, I see what you mean when you say that the same key type for prefix won't work. For example, continuing with the UUID example that you gave,

Build failed in Jenkins: kafka-2.6-jdk8 #30

See Changes: [bill] MINOR: fix HTML markup (#8823) -- [...truncated 3.13 MB...] org.apache.kafka.streams.test.ConsumerRecordFactoryTest >

[GitHub] [kafka-site] mjsax commented on pull request #268: MINOR: Make contact.html more clear

mjsax commented on pull request #268: URL: https://github.com/apache/kafka-site/pull/268#issuecomment-640962104 Thanks for the PR! This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [kafka-site] mjsax merged pull request #268: MINOR: Make contact.html more clear

mjsax merged pull request #268: URL: https://github.com/apache/kafka-site/pull/268 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [kafka-site] scott-confluent opened a new pull request #269: Kafka nav and hompeage redesign

scott-confluent opened a new pull request #269: URL: https://github.com/apache/kafka-site/pull/269 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Resolved] (KAFKA-9923) Join window store duplicates can be compacted in changelog

[ https://issues.apache.org/jira/browse/KAFKA-9923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sophie Blee-Goldman resolved KAFKA-9923. Resolution: Not A Problem [~cadonna] pointed out that this actually ins't a

[jira] [Created] (KAFKA-10129) Fail the QA if there is javadoc error

Chia-Ping Tsai created KAFKA-10129: -- Summary: Fail the QA if there is javadoc error Key: KAFKA-10129 URL: https://issues.apache.org/jira/browse/KAFKA-10129 Project: Kafka Issue Type:

Jenkins build is back to normal : kafka-trunk-jdk11 #1554

See

Jenkins build is back to normal : kafka-trunk-jdk8 #4625

See

[jira] [Resolved] (KAFKA-9724) Consumer wrongly ignores fetched records "since it no longer has valid position"

[ https://issues.apache.org/jira/browse/KAFKA-9724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Arthur resolved KAFKA-9724. - Fix Version/s: 2.6.0 Assignee: David Arthur Resolution: Fixed > Consumer wrongly

Re: [VOTE] KIP-599: Throttle Create Topic, Create Partition and Delete Topic Operations

Hi Colin, Thank you for your feedback. Jun has summarized the situation pretty well. Thanks Jun! I would like to complement it with the following points: 1. Indeed, when the quota is exceeded, the broker will reject the topic creations, partition creations and topics deletions that are

Re: KIP-599: Throttle Create Topic, Create Partition and Delete Topic Operations

Hi Jun, 40. Yes, ThrottleTimeMs is set when the error code is set to QuotaViolated. This is required to let the client know how long it must wait. This is explained in the "Handling of new/old clients". Best, David On Mon, Jun 8, 2020 at 9:29 PM Jun Rao wrote: > Hi, David, > > Thanks for the

Build failed in Jenkins: kafka-trunk-jdk11 #1553

See Changes: [github] KAFKA-10063; UnsupportedOperation when querying cleaner metrics after [github] MINOR: Fix fetch session epoch comment in `FetchRequest.json` (#8802)

[jira] [Created] (KAFKA-10128) MM2 - Delete topics when config sync is enabled

Karthik created KAFKA-10128: --- Summary: MM2 - Delete topics when config sync is enabled Key: KAFKA-10128 URL: https://issues.apache.org/jira/browse/KAFKA-10128 Project: Kafka Issue Type: Bug

Re: [DISCUSS] KIP-405: Kafka Tiered Storage

We did not want to add many implementation details in the KIP. But we decided to add them in the KIP as appendix or sub-sections(including follower fetch protocol) to describe the flow with the main cases. That will answer most of the queries. I will update on this mail thread when the respective

[jira] [Created] (KAFKA-10127) kafka cluster not recovering - Shrinking ISR continously

Youssef BOUZAIENNE created KAFKA-10127: -- Summary: kafka cluster not recovering - Shrinking ISR continously Key: KAFKA-10127 URL: https://issues.apache.org/jira/browse/KAFKA-10127 Project: Kafka

[jira] [Created] (KAFKA-10126) Remove unused options in ConsumerPerformance

jiamei xie created KAFKA-10126: -- Summary: Remove unused options in ConsumerPerformance Key: KAFKA-10126 URL: https://issues.apache.org/jira/browse/KAFKA-10126 Project: Kafka Issue Type: Bug

Re: Broker side round robin on topic partitions when receiving messages

Anyone? On Fri, Jun 5, 2020 at 2:42 PM Vinicius Scheidegger < vinicius.scheideg...@gmail.com> wrote: > Does anyone know how could I perform a load balance to distribute equally > the messages to all consumers within the same consumer group having > multiple producers? > > Is this a conceptual

[jira] [Created] (KAFKA-10125) The partition which is removing should be considered to be under reassignment

Chia-Ping Tsai created KAFKA-10125: -- Summary: The partition which is removing should be considered to be under reassignment Key: KAFKA-10125 URL: https://issues.apache.org/jira/browse/KAFKA-10125

[jira] [Created] (KAFKA-10124) ConsumerPerformance output wrong rebalance.time.ms

jiamei xie created KAFKA-10124: -- Summary: ConsumerPerformance output wrong rebalance.time.ms Key: KAFKA-10124 URL: https://issues.apache.org/jira/browse/KAFKA-10124 Project: Kafka Issue Type: