[jira] [Resolved] (KAFKA-13614) Leader replication quota is applied to consumer fetches

[ https://issues.apache.org/jira/browse/KAFKA-13614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-13614. - Fix Version/s: 3.2.0 Reviewer: David Jacot Resolution: Fixed > Leader

[jira] [Created] (KAFKA-13622) Revisit the complexity of position tracking in state stores

John Roesler created KAFKA-13622: Summary: Revisit the complexity of position tracking in state stores Key: KAFKA-13622 URL: https://issues.apache.org/jira/browse/KAFKA-13622 Project: Kafka

[jira] [Resolved] (KAFKA-13608) Implement Position restoration for all in-memory state stores

[ https://issues.apache.org/jira/browse/KAFKA-13608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler resolved KAFKA-13608. -- Resolution: Duplicate > Implement Position restoration for all in-memory state stores >

[jira] [Resolved] (KAFKA-13524) IQv2: Implement KeyQuery from the RecordCache

[ https://issues.apache.org/jira/browse/KAFKA-13524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler resolved KAFKA-13524. -- Resolution: Fixed > IQv2: Implement KeyQuery from the RecordCache >

Re: State store guarantees - KStreams 2.8.1

Glad you figured it out. It's not easy to perform checks for this case. The problem is that the logic checking topics/partitions does not know anything about the operators that are used -- the DSL semantics are not available at runtime. And the `merge()` operator itself does not have access

Re: permission to create KIP

Done. On 1/26/22 12:52 PM, Vikas Singh wrote: Hi, Sending this mail as per https://cwiki.apache.org/confluence/display/kafka/kafka+improvement+proposals to request permission to be able to create KIP and contribute to AK. confluence wiki id: vikasconfluent jira id: vikasconfluent Thanks,

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #638

See

Re: [DISCUSS] KIP-704: Send a hint to broker if it is an unclean leader

Hey Jose, Thanks for the updates. I noticed that `LeaderRecoveryState` is marked as ignorable in the `AlterPartition` request. It would be helpful to understand the motivation for that. Thanks, Jason On Wed, Jan 26, 2022 at 10:25 AM Colin McCabe wrote: > On Wed, Jan 26, 2022, at 09:14, José

permission to create KIP

Hi, Sending this mail as per https://cwiki.apache.org/confluence/display/kafka/kafka+improvement+proposals to request permission to be able to create KIP and contribute to AK. confluence wiki id: vikasconfluent jira id: vikasconfluent Thanks, Vikas

Re: State store guarantees - KStreams 2.8.1

It's actually my mistake to blame. The whole problem was caused by topic partition count mismatch. I would have expected that at least *merge* operator let's you know when merging two inputs with a mismatching number of partitions. On Sat, 22 Jan 2022 at 03:46, Matthias J. Sax wrote: > Well,

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #637

See

[jira] [Created] (KAFKA-13621) Resign leader on partition

Jose Armando Garcia Sancio created KAFKA-13621: -- Summary: Resign leader on partition Key: KAFKA-13621 URL: https://issues.apache.org/jira/browse/KAFKA-13621 Project: Kafka Issue

[jira] [Created] (KAFKA-13620) The request handler metric name for ControllerApis should be different than KafkaApis

Colin McCabe created KAFKA-13620: Summary: The request handler metric name for ControllerApis should be different than KafkaApis Key: KAFKA-13620 URL: https://issues.apache.org/jira/browse/KAFKA-13620

[VOTE] KIP-704: Send a hint to partition leader to recover the partition

Hi all, I'd like to start a vote on KIP-704: Send a hint to the partition leader to recover the partition. KIP wiki: https://cwiki.apache.org/confluence/x/kAZRCg Discussion thread: https://lists.apache.org/thread/ld2t2xkby7rpgrggqo1h344goddfdnxb Thanks, -José

Re: [DISCUSS] KIP-704: Send a hint to broker if it is an unclean leader

On Wed, Jan 26, 2022, at 09:14, José Armando García Sancio wrote: > Thanks for the feedback Colin. > > Colin wrote: >> We already have many classes that are called "partition state." For example, >> PartitionStates.java on the client side, PartitionStateMachine.scala and >>

Re: [VOTE] KIP-801: Implement an Authorizer that stores metadata in __cluster_metadata

On Wed, Jan 26, 2022, at 01:54, Rajini Sivaram wrote: > Hi Colin, > > Thanks for the KIP. A couple of questions: > > 1) The KIP says: > *However, when the controller is active, its Authorizer state may be > slightly ahead of the the broker's Authorizer state. This will happen in > the time between

Re: [DISCUSS] Broker behaviour when returning records

Hi Luke, Thanks for the answers and pointers to docs! From: show...@gmail.com At: 01/22/22 02:37:59 UTC-5:00To: Megan Niu (BLOOMBERG/ TORONTO ) , dev@kafka.apache.org Subject: Re: [DISCUSS] Broker behaviour when returning records Hi Megan, Answering your questions below: 1. Why can't the

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #636

See

[jira] [Resolved] (KAFKA-13618) BatchAccumulator `Exptected` rename to `Expected`

[ https://issues.apache.org/jira/browse/KAFKA-13618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-13618. Fix Version/s: 3.2.0 Resolution: Fixed > BatchAccumulator `Exptected` rename to

Re: [DISCUSS] KIP-704: Send a hint to broker if it is an unclean leader

Thanks for the feedback Colin. Colin wrote: > We already have many classes that are called "partition state." For example, > PartitionStates.java on the client side, PartitionStateMachine.scala and > TopicPartitionStateZNode in the old controller, > RemotePartitionDeleteState.java under

Re: Proposal to add IBM Power (ppc64le) to apache kafka jenkins CI

Hi Abhijit, Thanks for offering a ppc64le VM. Looking at the INFRA ticket, it looks like it was added to Jenkins successfully. The spec looks appropriate for Kafka builds. Let's wait a few days to see if anybody has questions or concerns. Thanks, Mickael On Mon, Jan 24, 2022 at 11:03 AM

Re: [VOTE] KIP-714: Client Metrics and Observability

+1 I think this KIP solves a problem that has been around for some time with Kafka deployments, which is the ability to assess the current state of a Kafka architecture but looking at the whole picture. I also share other folks' concerns regarding adding runtime dependencies to the clients;

Re: [VOTE] KIP-714: Client Metrics and Observability

Hi all, it's been a while and there's been some more discussions of the KIP which have been addressed on the KIP page. I think it's a good time to revive this vote thread and get things moving. We're currently at +3 (non-binding) and -1 (non-binding) votes. Regards, Magnus Den mån 1 nov.

Re: [DISCUSS] KIP-714: Client metrics and observability

Hi all, I've updated the KIP with responses to the latest comments: Java client dependencies (Thanks Kirk!), alternate designs (separate cluster, separate producer, etc), etc. I will revive the vote thread. Thanks, Magnus Den mån 13 dec. 2021 kl 22:32 skrev Ryanne Dolan : > I think we should

Re: [DISCUSS] KIP-814: Static membership protocol should let the leader skip assignment

Hi Hector, Thanks for your comments. The idea is to add a flag to the onJoinLeader leader method. We must do this because the ConsumerCoordinator must be able to reconstruct its state while skipping the assignment part. That would definitely impact KIP-795. I need to look at your KIP. That's

Re: [DISCUSS] KIP-814: Static membership protocol should let the leader skip assignment

Hey Jason, I've updated the KIP based on your comments. Thanks for your feedback! Best, David On Wed, Jan 26, 2022 at 2:52 AM Jason Gustafson wrote: > > Hey David, > > Yeah, there might not be a simple option to address the scenario I > described. Other than a broker-side solution, another way

[jira] [Created] (KAFKA-13619) zookeeper.sync.time.ms is no longer used

Tomonari Yamashita created KAFKA-13619: -- Summary: zookeeper.sync.time.ms is no longer used Key: KAFKA-13619 URL: https://issues.apache.org/jira/browse/KAFKA-13619 Project: Kafka Issue

Re: [DISCUSS] KIP-787 - MM2 Interface to manage Kafka resources

Hi Omnia, Thanks for the KIP, sorry for taking so long to comment. I've only had time to take a quick look so far. This seems to address a relatively advanced and specific use case. My initial concern is this may make it hard to evolve MirrorMaker as we'll likely need to update this new

[jira] [Created] (KAFKA-13618) BatchAccumulator `Exptected` rename to `Expected`

Kvicii.Yu created KAFKA-13618: - Summary: BatchAccumulator `Exptected` rename to `Expected` Key: KAFKA-13618 URL: https://issues.apache.org/jira/browse/KAFKA-13618 Project: Kafka Issue Type:

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #635

See Changes: -- [...truncated 509983 lines...] [2022-01-26T13:27:00.120Z] org.apache.kafka.streams.integration.EosV2UpgradeIntegrationTest >

Re: [VOTE] KIP-808: Add support for unix epoch precision in TimestampConverter SMT

+1 (binding) Thanks Julien for the KIP! On Wed, Jan 26, 2022 at 12:05 PM Tom Bentley wrote: > > Hi Julien, > > Thanks again for this KIP. +1 (binding). > > Kind regards, > > Tom > > On Tue, 18 Jan 2022 at 08:15, Julien Chanaud > wrote: > > > Hi everyone, > > > > I'd like to start a vote for

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #634

See

Re: [VOTE] KIP-808: Add support for unix epoch precision in TimestampConverter SMT

Hi Julien, Thanks again for this KIP. +1 (binding). Kind regards, Tom On Tue, 18 Jan 2022 at 08:15, Julien Chanaud wrote: > Hi everyone, > > I'd like to start a vote for KIP-808: Add support for unix epoch precision > in TimestampConverter SMT > > https://cwiki.apache.org/confluence/x/GJuqCw

[jira] [Resolved] (KAFKA-9279) Silent data loss in Kafka producer

[ https://issues.apache.org/jira/browse/KAFKA-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-9279. --- Fix Version/s: 3.2.0 Resolution: Fixed > Silent data loss in Kafka producer >

Re: [DISCUSS] KIP-787 - MM2 Interface to manage Kafka resources

Hi, If there are no more concerns regarding the proposal can I get some votes on the KIP here https://lists.apache.org/thread/950lpxjb5kbjm8qdszlpxm9h4j4sfyjx Thanks On Wed, Oct 27, 2021 at 3:54 PM Ryanne Dolan wrote: > Well

Re: [VOTE] KIP-801: Implement an Authorizer that stores metadata in __cluster_metadata

Hi Colin, Thanks for the KIP. A couple of questions: 1) The KIP says: *However, when the controller is active, its Authorizer state may be slightly ahead of the the broker's Authorizer state. This will happen in the time between when a new ACL is created (or deleted) and the time that this

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.1 #70

See Changes: -- [...truncated 502829 lines...] [2022-01-26T09:45:20.058Z] > Task :raft:testClasses UP-TO-DATE [2022-01-26T09:45:20.058Z] > Task :connect:json:testJar

Re: [VOTE] KIP-769: Connect APIs to list all connector plugins and retrieve their configuration definitions

Hi Michael, +1 (non-binding) from me. Viktor On Thu, Jan 13, 2022 at 11:32 AM Mickael Maison wrote: > Bumping this vote. > > We have 2 non-binding votes so far. Please take a look and let me know > if you have any feedback. > > Thanks, > Mickael > > On Mon, Dec 13, 2021 at 10:50 PM Ryanne

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #633

See