[jira] [Created] (KAFKA-14155) Kafka Stream - State transition from RUNNING to ERROR

Harsha Nadig created KAFKA-14155: Summary: Kafka Stream - State transition from RUNNING to ERROR Key: KAFKA-14155 URL: https://issues.apache.org/jira/browse/KAFKA-14155 Project: Kafka Issue

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1130

See

Re: [DISCUSS] KIP-848: The Next Generation of the Consumer Rebalance Protocol

Hello Greg, Thanks for reviewing the KIP! I hope David has addressed your questions above, and I'd like to just emphasize one thing regarding your question 1): one principle of the reconciliation is that, for a single client, before it has completely revoked all the partitions that it should

Re: [DISCUSS] KIP-848: The Next Generation of the Consumer Rebalance Protocol

Thanks Sagar, I made a quick read on your doc, and am also leaning towards having a separate API for connect. Would also love to hear @Randall Hauch @Konstantin 's opinion about that. One thing is that for Kafka Connect, their compatibility story, especially downgrading is more flexible than

Re: [DISCUSS] KIP-857: Streaming recursion in Kafka Streams

Hello Nick, Thanks for bringing this KIP! Just a few thoughts: 1) I agree with Sagar that, we'd probably think about two routes to rephrase / restructure the proposal: * we can propose a couple of new APIs, and just list "more convenient recursion" as one of its benefits. Then we'd need to be

[jira] [Created] (KAFKA-14154) Persistent URP after controller soft failure

Jason Gustafson created KAFKA-14154: --- Summary: Persistent URP after controller soft failure Key: KAFKA-14154 URL: https://issues.apache.org/jira/browse/KAFKA-14154 Project: Kafka Issue

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.3 #28

See Changes: -- [...truncated 568902 lines...] [2022-08-09T22:53:53.565Z] > Task :connect:api:testSrcJar [2022-08-09T22:53:53.565Z] > Task

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1129

See

[jira] [Created] (KAFKA-14153) UnknownTopicOrPartitionException should include the topic/partition in the returned exception message

Alyssa Huang created KAFKA-14153: Summary: UnknownTopicOrPartitionException should include the topic/partition in the returned exception message Key: KAFKA-14153 URL:

Re: TopologyTestDriver and IQv2

Hello Jorge, Thanks for bringing this up. So far we have not updated TopologyTestDriver has not been updated to use the new IQv2. I took a quick look into that and I think it should not be a big task to add. Would you mind creating a ticket for it? As for now, if you want to write tests for

Re: [DISCUSS]: Including TLA+ in the repo

+1 as well. I think adding such proofs in the repo could encourage more people reviewing and challenging it, helping to improve whenever we see fit. Also it helps readers better understand the design patterns. One thing worth noting though is how to make sure the proofs are keep up to date with

[jira] [Created] (KAFKA-14152) Add logic to fence kraft brokers which have fallen behind in replication

Jason Gustafson created KAFKA-14152: --- Summary: Add logic to fence kraft brokers which have fallen behind in replication Key: KAFKA-14152 URL: https://issues.apache.org/jira/browse/KAFKA-14152

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #1128

See

Re: [VOTE] KIP-837 Allow MultiCasting a Result Record.

+1 (non binding) Walker On Tue, May 31, 2022 at 4:44 AM Sagar wrote: > Hi All, > > I would like to start a voting thread on > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=211883356 > . > > I am just starting this as the discussion thread has been open for 10+ > days. In

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.3 #27

See Changes: -- [...truncated 488392 lines...] [2022-08-09T18:37:06.308Z] org.apache.kafka.streams.processor.internals.StreamsAssignmentScaleTest >

Re: [DISCUSS] KIP-837 Allow MultiCasting a Result Record.

Thanks for updating! I looked over the changes and I think it's good. Walker On Tue, Aug 9, 2022 at 5:44 AM Sagar wrote: > Hello All, > > Bumping this one again to see if folks have any other > comments/observations. > > Thanks! > Sagar. > > On Wed, Jul 27, 2022 at 4:03 PM Sagar wrote: > > >

Re: [DISCUSS] KIP-862: Implement self-join optimization

Hello Vicky, Thanks for the KIP! I made a quick pass and here are some quick thoughts: 1. Store Implementation: this may be not directly related to the KIP itself since its all internal, but the stream-stream join state store implementation has been changed in

Re: [VOTE] KIP-854 Separate configuration for producer ID expiry

Hi Justine, Thanks again for the KIP, +1 (binding). On Tue, 9 Aug 2022 at 18:09, Jason Gustafson wrote: > Thanks Justine, +1 from me. > > On Tue, Aug 9, 2022 at 1:12 AM Sagar wrote: > > > Thanks for the KIP. > > > > +1(non-binding) > > > > Sagar. > > > > On Tue, Aug 9, 2022 at 1:13 PM David

[jira] [Created] (KAFKA-14151) Add additional validation to protect on-disk log segment data from being corrupted

Vincent Jiang created KAFKA-14151: - Summary: Add additional validation to protect on-disk log segment data from being corrupted Key: KAFKA-14151 URL: https://issues.apache.org/jira/browse/KAFKA-14151

Re: Kafka 事务实现咨询

此外，这一段 scala code 可能有点难理解的地方就是在一个function里面定义了很多其他的function，比如“ sendTxnMarkersCallback”，但是这段callback并不是立刻被执行的，而只是在此定义而已。它真正被执行的地方是在 txnManager.appendTransactionToLog 之后，也就是当这个record被成功append并且备份之后作为callback才会被执行。其他还有好几个地方都有类似的design pattern，可能刚开始看的时候会误解。 国璋 On Tue, Aug 9, 2022 at 10:28 AM

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1127

See Changes: -- [...truncated 500893 lines...] [2022-08-09T17:03:39.065Z] IQv2IntegrationTest > shouldNotRequireQueryHandler(TestInfo) PASSED [2022-08-09T17:03:39.065Z]

Re: [VOTE] KIP-854 Separate configuration for producer ID expiry

Thanks Justine, +1 from me. On Tue, Aug 9, 2022 at 1:12 AM Sagar wrote: > Thanks for the KIP. > > +1(non-binding) > > Sagar. > > On Tue, Aug 9, 2022 at 1:13 PM David Jacot > wrote: > > > Thanks for the KIP, Justine. The proposal makes sense to me. I am +1 > > (binding). > > > > Cheers, > >

[GitHub] [kafka-site] guozhangwang commented on pull request #434: Update my entry to include PMC membership

guozhangwang commented on PR #434: URL: https://github.com/apache/kafka-site/pull/434#issuecomment-1209614487 LGTM! Merged to trunk. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [kafka-site] guozhangwang merged pull request #434: Update my entry to include PMC membership

guozhangwang merged PR #434: URL: https://github.com/apache/kafka-site/pull/434 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Resolved] (KAFKA-14144) AlterPartition is not idempotent when requests time out

[ https://issues.apache.org/jira/browse/KAFKA-14144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-14144. - Resolution: Fixed > AlterPartition is not idempotent when requests time out >

Re: [DISCUSS] KIP-848: The Next Generation of the Consumer Rebalance Protocol

Hi Gregory, Thanks for your feedback. Please find my answers below. > 1. The 'Rejected Alternatives' section describes how member epoch should > advance in step with the group epoch and assignment epoch values. I think > that this is a good idea for the reasons described in the KIP. When the >

Re: [DISCUSS] KIP-731: Record Rate Limiting for Kafka Connect

Thanks Mickael. > 1) if you set rate.limiters to MyRateLimiter you would > not have to set these 2 configs. > True. That may be motivation to adopt Tom's suggestion re config. > 2) Should we have a > ByteRateLimiter? > That would be ideal, but it is difficult in practice, since ConnectRecord

Re: [DISCUSS] KIP-848: The Next Generation of the Consumer Rebalance Protocol

Hi Luke, Thanks for your comments. Please find my answers below. > 1. Will the member reconciling jump to the latest target assignment? For > example, member epoch are A:1, B:2, but now the group is in target > assignment epoch 4. Will the members jump to the target assignment result > in epoch

Re: [DISCUSS] KIP-848: The Next Generation of the Consumer Rebalance Protocol

Hi Sagar, Thanks for the feedback and the document. That's really helpful. I will take a look at it. Overall, it seems to me that both Connect and the Consumer could share the same underlying "engine". The main difference is that the Consumer assigns topic-partitions to members whereas Connect

Re: [DISCISS] KIP-860: Add client-provided option to guard against unintentional replication factor change during partition reassignments

Throwing an UnsupportedVersionException with an appropriate message seems to be the best option when the new API is not supported and AllowReplicationFactorChange is not set to the default value. Cheers, David On Mon, Aug 8, 2022 at 6:25 PM Vikas Singh wrote: > > I personally like the UVE

Re: [DISCUSS] KIP-731: Record Rate Limiting for Kafka Connect

Hi Ryanne, Thanks for the KIP! Sorry for the delay, I finally took some time to take a look and I have a few questions: 1) record.rate.limit, record.batch.rate.limit are listed as Connector configurations. If I understand correctly they are actually configurations of RecordRateLimiter, and

Re: [DISCUSS] KIP-837 Allow MultiCasting a Result Record.

Hello All, Bumping this one again to see if folks have any other comments/observations. Thanks! Sagar. On Wed, Jul 27, 2022 at 4:03 PM Sagar wrote: > Thanks Walker for the comments > > I have updated the KIP with all the suggestions. > > Thanks! > > On Tue, Jul 12, 2022 at 10:59 PM Walker

Re: [VOTE] KIP-731: Record Rate Limiting for Kafka Connect

Hey Ryanne, Bumping this thread again! Thanks! Sagar. On Mon, Aug 1, 2022 at 10:43 PM Sagar wrote: > Also, should we look to reopen the discussion/voting thread to see if the > community's opinions have changed? > > Sagar. > > On Mon, Aug 1, 2022 at 10:42 PM Sagar wrote: > >> Thanks Ryanne,

[jira] [Created] (KAFKA-14150) Allocation of initial partitions is deterministic and produces a leader bias when a broker is offline

David Buckley created KAFKA-14150: - Summary: Allocation of initial partitions is deterministic and produces a leader bias when a broker is offline Key: KAFKA-14150 URL:

Re: [ANNOUNCE] New Kafka PMC Member: A. Sophie Blee-Goldman

Congrats, Sophie! -- Best, Ziming > On Aug 9, 2022, at 3:20 PM, Bruno Cadonna wrote: > > Congrats, Sophie!

Re: [DISCUSS] KIP-858: Handle JBOD broker disk failure in KRaft

Hi, Igor, Thanks for this great work, left some questions, 1. We have a version field in meta.properties, currently it’s 1, and we can set it to 2 in this KIP, and we can give an example of server.properties and it’s corresponding meta.properties generated by the storage command tool. 2. When

Re: Hosting Kafka Videos on ASF YouTube channel

Hi, I checked the four Streams videos (https://kafka.apache.org/32/documentation/streams/), they are good and don't mention any vendors. +1 (binding) for these four videos For the last video (https://kafka.apache.org/intro and https://kafka.apache.org/quickstart) we will have to wait till the

Re: [VOTE] KIP-854 Separate configuration for producer ID expiry

Thanks for the KIP. +1(non-binding) Sagar. On Tue, Aug 9, 2022 at 1:13 PM David Jacot wrote: > Thanks for the KIP, Justine. The proposal makes sense to me. I am +1 > (binding). > > Cheers, > David > > On Mon, Aug 8, 2022 at 6:18 PM Justine Olshan > wrote: > > > > Hi all, > > I'd like to

Re: [VOTE] KIP-854 Separate configuration for producer ID expiry

Thanks for the KIP, Justine. The proposal makes sense to me. I am +1 (binding). Cheers, David On Mon, Aug 8, 2022 at 6:18 PM Justine Olshan wrote: > > Hi all, > I'd like to start a vote for KIP-854: Separate configuration for producer > ID expiry. > > KIP: >

Re: [ANNOUNCE] New Kafka PMC Member: A. Sophie Blee-Goldman

Congrats, Sophie! Bruno On 03.08.22 21:26, Jeremy Custenborder wrote: Congrats Sophie! On Wed, Aug 3, 2022 at 9:25 AM David Arthur wrote: Well done! Congrats! -David On Wed, Aug 3, 2022 at 9:48 AM Sagar wrote: Congratulations Sophie ! On Wed, 3 Aug 2022 at 6:37 PM, José Armando