Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2673

2024-02-23 Thread Apache Jenkins Server
See

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2672

2024-02-23 Thread Apache Jenkins Server
See

[DISCUSS] Uninitialized metadata cache during broker startup

2024-02-23 Thread Chris Wildman
Hi All, I recently discovered the race condition where Kafka clients may request metadata from brokers who have not yet received a snapshot of the cluster metadata. At scale with ZK managed clusters we see this happen frequently when brokers are restarted, possibly due to the admin client's

Re: [DISCUSS] KIP-853: KRaft Controller Membership Changes

2024-02-23 Thread Jun Rao
Hi, Jose, Thanks for the reply. 15. VotersRecord: Ok. I got the need for including the listener name in the endpoint. Currently, controller.quorum.voters can only specify one endpoint per voter. So, we can only support one listener. It's fine if we want to extend that in this KIP. 15.1 "In this

Re: [DISCUSS] KIP-966: Eligible Leader Replicas

2024-02-23 Thread José Armando García Sancio
Hi Calvin On Fri, Feb 23, 2024 at 9:23 AM Calvin Liu wrote: > As we agreed to implement the pagination for the new API > DescribeTopicPartitions, the client side must also add a proper interface > to handle the pagination. > The current KafkaAdminClient.describeTopics returns > the

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2671

2024-02-23 Thread Apache Jenkins Server
See

Re: [PR] 3.7: Add blog post for Kafka 3.7 [kafka-site]

2024-02-23 Thread via GitHub
pprovenzano commented on code in PR #578: URL: https://github.com/apache/kafka-site/pull/578#discussion_r1501132621 ## blog.html: ## @@ -22,6 +22,125 @@ Blog + + + +Apache

Re: [DISCUSS] KIP-853: KRaft Controller Membership Changes

2024-02-23 Thread José Armando García Sancio
Jun, I updated one of the rejected ideas to better explain why KRaft can't rely on information stored by the metadata layer. Thanks, -- -José

Re: [DISCUSS] KIP-966: Eligible Leader Replicas

2024-02-23 Thread Andrew Schofield
This is an interesting problem. While it would be possible to use a Consumer, it can’t handle exceptions really. A java.util.Stream has a similar problem. I wonder whether an interface which looks like java.util.concurrent.Flow.Subscriber would be good. Something like: public interface

Re: [DISCUSS] KIP-966: Eligible Leader Replicas

2024-02-23 Thread David Arthur
Thanks for raising this here, Calvin. Since this is the first "streaming results" type API in KafkaAdminClient (as far as I know), we're treading new ground here. As you mentioned, we can either accept a consumer or return some iterable result. Returning a java.util.Stream is also an option, and

Re: [DISCUSS] KIP-966: Eligible Leader Replicas

2024-02-23 Thread Calvin Liu
Hey, As we agreed to implement the pagination for the new API DescribeTopicPartitions, the client side must also add a proper interface to handle the pagination. The current KafkaAdminClient.describeTopics returns the DescribeTopicsResult which is the future for querying all the topics. It is

Re: [DISCUSS] KIP-939: Support Participation in 2PC

2024-02-23 Thread Jun Rao
Hi, Artem, Thanks for the reply. For 3b, it would be useful to understand the reason why an admin doesn't authorize 2PC for self-hosted Flink. Is the main reason that 2PC has unbounded timeout that could lead to unbounded outstanding transactions? If so, another way to address that is to allow

[jira] [Created] (KAFKA-16304) Disk I/O error does not offline log directory while handling Fetch requests

2024-02-23 Thread Gaurav Narula (Jira)
Gaurav Narula created KAFKA-16304: - Summary: Disk I/O error does not offline log directory while handling Fetch requests Key: KAFKA-16304 URL: https://issues.apache.org/jira/browse/KAFKA-16304

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2670

2024-02-23 Thread Apache Jenkins Server
See

Re: [VOTE] 3.7.0 RC4

2024-02-23 Thread Stanislav Kozlovski
Some quick updates: There were some inconsistencies between the documentation in the apache/kafka repo and the one in kafka-site. The process is such that the apache/kafka docs are the source of truth, but we had a few divergences in the other repo. I have worked on correcting those with: -

Re: [PR] MINOR: Update stale `upgrade_3_6_0` header links in documentation [kafka-site]

2024-02-23 Thread via GitHub
stanislavkozlovski commented on PR #580: URL: https://github.com/apache/kafka-site/pull/580#issuecomment-1961103486 This will be done with https://github.com/apache/kafka-site/pull/586/files -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [PR] MINOR: Update stale `upgrade_3_6_0` header links in documentation [kafka-site]

2024-02-23 Thread via GitHub
stanislavkozlovski closed pull request #580: MINOR: Update stale `upgrade_3_6_0` header links in documentation URL: https://github.com/apache/kafka-site/pull/580 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] 3.7: Add blog post for Kafka 3.7 [kafka-site]

2024-02-23 Thread via GitHub
stanislavkozlovski commented on code in PR #578: URL: https://github.com/apache/kafka-site/pull/578#discussion_r1500491362 ## blog.html: ## @@ -22,6 +22,125 @@ Blog + + + +

Re: [PR] 37: Add latest apache/kafka/3.7 site-docs [kafka-site]

2024-02-23 Thread via GitHub
divijvaidya commented on code in PR #587: URL: https://github.com/apache/kafka-site/pull/587#discussion_r1500467325 ## 37/generated/admin_client_config.html: ## @@ -304,7 +304,7 @@

[PR] Fixed links to Streams Developer Guide subpages [kafka-site]

2024-02-23 Thread via GitHub
thuri opened a new pull request, #588: URL: https://github.com/apache/kafka-site/pull/588 As it seems the Developer Guide page has been changed for Version 1.0.x and sections for "Streams DSL", "Processor API" and "Interactive Queries" got new, separate pages. But some links have

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2669

2024-02-23 Thread Apache Jenkins Server
See

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.7 #101

2024-02-23 Thread Apache Jenkins Server
See