[jira] [Created] (KAFKA-15958) Add tests to validate telemetry requests with different version

2023-12-01 Thread Apoorv Mittal (Jira)
Apoorv Mittal created KAFKA-15958: - Summary: Add tests to validate telemetry requests with different version Key: KAFKA-15958 URL: https://issues.apache.org/jira/browse/KAFKA-15958 Project: Kafka

Re: fine-gained acls

2023-12-01 Thread Haruki Okada
Hi. KafkaConsumer can subscribe to topics by pattern: https://kafka.apache.org/36/javadoc/org/apache/kafka/clients/consumer/Consumer.html#subscribe(java.util.regex.Pattern) 2023年12月1日(金) 22:05 Chunlin Yang : > Hi team, > > My use case is I have a central controller to manage tens of thousands

[jira] [Created] (KAFKA-15957) ConsistencyVectorIntegrationTest.shouldHaveSamePositionBoundActiveAndStandBy broken

2023-12-01 Thread Justine Olshan (Jira)
Justine Olshan created KAFKA-15957: -- Summary: ConsistencyVectorIntegrationTest.shouldHaveSamePositionBoundActiveAndStandBy broken Key: KAFKA-15957 URL: https://issues.apache.org/jira/browse/KAFKA-15957

[jira] [Created] (KAFKA-15956) MetadataShell must take the directory lock when reading

2023-12-01 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-15956: Summary: MetadataShell must take the directory lock when reading Key: KAFKA-15956 URL: https://issues.apache.org/jira/browse/KAFKA-15956 Project: Kafka

Re: [DISCUSS] KIP-994: Minor Enhancements to ListTransactions and DescribeTransactions APIs

2023-12-01 Thread Jun Rao
Hi, Raman, Thanks for the KIP. A couple of comments. 10. From the discussion of KIP-951, it seems that our convention is to always bump up the request version even for just adding tagged fields in the response. 11. "In case a new AdminClient is sending durationFilter (greater than 0) to an

Re: [VOTE] 3.6.1 RC0

2023-12-01 Thread Bill Bejeck
Hi Mickael, I did the following: 1. Validated all checksums, signatures, and hashes 2. Built from source 3. Ran all the unit tests 4. Spot checked the documentation and Javadoc 5. Ran the ZK, Kraft, and Kafka Streams quickstart guides I did notice that the `fillDotVersion` in

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2439

2023-12-01 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.6 #123

2023-12-01 Thread Apache Jenkins Server
See Changes: -- [...truncated 310028 lines...] > Task :connect:json:testJar > Task :connect:json:copyDependantLibs UP-TO-DATE > Task :connect:api:compileTestJava UP-TO-DATE >

Re: [DISCUSS] KIP-969: Support range interactive queries for versioned state stores

2023-12-01 Thread Alieh Saeedi
Hi all, I updated the KIP based on the changes made in the former KIP (KIP-968). So with the `ResultOrder` enum, the class `MultiVersionedRangeQuery` had some changes both in the defined fields and defined methods. Based on the PoC PR, what we currently promise in the KIP about ordering seems

[VOTE] KIP-939: Support Participation in 2PC

2023-12-01 Thread Artem Livshits
Hello, This is a voting thread for https://cwiki.apache.org/confluence/display/KAFKA/KIP-939%3A+Support+Participation+in+2PC . The KIP proposes extending Kafka transaction support (that already uses 2PC under the hood) to enable atomicity of dual writes to Kafka and an external database, and

Re: [VOTE] 3.6.1 RC0

2023-12-01 Thread Justine Olshan
I've started a system test run on my end. Justine On Wed, Nov 29, 2023 at 1:55 PM Justine Olshan wrote: > I built from source and ran a simple transactional produce bench. I ran a > handful of unit tests as well. > I scanned the docs and everything looked reasonable. > > I was wondering if we

Re: [DISCUSS] KIP-988 Streams Standby Task Update Listener

2023-12-01 Thread Matthias J. Sax
Thanks for clarifying. Makes sense to me. On 11/30/23 8:33 PM, Colt McNealy wrote: Hi Matthias and everyone— Some clarification is necessary just for posterity. It turns out that, on a fresh standby task before we start polling for records, we wouldn't be able to get the current end offset

[jira] [Reopened] (KAFKA-9545) Flaky Test `RegexSourceIntegrationTest.testRegexMatchesTopicsAWhenDeleted`

2023-12-01 Thread Apoorv Mittal (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apoorv Mittal reopened KAFKA-9545: -- Assignee: (was: Boyang Chen) > Flaky Test

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2438

2023-12-01 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-15955) Migrating ZK brokers send dir assignments

2023-12-01 Thread Igor Soarez (Jira)
Igor Soarez created KAFKA-15955: --- Summary: Migrating ZK brokers send dir assignments Key: KAFKA-15955 URL: https://issues.apache.org/jira/browse/KAFKA-15955 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-15954) Review minimal effort approach on consumer last heartbeat on unsubscribe

2023-12-01 Thread Lianet Magrans (Jira)
Lianet Magrans created KAFKA-15954: -- Summary: Review minimal effort approach on consumer last heartbeat on unsubscribe Key: KAFKA-15954 URL: https://issues.apache.org/jira/browse/KAFKA-15954

[jira] [Created] (KAFKA-15953) Refactor polling delays

2023-12-01 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-15953: Summary: Refactor polling delays Key: KAFKA-15953 URL: https://issues.apache.org/jira/browse/KAFKA-15953 Project: Kafka Issue Type: Sub-task

[jira] [Resolved] (KAFKA-15890) Consumer.poll with long timeout unaware of assigned partitions

2023-12-01 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-15890. -- Resolution: Fixed > Consumer.poll with long timeout unaware of assigned partitions >

[jira] [Resolved] (KAFKA-15842) Correct handling of KafkaConsumer.committed for new consumer

2023-12-01 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-15842. -- Resolution: Fixed > Correct handling of KafkaConsumer.committed for new consumer >

Re: [DISCUSS] KIP-994: Minor Enhancements to ListTransactions and DescribeTransactions APIs

2023-12-01 Thread Raman Verma
Thanks Kirk, I have made the changes you mentioned. Regarding these questions 3. Is the TransactionStartTimeMs return value in the DescribeTransactionsResponse nullable? Broker can send a value less than zero but not null. 5. What happens when a user runs the updated kafka-transactions.sh script

Produce GenericRecord in Kafka Topic

2023-12-01 Thread Shivam Dongre
Hello Dev Community, I have a use case where I need to stream data to Google BigQuery. Therefore, I'm producing data to a Kafka Topic and using Confluent Kafka BigQuery Sink Connector to sink data from Kafka Topic to BigQuery Table. Currently, I'm using this method and it works well for our use

Re: [DISCUSS] KIP-994: Minor Enhancements to ListTransactions and DescribeTransactions APIs

2023-12-01 Thread Raman Verma
Thanks Artem, I have made the changes to the KIP as specified. I think I will start a Vote on the KIP tomorrow.

fine-gained acls

2023-12-01 Thread Chunlin Yang
Hi team, My use case is I have a central controller to manage tens of thousands of clusters. Each cluster can receive and send the message via Kafka. but each cluster can only consume its own message. The controller can consume all the messages from each cluster. I checked the Kafka document and

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2437

2023-12-01 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-15952) Create public doc for telemetry state transition

2023-12-01 Thread Apoorv Mittal (Jira)
Apoorv Mittal created KAFKA-15952: - Summary: Create public doc for telemetry state transition Key: KAFKA-15952 URL: https://issues.apache.org/jira/browse/KAFKA-15952 Project: Kafka Issue