Re: [DISCUSS] Apache Kafka 3.4.1 release

Hi José, Thanks for the reminder. Yes, I did miss that. Already updated and pushed. Thanks. Luke On Wed, Aug 9, 2023 at 8:08 AM José Armando García Sancio wrote: > Hey Luke, > > Thanks for working on the release for 3.4.1. I was working on some > cherry picks and I noticed that branch 3.4

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2082

See

Re: [DISCUSS] KIP-960: Support interactive queries (IQv2) for versioned state stores

Seems there was a lot of additional feedback. Looking forward to an updated version of the KIP. I also agree to make the queries more composable. I was considering to raise this originally, but hold off because `RangeQuery` is also not designed very composable. But for versioned store, we

[GitHub] [kafka-site] lbradstreet commented on a diff in pull request #537: MINOR: Add Lucas Bradstreet to committers

lbradstreet commented on code in PR #537: URL: https://github.com/apache/kafka-site/pull/537#discussion_r1289395022 ## committers.html: ## @@ -552,6 +552,13 @@ The committers https://github.com/gharris1727/;>github.com/gharris1727

[GitHub] [kafka-site] jolshan commented on a diff in pull request #537: MINOR: Add Lucas Bradstreet to committers

jolshan commented on code in PR #537: URL: https://github.com/apache/kafka-site/pull/537#discussion_r1289372410 ## committers.html: ## @@ -552,6 +552,13 @@ The committers https://github.com/gharris1727/;>github.com/gharris1727

[GitHub] [kafka-site] lbradstreet opened a new pull request, #537: MINOR: Add Lucas Bradstreet to committers

lbradstreet opened a new pull request, #537: URL: https://github.com/apache/kafka-site/pull/537 I recently became a committer https://projects.apache.org/committee.html?kafka. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [DISCUSS] KIP-955: Add stream-table join on foreign key

Thanks for the details. And sorry for being a little bit picky. My goal is to really understand the use-case and the need for this KIP. It's a massive change and I just want to ensure we don't add (complex) things unnecessarily. So you have a streams of "orderEvents" with key=orderId. You

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.5 #56

See Changes: -- [...truncated 189429 lines...] > Task :connect:json:publishToMavenLocal > Task :connect:api:javadocJar > Task :connect:api:compileTestJava UP-TO-DATE > Task

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2081

See

Re: [DISCUSS] KIP-962 Relax non-null key requirement in Kafka Streams

Thanks for the KIP. left join KStream-GlobalTable: no longer drop left records with null-key and call KeyValueMapper with 'null' for left key. The case where KeyValueMapper returns null is already handled in the current implementation. Not sure if this is the right phrasing? In the end,

[jira] [Resolved] (KAFKA-14831) Illegal state errors should be fatal in transactional producer

[ https://issues.apache.org/jira/browse/KAFKA-14831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True resolved KAFKA-14831. --- Resolution: Fixed > Illegal state errors should be fatal in transactional producer >

Re: [VOTE] KIP-714: Client metrics and observability

-1, non-binding, for reasons previously stated. Ryanne On Fri, Aug 4, 2023, 3:46 AM Andrew Schofield < andrew_schofield_j...@outlook.com> wrote: > Hi, > After almost 2 1/2 years in the making, I would like to call a vote for > KIP-714 ( >

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2080

See Changes: -- [...truncated 384979 lines...] Gradle Test Run :streams:integrationTest > Gradle Test Executor 179 > TaskMetadataIntegrationTest >

[jira] [Created] (KAFKA-15327) Async consumer should commit offsets on close

Lianet Magrans created KAFKA-15327: -- Summary: Async consumer should commit offsets on close Key: KAFKA-15327 URL: https://issues.apache.org/jira/browse/KAFKA-15327 Project: Kafka Issue

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.4 #157

See Changes: -- [...truncated 439354 lines...] Gradle Test Run :core:integrationTest > Gradle Test Executor 167 > KafkaZkClientTest > testGetDataAndStat() PASSED Gradle

[jira] [Created] (KAFKA-15326) Decouple Processing Thread from Polling Thread

Lucas Brutschy created KAFKA-15326: -- Summary: Decouple Processing Thread from Polling Thread Key: KAFKA-15326 URL: https://issues.apache.org/jira/browse/KAFKA-15326 Project: Kafka Issue

Re: [VOTE] KIP-714: Client metrics and observability

Hi Andrew, +1 (non-binding) This is a huge step in enabling end-to-end observability for users and hopefully even help us get a better idea where we can improvement the client behavior. And +100 re: librdkafka team involvement. Thanks! > On Aug 8, 2023, at 4:00 AM, Milind Luthra > wrote:

Re: [VOTE] KIP-858: Handle JBOD broker disk failure in KRaft

Hi Igor, Thanks for the KIP, adding JBOD support to KRaft is really important. I see 2 different metric names mentioned "QueuedReplicaToDirAssignments" and "NumMismatchingReplicaToLogDirAssignments". From the descriptions it seems it's the same metric, can you clarify which name you propose

[jira] [Resolved] (KAFKA-15298) Disable DeleteRecords on Tiered Storage topics

[ https://issues.apache.org/jira/browse/KAFKA-15298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christo Lolov resolved KAFKA-15298. --- Resolution: Won't Fix > Disable DeleteRecords on Tiered Storage topics >

[jira] [Resolved] (KAFKA-15100) Unsafe to call tryCompleteFetchResponse on request timeout

[ https://issues.apache.org/jira/browse/KAFKA-15100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] José Armando García Sancio resolved KAFKA-15100. Resolution: Fixed > Unsafe to call tryCompleteFetchResponse on

RE: Re: [DISCUSS] KIP-960: Support interactive queries (IQv2) for versioned state stores

Hey Alieh, Thanks for the KIP! It looks like the KIP proposes three different types of interactive queries for versioned stores, though they are grouped together into two classes: VersionedKeyQuery adds supports for single-key, single-timestamp lookups, and also for single-key,

[jira] [Created] (KAFKA-15325) Integrate topicId in OffsetFetch and OffsetCommit async consumer calls

Lianet Magrans created KAFKA-15325: -- Summary: Integrate topicId in OffsetFetch and OffsetCommit async consumer calls Key: KAFKA-15325 URL: https://issues.apache.org/jira/browse/KAFKA-15325 Project:

Re: [DISCUSS] KIP-963: Upload and delete lag metrics in Tiered Storage

Heya Kamal, Thank you for going through the KIP and for the question! I have been thinking about this and as an operator I might find it the most useful to know all three of them actually. I would find knowing the size in bytes useful to determine how much disk I might need to add temporarily

Re: [DISCUSS] KIP-962 Relax non-null key requirement in Kafka Streams

Hi All, I added a remark about the repartition of null-key records. https://cwiki.apache.org/confluence/display/KAFKA/KIP-962%3A+Relax+non-null+key+requirement+in+Kafka+Streams#KIP962:RelaxnonnullkeyrequirementinKafkaStreams-Repartitionofnull-keyrecords Can we relax this constraint for any kind

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2079

See

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.4 #156

See

Re: [DISCUSS] KIP-960: Support interactive queries (IQv2) for versioned state stores

Hi, I will use the initials of the authors to distinguish the points. LB 2. I like the idea of composable construction of queries. It would make the API more readable. I think this is better than the VersionsQualifier, I proposed in BC 3.. LB 4. and LB 5. Being explicit on the time bounds

[jira] [Reopened] (KAFKA-14595) Move ReassignPartitionsCommand to tools

[ https://issues.apache.org/jira/browse/KAFKA-14595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison reopened KAFKA-14595: > Move ReassignPartitionsCommand to tools > --- > >

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.5 #55

See Changes: -- [...truncated 281194 lines...] Gradle Test Run :core:integrationTest > Gradle Test Executor 174 > ZkMigrationClientTest > testCreateNewTopic() STARTED

Re: [QUESTION] What is the difference between sequence and offset for a Record?

Thanks for your reply! I may not use "normalization". What I want to refer to is: appendInfo.setLastOffset(offset.value - 1) which underneath updates the base offset field (in record batch) but not the offset delta of each record. Best, tison. Justine Olshan 于2023年8月8日周二 00:43写道： > The

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.3 #185

See Changes: -- [...truncated 357112 lines...] Please consult deprecation warnings for more details. BUILD SUCCESSFUL in 29s 79 actionable tasks: 33 executed, 46 up-to-date