Re: [VOTE] KIP-953: partition method to be overloaded to accept headers as well.

2023-08-22 Thread Jack Tomy
Hi Ismael, That would be totally different from the pattern currently being followed in all the interfaces, for example serializer. I personally don't favour that either. Let's see if the community has any opinions on the same. Hey everyone, please share your thoughts on using a DTO instead of

Re: [DISCUSS] KIP-939: Support Participation in 2PC

2023-08-22 Thread Roger Hoover
Artem, Thanks for the reply. If I understand correctly, Kafka does not support concurrent transactions from the same producer (transactional id). I think this means that applications that want to support in-process concurrency (say thread-level concurrency with row-level DB locking) would need

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2130

2023-08-22 Thread Apache Jenkins Server
See Changes: -- [...truncated 304607 lines...] Gradle Test Run :core:test > Gradle Test Executor 93 > ZkMigrationClientTest > testUpdateExistingPartitions() STARTED

[jira] [Created] (KAFKA-15393) MirrorMaker2 integration tests are shutting down uncleanly

2023-08-22 Thread Greg Harris (Jira)
Greg Harris created KAFKA-15393: --- Summary: MirrorMaker2 integration tests are shutting down uncleanly Key: KAFKA-15393 URL: https://issues.apache.org/jira/browse/KAFKA-15393 Project: Kafka

Re: [DISCUSS] KIP-939: Support Participation in 2PC

2023-08-22 Thread Artem Livshits
Hi Roger, Arjun, Thank you for the questions. > It looks like the application must have stable transactional ids over time? The transactional id should uniquely identify a producer instance and needs to be stable across the restarts. If the transactional id is not stable across restarts, then

[jira] [Created] (KAFKA-15392) RestServer starts but does not stop ServletContextHandler

2023-08-22 Thread Greg Harris (Jira)
Greg Harris created KAFKA-15392: --- Summary: RestServer starts but does not stop ServletContextHandler Key: KAFKA-15392 URL: https://issues.apache.org/jira/browse/KAFKA-15392 Project: Kafka

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2129

2023-08-22 Thread Apache Jenkins Server
See Changes: -- [...truncated 307524 lines...] Gradle Test Run :core:test > Gradle Test Executor 90 > ZkMigrationClientTest > testUpdateExistingPartitions() STARTED

[jira] [Resolved] (KAFKA-15213) Provide the exact offset to QuorumController.replay

2023-08-22 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-15213. -- Fix Version/s: 3.6.0 Resolution: Fixed > Provide the exact offset to

Re: [DISCUSS] KIP-910: Update Source offsets for Source Connectors without producing records

2023-08-22 Thread Yash Mayya
Hi Sagar, Thanks for the updates and apologies for the delayed response. > Hmm the question is how do you qualify a > partition as stale or old? Let's say a connector > has implemented updateOffsets and for a certain > partition for which no records are received then it > will update it's

Requesting permissions to contribute to Apache Kafka

2023-08-22 Thread Animesh Kumar
Hi Team, Please provide access to contribute to Apache Kafka JIRA id -- akanimesh7 Wiki Id -- akanimesh7 -- Animesh Kumar 8120004556

Re: [DISCUSS] KIP-970: Deprecate and remove Connect's redundant task configurations endpoint

2023-08-22 Thread Chris Egerton
Hi Yash, Thanks for driving this, and for putting out a well-written KIP. LGTM! Cheers, Chris On Tue, Aug 22, 2023 at 6:13 AM Yash Mayya wrote: > Hi all, > > I'd like to start a discussion thread for this KIP - > >

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2128

2023-08-22 Thread Apache Jenkins Server
See Changes: -- [...truncated 306231 lines...] Gradle Test Run :core:test > Gradle Test Executor 93 > ZooKeeperClientTest > testConnectionViaNettyClient() PASSED Gradle

[jira] [Created] (KAFKA-15391) Delete topic may lead to directory offline

2023-08-22 Thread Divij Vaidya (Jira)
Divij Vaidya created KAFKA-15391: Summary: Delete topic may lead to directory offline Key: KAFKA-15391 URL: https://issues.apache.org/jira/browse/KAFKA-15391 Project: Kafka Issue Type: Bug

Re: [REVIEW REQUEST] Move ReassignPartitionsCommandArgsTest to java

2023-08-22 Thread Николай Ижиков
Hello. Please, join the simple review) We have few steps left to completely rewrite ReassignPartitionsCommand in java. > 17 авг. 2023 г., в 17:16, Николай Ижиков написал(а): > > Hello. > > I’m working on [1]. > The goal of ticket is to rewire `ReassignPartitionCommand` in java. > > The PR

[DISCUSS] KIP-970: Deprecate and remove Connect's redundant task configurations endpoint

2023-08-22 Thread Yash Mayya
Hi all, I'd like to start a discussion thread for this KIP - https://cwiki.apache.org/confluence/display/KAFKA/KIP-970%3A+Deprecate+and+remove+Connect%27s+redundant+task+configurations+endpoint . It proposes the deprecation and eventual removal of Kafka Connect's redundant task configurations

Re: [DISCUSS] KIP-939: Support Participation in 2PC

2023-08-22 Thread Arjun Satish
Hello Artem, Thanks for the KIP. I have the same question as Roger on concurrent writes, and an additional one on consumer behavior. Typically, transactions will timeout if not committed within some time interval. With the proposed changes in this KIP, consumers cannot consume past the ongoing