[jira] [Created] (KAFKA-16582) Feature Request: Introduce max.record.size Configuration Parameter for Producers

2024-04-17 Thread Ramiz Mehran (Jira)
Ramiz Mehran created KAFKA-16582: Summary: Feature Request: Introduce max.record.size Configuration Parameter for Producers Key: KAFKA-16582 URL: https://issues.apache.org/jira/browse/KAFKA-16582

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2823

2024-04-17 Thread Apache Jenkins Server
See Changes: -- [...truncated 349676 lines...] [2024-04-18T03:36:13.801Z] [2024-04-18T03:36:13.801Z] Gradle Test Run :streams:test > Gradle Test Executor 94 >

Re: [PR] KAFKA-16467: Add how to integrate with kafka repo [kafka-site]

2024-04-17 Thread via GitHub
showuon merged PR #596: URL: https://github.com/apache/kafka-site/pull/596 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Created] (KAFKA-16581) Implement KafkaRaftClient unittest for membership change

2024-04-17 Thread Jira
José Armando García Sancio created KAFKA-16581: -- Summary: Implement KafkaRaftClient unittest for membership change Key: KAFKA-16581 URL: https://issues.apache.org/jira/browse/KAFKA-16581

[jira] [Created] (KAFKA-16580) Write simulation tests for kraft membership change

2024-04-17 Thread Jira
José Armando García Sancio created KAFKA-16580: -- Summary: Write simulation tests for kraft membership change Key: KAFKA-16580 URL: https://issues.apache.org/jira/browse/KAFKA-16580

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2822

2024-04-17 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-16579) Revert changes to consumer_rolling_upgrade_test.py for the new async Consumer

2024-04-17 Thread Kirk True (Jira)
Kirk True created KAFKA-16579: - Summary: Revert changes to consumer_rolling_upgrade_test.py for the new async Consumer Key: KAFKA-16579 URL: https://issues.apache.org/jira/browse/KAFKA-16579 Project:

[jira] [Created] (KAFKA-16578) Revert changes to connect_distributed_test.py for the new async Consumer

2024-04-17 Thread Kirk True (Jira)
Kirk True created KAFKA-16578: - Summary: Revert changes to connect_distributed_test.py for the new async Consumer Key: KAFKA-16578 URL: https://issues.apache.org/jira/browse/KAFKA-16578 Project: Kafka

[jira] [Created] (KAFKA-16577) New consumer fails with stop timeout in consumer_test.py’s test_consumer_bounce system test

2024-04-17 Thread Kirk True (Jira)
Kirk True created KAFKA-16577: - Summary: New consumer fails with stop timeout in consumer_test.py’s test_consumer_bounce system test Key: KAFKA-16577 URL: https://issues.apache.org/jira/browse/KAFKA-16577

[jira] [Created] (KAFKA-16576) New consumer fails with assert in consumer_test.py’s test_consumer_failure system test

2024-04-17 Thread Kirk True (Jira)
Kirk True created KAFKA-16576: - Summary: New consumer fails with assert in consumer_test.py’s test_consumer_failure system test Key: KAFKA-16576 URL: https://issues.apache.org/jira/browse/KAFKA-16576

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.7 #138

2024-04-17 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-1023: Follower fetch from tiered offset

2024-04-17 Thread Jun Rao
Hi, Abhijeet, Thanks for the reply. 1. I am wondering if we could achieve the same result by just lowering local.retention.ms and local.retention.bytes. This also allows the newly started follower to build up the local data before serving the consumer traffic. 2. Have you updated the KIP?

[jira] [Created] (KAFKA-16575) Automatically remove KTable aggregation result when group becomes empty

2024-04-17 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-16575: --- Summary: Automatically remove KTable aggregation result when group becomes empty Key: KAFKA-16575 URL: https://issues.apache.org/jira/browse/KAFKA-16575

[jira] [Created] (KAFKA-16574) The metrics of LogCleaner disappear after reconfiguration

2024-04-17 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-16574: -- Summary: The metrics of LogCleaner disappear after reconfiguration Key: KAFKA-16574 URL: https://issues.apache.org/jira/browse/KAFKA-16574 Project: Kafka

[jira] [Resolved] (KAFKA-16405) Mismatch assignment error when running consumer rolling upgrade system tests

2024-04-17 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True resolved KAFKA-16405. --- Reviewer: Lucas Brutschy Resolution: Fixed > Mismatch assignment error when running consumer

Re: [DISCUSS] KIP-924: customizable task assignment for Streams

2024-04-17 Thread Sophie Blee-Goldman
Thanks Bruno! I can provide a bit of context behind some of these decisions but I just want to say up front that I agree with every single one of your points, though I am going to push back a bit on the first one. [1] The idea here is to help avoid some confusion around the overloaded term

Re: [DISCUSS] KIP-1038: Add Custom Error Handler to Producer

2024-04-17 Thread Chris Egerton
Hi Alieh, Thanks for the KIP! The issue with writing to non-existent topics is particularly frustrating for users of Kafka Connect and has been the source of a handful of Jira tickets over the years. My thoughts: 1. An additional detail we can add to the motivation (or possibly rejected

Re: [DISCUSS] KIP-1038: Add Custom Error Handler to Producer

2024-04-17 Thread Lucas Brutschy
Hey Alieh, some comments: * "Compatibility" section wasn't clear to me. Are we just introducing the interfaces or are we changing the default behavior? If so, that should be explained in more detail. * If we are introducing a new interface `ClientExceptionHandler`, what is it going to be used

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2821

2024-04-17 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-16573) Streams does not specify where a Serde is needed

2024-04-17 Thread Ayoub Omari (Jira)
Ayoub Omari created KAFKA-16573: --- Summary: Streams does not specify where a Serde is needed Key: KAFKA-16573 URL: https://issues.apache.org/jira/browse/KAFKA-16573 Project: Kafka Issue Type:

Re: [DISCUSS] KIP-1038: Add Custom Error Handler to Producer

2024-04-17 Thread Justine Olshan
Hey Alieh, I echo what Omnia says, I'm not sure I understand the implications of the change and I think more detail is needed. This comment also confused me a bit: * {@code ClientExceptionHandler} that continues the transaction even if a record is too large. * Otherwise, it makes the transaction

Re: [DISCUSS] KIP-1038: Add Custom Error Handler to Producer

2024-04-17 Thread Omnia Ibrahim
Hi Alieh, Thanks for the KIP! I have couple of comments - You mentioned in the KIP motivation, > Another example for which a production exception handler could be useful is > if a user tries to write into a non-existing topic, which returns a retryable > error code; with infinite retries, the

Re: [VOTE] KIP-1031: Control offset translation in MirrorSourceConnector

2024-04-17 Thread Omnia Ibrahim
Thanks Chris and Mickael for the votes. Can I please get one last +1 binding vote please? Thanks Omnia > On 12 Apr 2024, at 13:21, Chris Egerton wrote: > > +1 (binding), thanks Omnia! > > On Fri, Apr 12, 2024, 03:46 Mickael Maison wrote: > >> Hi Omnia, >> >> +1 (binding), thanks for the

Re: [VOTE] KIP-899: Allow producer and consumer clients to rebootstrap

2024-04-17 Thread Omnia Ibrahim
Hi Ivan, Thanks for the KIP this is a very nice feature to have. +1(non-binding) Omnia > On 15 Apr 2024, at 14:33, Andrew Schofield wrote: > > Thanks for the KIP > > +1 (non-binding) > > Andrew > >> On 15 Apr 2024, at 14:16, Chris Egerton wrote: >> >> Hi Ivan, >> >> Thanks for the KIP.

Re: [DISCUSS] KIP-924: customizable task assignment for Streams

2024-04-17 Thread Bruno Cadonna
Hi, sorry, I am late to the party. I have a couple of comments: (1) I would prefer Client* instead of Node* in the names. In Kafka Streams we do not really have the concept of node but we have the concept of client (admittedly, we sometimes also use instance). I would like to avoid

Re: [PR] KAFKA-16467: Add how to integrate with kafka repo [kafka-site]

2024-04-17 Thread via GitHub
FrankYang0529 commented on code in PR #596: URL: https://github.com/apache/kafka-site/pull/596#discussion_r1568848118 ## README.md: ## @@ -10,4 +10,32 @@ You can run it with the following command, note that it requires docker: Then you can open

Re: [DISCUSS] KIP-1035: StateStore managed changelog offsets

2024-04-17 Thread Bruno Cadonna
Hi Nick and Sophie, I think the task ID is not enough to create a state store that can read the offsets of non-assigned tasks for lag computation during rebalancing. The state store also needs the state directory so that it knows where to find the information that it needs to return from

[DISCUSS] KIP-1038: Add Custom Error Handler to Producer

2024-04-17 Thread Alieh Saeedi
Hi all, Here is the KIP-1038: Add Custom Error Handler to Producer. I look forward to your feedback! Cheers, Alieh

Re: [DISCUSS] KIP-892: Transactional Semantics for StateStores

2024-04-17 Thread Nick Telford
Hi Walker, Feel free to ask away, either on the mailing list of the Confluent Community Slack, where I hang out :-) The implementation is *mostly* complete, although it needs some polishing. It's worth noting that KIP-1035 is a hard prerequisite for this. Regards, Nick

Re: [DISCUSS] KIP-1028: Docker Official Image for Apache Kafka

2024-04-17 Thread Krish Vora
Hi Manikumar, Thanks for the comments. Maybe as part of the release process, RM can create a JIRA for this > task. This can be taken by RM or any comitter or any contributor (with > some help from commiters to run "Docker Image Preparation via GitHub > Actions:" This sounds like a good idea.