[jira] [Resolved] (KAFKA-16644) FK join emits duplicate tombstone on left-side delete

[ https://issues.apache.org/jira/browse/KAFKA-16644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-16644. - Resolution: Duplicate > FK join emits duplicate tombstone on left-side delete >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2861

See

Re: [DISCUSS] KIP-1033: Add Kafka Streams exception handler for exceptions occuring during processing

Thanks for the update. I am wondering if we should use `ReadOnlyHeaders` instead of `ImmutableHeaders` as interface name? Also, the returned `Header` interface is technically not immutable either, because `Header#key()` returns a mutable byte-array... Would we need a `ReadOnlyHeader`

Re: [DISCUSS] KIP-1035: StateStore managed changelog offsets

Thanks Bruno. 101: I think I understand this better now. But just want to make sure I do. What do you mean by "they can diverge" and "Recovering after a failure might load inconsistent offsets and positions." The checkpoint is the offset from the changelog, while the position is the

Re: [DISCUSS] KIP-924: customizable task assignment for Streams

I like the idea of error codes. Not sure if the name are ideal? UNKNOWN_PROCESS_ID makes sense, but the other two seems a little bit difficult to understand? Should we be very descriptive (and also try to avoid coupling it to the threading model -- important for the first error code): -

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2860

See

[jira] [Created] (KAFKA-16650) add integration test for Admin#abortTransaction

Chia-Ping Tsai created KAFKA-16650: -- Summary: add integration test for Admin#abortTransaction Key: KAFKA-16650 URL: https://issues.apache.org/jira/browse/KAFKA-16650 Project: Kafka Issue

[jira] [Created] (KAFKA-16649) Fix potential deadlock in DynamicBrokerConfig

Colin McCabe created KAFKA-16649: Summary: Fix potential deadlock in DynamicBrokerConfig Key: KAFKA-16649 URL: https://issues.apache.org/jira/browse/KAFKA-16649 Project: Kafka Issue Type:

Re: [DISCUSS] KIP-1036: Extend RecordDeserializationException exception

Actually one more thing, after thinking a bit about how this would be used in practice, I'm inclined to agree that maybe distinguishing between key vs value errors via subclasses is not the cleanest way to present the API. Users would still essentially want to catch the general

Re: [DISCUSS] KIP-1036: Extend RecordDeserializationException exception

Hey Fred, I think this is looking good but I just want to follow up on what Kirk asked earlier about having both the ByteBuffer and byte[] forms. Can't users just use the ByteBuffer versions and convert them into a byte[] themselves? In some cases it maybe makes sense to offer some additional APIs

Re: [PR] PayPal powered by Apache Kafka section Update [kafka-site]

bbejeck merged PR #590: URL: https://github.com/apache/kafka-site/pull/590 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [DISCUSS] KIP-924: customizable task assignment for Streams

One last thing: I added an error code enum to be returned from the #onAssignmentComputed method in case of an invalid assignment. I created one code for each of the invalid cases we described above. The downside is that this means we'll have to go through a deprecation cycle if we want to loosen

Re: [DISCUSS] KIP-924: customizable task assignment for Streams

Thanks guys! I agree with what Lucas said about 117c, we can always loosen a restriction later and I don't want to do anything now that might get in the way of the new threading models. With that I think we're all in agreement on 117. I'll update the KIP to include what we've discussed (and will

RE: lambda not returning?

Hi, The connector is up and running - it's reading in files (I'm using custenborder file adapter as a simple test adapter but it fails with JDBC too ) . I have seen issues when I've tried to use transformers that weren't configured correctly- sometimes they throw and I get an internal error

Re: lambda not returning?

Hi John, Do you have logs demonstrating that the connector was able to start up successfully? If not, it's possible that instead of the callback being dropped, it was properly retained but never invoked because the connector was blocked. Cheers, Chris On Tue, Apr 30, 2024 at 1:57 PM John

lambda not returning?

Hi folks, I've been working with the standalone kafka for quite a while now and been debugging a problem I'm having when deploying new connectors (using the PUT method but it happens in the POST as well). I get a 500 timeout whenever I try to create a new connector. It looks to me like the

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2859

See

Re: [DISCUSS] KIP-1024: Make the restore behavior of GlobalKTables with custom processors configureable

Hey Bruno, Thanks for the feedback. Sorry for the late reply, I was hoping others might weigh in as well and it got away from me. a) I like this but I think we should separate this out. This kip has already dragged on more than it should and I think that is a big enough change to get done by

Re: [DISCUSS] KIP-1028: Docker Official Image for Apache Kafka

Hi Vedarth and Krish, Thanks for the KIP! I have to admit I'm a little skeptical; hopefully you can help me understand the need for these additional images. 1) In the motivation section it's stated that "Several other Apache projects, like Flink, Spark, Solr, have already released Docker

Re: [DISCUSS] KIP-924: customizable task assignment for Streams

Hi again, I forgot to ask whether you could add the agreement about handling invalid assignment to the KIP. Best, Bruno On 4/30/24 2:00 PM, Bruno Cadonna wrote: Hi all, I think we are converging! 117 a) fail: Since it is an invalid consumer assignment b) pass: I agree that not assigning a

Re: [DISCUSS] KIP-1039: Disable automatic topic creation for MirrorMaker2 consumers

Hi Aaron, Thanks for publishing this KIP after the feedback on your PR. I'm generally in favor but have a few questions: 1) Is the consumer mentioned in the KIP the one constructed by the MirrorSourceConnector for polling replicated records from the source cluster? If yes, are there any other

Re: [DISCUSS] KIP-936 Throttle number of active PIDs

Hi, Just bringing some offline discussion and recent updated to the KIP here to the mailing list Claude updated the KIP to use LayeredBloomFilter from Apache-commons https://commons.apache.org/proper/commons-collections/apidocs/org/apache/commons/collections4/bloomfilter/LayeredBloomFilter.html

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2858

See

Re: [DISCUSS] KIP-924: customizable task assignment for Streams

Hi all, I think we are converging! 117 a) fail: Since it is an invalid consumer assignment b) pass: I agree that not assigning a task might be reasonable in some situations c) fail: For the reasons Lucas pointed out. I am missing a good use case here. d) fail: It is invalid Somewhere in

[jira] [Resolved] (KAFKA-16506) add the scala version of tool-related classes back to core module to follow KIP-906

[ https://issues.apache.org/jira/browse/KAFKA-16506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] PoAn Yang resolved KAFKA-16506. --- Resolution: Not A Problem Compare commands between 2.8 and trunk brand in folders

Re: [DISCUSS] KIP-924: customizable task assignment for Streams

Hi, Looks like a great KIP to me! I'm late, so I'm only going to comment on the last open point 117. I'm against any fallbacks like "use the default assignor if the custom assignment is invalid", as it's just going to hide bugs. For the 4 cases mentioned by Sophie: 117a) I'd fail immediately

[jira] [Created] (KAFKA-16648) Question: KIP-848 and KafkaTestKit.java

sanghyeok An created KAFKA-16648: Summary: Question: KIP-848 and KafkaTestKit.java Key: KAFKA-16648 URL: https://issues.apache.org/jira/browse/KAFKA-16648 Project: Kafka Issue Type: Bug

Re: [ANNOUNCE] New committer: Igor Soarez

Congrats Igor! > On Apr 26, 2024, at 13:53, Christo Lolov wrote: > > Congratulations Igor :) ! > > On Thu, 25 Apr 2024 at 17:07, Igor Soarez wrote: > >> Thanks everyone, I'm very honoured to join! >> >> -- >> Igor >>

Re: [DISCUSS] KIP-1035: StateStore managed changelog offsets

Hi all, 100 I think we already have such a wrapper. It is called AbstractReadWriteDecorator. 101 Currently, the position is checkpointed when a offset checkpoint is written. If we let the state store manage the committed offsets, we need to also let the state store also manage the position

Re: [VOTE] KIP-1037: Allow WriteTxnMarkers API with Alter Cluster Permission

Hi all, KIP-1037 is accepted with 4 +1s (3 binding and 1 non-binding votes). Thank you all for casting your votes! Nikhil Nikhil On Thu, Apr 25, 2024 at 10:28 AM Nikhil Ramakrishnan wrote: > > Thank you Justine, Christo, Andrew, and Luke for the vote! I will keep > this vote open for

[jira] [Created] (KAFKA-16647) Remove setMetadataDirectory from BrokerNode/ControllerNode

Chia-Ping Tsai created KAFKA-16647: -- Summary: Remove setMetadataDirectory from BrokerNode/ControllerNode Key: KAFKA-16647 URL: https://issues.apache.org/jira/browse/KAFKA-16647 Project: Kafka

[VOTE] KIP-1036: Extend RecordDeserializationException exception

Hi all, As there is no more activity for a while on the discuss thread, I think we can start a vote. The KIP is available on https://cwiki.apache.org/confluence/display/KAFKA/KIP-1036%3A+Extend+RecordDeserializationException+exception If you have some feedback or suggestions, please participate

[jira] [Created] (KAFKA-16646) Consider only running the CVE scanner action on apache/kafka and not in forks

Mickael Maison created KAFKA-16646: -- Summary: Consider only running the CVE scanner action on apache/kafka and not in forks Key: KAFKA-16646 URL: https://issues.apache.org/jira/browse/KAFKA-16646

[jira] [Created] (KAFKA-16645) CVEs in 3.7.0 docker image

Mickael Maison created KAFKA-16645: -- Summary: CVEs in 3.7.0 docker image Key: KAFKA-16645 URL: https://issues.apache.org/jira/browse/KAFKA-16645 Project: Kafka Issue Type: Task Affects

[jira] [Resolved] (KAFKA-10859) add @Test annotation to FileStreamSourceTaskTest.testInvalidFile and reduce the loop count to speedup the test

[ https://issues.apache.org/jira/browse/KAFKA-10859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-10859. Resolution: Duplicate fixed by