[jira] [Resolved] (KAFKA-16770) Coalesce records into bigger batches

[ https://issues.apache.org/jira/browse/KAFKA-16770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16770. - Resolution: Fixed > Coalesce records into bigger batches >

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.8 #33

See

[jira] [Created] (KAFKA-16937) Consider inlineing Time#waitObject to ProducerMetadata#awaitUpdate

Chia-Ping Tsai created KAFKA-16937: -- Summary: Consider inlineing Time#waitObject to ProducerMetadata#awaitUpdate Key: KAFKA-16937 URL: https://issues.apache.org/jira/browse/KAFKA-16937 Project: Kafka

[jira] [Resolved] (KAFKA-15600) KIP-990: Capability to PAUSE Tasks on DeserializationException

[ https://issues.apache.org/jira/browse/KAFKA-15600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-15600. - Resolution: Won't Fix > KIP-990: Capability to PAUSE Tasks on DeserializationException >

Re: [VOTE] KIP-1040: Improve handling of nullable values in InsertField, ExtractField, and other transformations

Hi Mario, Thanks for the KIP. I'm on-board with this KIP, I just wanted to verify a discrepancy I noticed. I checked all of the call-sites of Struct#get(Field) and Struct#get(String) in Kafka, and noticed there are some call-sites which are not included in the KIP. 1. The Flatten transformation s

Re: [DISCUSS] KIP-655: Add deduplication processor in kafka-streams

Hi Sebastien & Matthias, For 106. My idea was to deduplicate on a per-task basis. If the user wants to do a global deduplication over all partitions, I think it's better to have him explicitly repartition and then call the deduplication processor. For the use-case of deduplicating a "at least onc

Re: [DISCUSS] Apache Kafka 3.8.0 release

Hi Josep, The PR https://github.com/apache/kafka/pull/13277 for KIP-899 looks ready to be merged (waiting for the PR build).The PR changes several files, but is relatively straightforward and not risky. Also the changes are under a config that is not enabled by default. Since the KIP was approved

[jira] [Created] (KAFKA-16936) Upgrade slf4k to 2.0.9 and integrate "-Dslf4j.provider" to kafka script

Chia-Ping Tsai created KAFKA-16936: -- Summary: Upgrade slf4k to 2.0.9 and integrate "-Dslf4j.provider" to kafka script Key: KAFKA-16936 URL: https://issues.apache.org/jira/browse/KAFKA-16936 Project:

Re: [VOTE] KIP-1049: Add config log.summary.interval.ms to Kafka Streams

+1 (binding) Thanks for the KIP! On Tue, Jun 11, 2024 at 5:37 AM jiang dou wrote: > HI > I would like to start a vote for KIP-1049: Add config > log.summary.interval.ms to Kafka Streams > > KIP： > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-1049%3A+Add+config+log.summary.interval.ms

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2998

See

Re: [DISCUSS] KIP-1017: A health check endpoint for Kafka Connect

Hi Viktor, Thanks for your comments! 1) I'm realizing now that there's some implicit behavior in the KIP that I should spell out explicitly. I was thinking that the timeout of 10 seconds that I mentioned in the "Public Interfaces" section would have to elapse before any 5xx responses were issued.

[jira] [Resolved] (KAFKA-16930) UniformHeterogeneousAssignmentBuilder throws NPE when member has not subscriptions

[ https://issues.apache.org/jira/browse/KAFKA-16930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16930. - Resolution: Fixed > UniformHeterogeneousAssignmentBuilder throws NPE when member has not > subs

[jira] [Created] (KAFKA-16935) Automatically wait for cluster startup in embedded Connect integration tests

Chris Egerton created KAFKA-16935: - Summary: Automatically wait for cluster startup in embedded Connect integration tests Key: KAFKA-16935 URL: https://issues.apache.org/jira/browse/KAFKA-16935 Projec

Re: [DISCUSS] KIP-655: Add deduplication processor in kafka-streams

Thanks Sebastien, that's a good point. Thanks for raising it. -- I like your proposal. An alternative would be to have two overloads of `deduplicate()` one w/ and one w/o the "id extractor" parameter. This would be less explicit though. -Matthias On 6/11/24 2:30 AM, Sebastien Viale wrote:

RE: Re: [VOTE] KIP-1040: Improve handling of nullable values in InsertField, ExtractField, and other transformations

Thanks for the KIP! +1 (Non-binding) On 2024/06/11 16:23:38 Yash Mayya wrote: > Thanks for the KIP! > > +1 (binding) > > On Tue, Jun 11, 2024 at 7:40 PM Mario Fiore Vitale > mv...@redhat.com > wrote: > > > Hi all, > > > > Just wanted to bump up this thread for visibility

[jira] [Resolved] (KAFKA-7744) Type in java

[ https://issues.apache.org/jira/browse/KAFKA-7744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-7744. Resolution: Duplicate > Type in java > > > Key: KAFKA-7744 >

[DISCUSS] RemoteLogSegmentMetadataRecord Schema Evolution

Hi, We have defined the remote log segment metadata schemas with type as "metadata" (controller records) in #10271 : 1. RemoteLogSegmentMetadataRecord.json

[jira] [Created] (KAFKA-16934) Clean up and refactor release.py

Igor Soarez created KAFKA-16934: --- Summary: Clean up and refactor release.py Key: KAFKA-16934 URL: https://issues.apache.org/jira/browse/KAFKA-16934 Project: Kafka Issue Type: Improvement

Re: [VOTE] KIP-1040: Improve handling of nullable values in InsertField, ExtractField, and other transformations

Thanks for the KIP! +1 (binding) On Tue, Jun 11, 2024 at 7:40 PM Mario Fiore Vitale wrote: > Hi all, > > Just wanted to bump up this thread for visibility. > > Thanks! > > On Wed, May 29, 2024 at 5:31 PM Mickael Maison > wrote: > > > Hi Mario, > > > > +1 (binding) > > Thanks for the KIP! > > >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2997

See

Re: [DISCUSS] KIP-1017: A health check endpoint for Kafka Connect

Hi Chris, I also have 2 other comments: 1. One more thing I came across is that should we provide the Retry-After header in the response in case of 503 response? Although I'm not sure how many clients honor this, we could add it just in case some does and if you also find it useful. (We could def

RE: [DISCUSS] KIP-1017: A health check endpoint for Kafka Connect

Hi Chris, Thanks for taking the time to provide more details about the intended usage. I hadn’t appreciated how nuanced (and perhaps in some cases not fully explored) the causes of an unhealthy Connect could be. With that in mind, I can see why you want to nail down a straight-forward and robus

Re: [DISCUSS] KIP-1034: Dead letter queue in Kafka Streams

Hi, since there was not too much activity in this thread recently, I was wondering what the status of this discussion is. I cannot find the examples in the KIP Sébastien mentioned in the last message to this thread. I can also not find the corresponding definition of the following method cal

[jira] [Created] (KAFKA-16933) New consumer leave group flow may not send leave request and clear epoch

Lianet Magrans created KAFKA-16933: -- Summary: New consumer leave group flow may not send leave request and clear epoch Key: KAFKA-16933 URL: https://issues.apache.org/jira/browse/KAFKA-16933 Project:

Re: [DISCUSS] KIP-1017: A health check endpoint for Kafka Connect

Hi Adrian, Thanks for your comments/questions! The responses to them are related so I'll try to address both at once. The most recent update I made to the KIP should help provide insight into what's going wrong if a non-200 response is returned. I don't plan on adding any structured data such as

[jira] [Resolved] (KAFKA-16827) Integrate Native Apache Kafka with System tests

[ https://issues.apache.org/jira/browse/KAFKA-16827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Agarwal resolved KAFKA-16827. - Resolution: Done > Integrate Native Apache Kafka with System tests > ---

[jira] [Created] (KAFKA-16932) Documentation changes for Native Docker image

Krishna Agarwal created KAFKA-16932: --- Summary: Documentation changes for Native Docker image Key: KAFKA-16932 URL: https://issues.apache.org/jira/browse/KAFKA-16932 Project: Kafka Issue Typ

Re: [VOTE] KIP-1040: Improve handling of nullable values in InsertField, ExtractField, and other transformations

Hi all, Just wanted to bump up this thread for visibility. Thanks! On Wed, May 29, 2024 at 5:31 PM Mickael Maison wrote: > Hi Mario, > > +1 (binding) > Thanks for the KIP! > > Mickael > > On Mon, May 27, 2024 at 12:06 PM Mario Fiore Vitale > wrote: > > > > After 7 days I received only one vot

[jira] [Created] (KAFKA-16931) A transient REST failure to forward fenceZombie request leaves Connect Task in FAILED state

Edoardo Comar created KAFKA-16931: - Summary: A transient REST failure to forward fenceZombie request leaves Connect Task in FAILED state Key: KAFKA-16931 URL: https://issues.apache.org/jira/browse/KAFKA-16931

Re: [PR] Add blog post for 3.7.1 [kafka-site]

soarez commented on PR #605: URL: https://github.com/apache/kafka-site/pull/605#issuecomment-2160795775 https://github.com/apache/kafka-site/assets/1357510/c708a89a-f529-4fec-acc7-e338c3650646";> -- This is an automated message from the Apache Git Service. To respond to the message, pl

Re: [VOTE] KIP-1025: Optionally URL-encode clientID and clientSecret in authorization header

Hi all, I want to bump up this thread for visibility. Currently, this KIP is one binding vote short of being accepted. Thanks! On Thu, May 16, 2024 at 1:07 AM Mickael Maison wrote: > Hi, > > +1 (binding) > Thanks for the KIP! > > Mickael > > On Sun, Apr 21, 2024 at 7:12 PM Nelson B. wrote: >

[PR] Add blog post for 3.7.1 [kafka-site]

soarez opened a new pull request, #605: URL: https://github.com/apache/kafka-site/pull/605 This change should not to be merged before a 3.7.1 RC is promoted. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[PR] Update docs for 3.7.1 [kafka-site]

soarez opened a new pull request, #604: URL: https://github.com/apache/kafka-site/pull/604 This change should not to be merged before a 3.7.1 RC is promoted. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[jira] [Created] (KAFKA-16930) UniformHeterogeneousAssignmentBuilder throws NPE when member has not subscriptions

David Jacot created KAFKA-16930: --- Summary: UniformHeterogeneousAssignmentBuilder throws NPE when member has not subscriptions Key: KAFKA-16930 URL: https://issues.apache.org/jira/browse/KAFKA-16930 Proj

[VOTE] KIP-1049: Add config log.summary.interval.ms to Kafka Streams

HI I would like to start a vote for KIP-1049: Add config log.summary.interval.ms to Kafka Streams KIP： https://cwiki.apache.org/confluence/display/KAFKA/KIP-1049%3A+Add+config+log.summary.interval.ms+to+Kafka+Streams Discussion thread: https://lists.apache.org/thread/rjqslkt46y5zlg0552rloqjfm5ddzk

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.8 #31

See

[jira] [Resolved] (KAFKA-16914) Add Share Group dynamic and broker configs

[ https://issues.apache.org/jira/browse/KAFKA-16914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhinav Dixit resolved KAFKA-16914. --- Resolution: Fixed > Add Share Group dynamic and broker configs > ---

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2996

See

[jira] [Reopened] (KAFKA-14567) Kafka Streams crashes after ProducerFencedException

[ https://issues.apache.org/jira/browse/KAFKA-14567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruno Cadonna reopened KAFKA-14567: --- > Kafka Streams crashes after ProducerFencedException >

Re: [DISCUSS] KIP-655: Add deduplication processor in kafka-streams

Hi, I am really interested in this KIP. 106: I hope I am not talking nonsense, but if you do not deduplicate based on the key, the input stream has to be repartitioned. Otherwise, different stream tasks may handle records that need to be deduplicated, and thus duplicates will not be detected.

Re: [PR] MINOR: Add Josep Prat Key [kafka-site]

jlprat commented on PR #603: URL: https://github.com/apache/kafka-site/pull/603#issuecomment-2160245477 Thanks @mimaison ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

Re: [PR] MINOR: Add Josep Prat Key [kafka-site]

mimaison commented on PR #603: URL: https://github.com/apache/kafka-site/pull/603#issuecomment-2160201828 I added the key to https://dist.apache.org/repos/dist/release/kafka/KEYS -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [PR] MINOR: Add Josep Prat Key [kafka-site]

jlprat merged PR #603: URL: https://github.com/apache/kafka-site/pull/603 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@kafka.apache.o

Re: [DISCUSS] Apache Kafka 3.8.0 release

Hi all, I just want to remind everybody that the code freeze deadline is approaching. June 12th EOD is the deadline. Please do not automatically backport any commit to the 3.8 branch after June 12th EOD. Ping me if you think the commit should be backported (fixes failures in the branch or critica

Re: [PR] MINOR: Add Josep Prat Key [kafka-site]

soarez commented on PR #603: URL: https://github.com/apache/kafka-site/pull/603#issuecomment-2160115947 I noticed the same. I don't know if it is actually important. I suppose you can add another key later if it proves really necessary. -- This is an automated message from the Apache Git

Re: [PR] MINOR: Add Josep Prat Key [kafka-site]

jlprat commented on PR #603: URL: https://github.com/apache/kafka-site/pull/603#issuecomment-2160111387 I see that others also lack this comment? How important is it to have it? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[PR] MINOR: Add Josep Prat Key [kafka-site]

jlprat opened a new pull request, #603: URL: https://github.com/apache/kafka-site/pull/603 Once merged, could a PMC member update the KEYS file in https://dist.apache.org/repos/dist/release/kafka/KEYS? Thanks! -- This is an automated message from the Apache Git Service. To respond

[jira] [Resolved] (KAFKA-16724) Add new options for kafka-producer-perf-test.sh

[ https://issues.apache.org/jira/browse/KAFKA-16724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-16724. -- Resolution: Fixed > Add new options for kafka-producer-perf-test.sh >

RE: [DISCUSS] KIP-1017: A health check endpoint for Kafka Connect

Hi Chris, Good KIP – I think it will be very helpful in alerting and automating the resolution of common Connect problems. I have a couple of questions / suggestions: 1. What are you planning on documenting as guidance for using this new endpoint? My guess would be that if Connect doesn’t retu

Re: [VOTE] 3.7.1 RC1

Now attaching the container build reports, which I seem to have forgotten to include before. -- Igor kafka/test:test (alpine 3.19.1) === Total: 0 (HIGH: 0, CRITICAL: 0)