Re: [VOTE] KIP-447: Producer scalability for exactly once semantics

Hello Colin, Ismael, Thanks for your feedbacks, they are quite helpful. Just to provide some context here about OffsetFetch: 1) When building the offset fetch request, we used to auto "downgrade" the request by falling back the requireStable flag when broker supporter version is < 7.

Re: [VOTE] KIP-447: Producer scalability for exactly once semantics

I'm a bit puzzled. We added this feature because we thought it was useful. And now we are saying that you don't know if you can rely on it since the downgrade happens silently. Can you provide more context on the OffsetFetch downgrade? What is the implication of that? Ismael On Fri, Mar 27, 2020

Build failed in Jenkins: kafka-trunk-jdk8 #4377

See Changes: [github] KAFKA-9770: Close underlying state store also when flush throws (#8368) -- [...truncated 2.95 MB...]

Re: [VOTE] KIP-447: Producer scalability for exactly once semantics

Thanks Colin, I think the point of this change is to make the new client experience better while working with old brokers, when the upgrade is happening on client side only. For Streams, it is very common to have more advanced client version. On code level, the path to call transaction commit is

Re: [VOTE] KIP-447: Producer scalability for exactly once semantics

On Fri, Mar 27, 2020, at 18:29, Colin McCabe wrote: > On Fri, Mar 27, 2020, at 16:06, Boyang Chen wrote: > > Hey there, > > > > we would like to address an improvement on the > > *Producer#sendOffsetsToTransaction(offsets, > > groupMetadata) *API. Previously we assume the calling of this function

Re: [VOTE] KIP-447: Producer scalability for exactly once semantics

On Fri, Mar 27, 2020, at 16:06, Boyang Chen wrote: > Hey there, > > we would like to address an improvement on the > *Producer#sendOffsetsToTransaction(offsets, > groupMetadata) *API. Previously we assume the calling of this function > would crash the app if broker is not on version 2.5.0 or

回复：回复：回复：回复：[Vote] KIP-571: Add option to force remove members in StreamsResetter

Bump, can anyone kindly take a look at the updated KIP-571? Thanks! -- 发件人：feyman2009 发送时间：2020年3月23日(星期一) 08:51 收件人：dev 主　题：回复：回复：回复：回复：[Vote] KIP-571: Add option to force remove members in StreamsResetter Hi, team I have

[jira] [Created] (KAFKA-9780) Deprecate commit records without record metadata

Mario Molina created KAFKA-9780: --- Summary: Deprecate commit records without record metadata Key: KAFKA-9780 URL: https://issues.apache.org/jira/browse/KAFKA-9780 Project: Kafka Issue Type:

Re: [VOTE] KIP-447: Producer scalability for exactly once semantics

Hey there, we would like to address an improvement on the *Producer#sendOffsetsToTransaction(offsets, groupMetadata) *API. Previously we assume the calling of this function would crash the app if broker is not on version 2.5.0 or higher. As Streams side change was rolling out, the disadvantage of

Build failed in Jenkins: kafka-trunk-jdk11 #1297

See Changes: [github] KAFKA-9771: Port patch for inter-worker Connect SSL from Jetty 9.4.25 -- [...truncated 2.96 MB...] org.apache.kafka.streams.TopologyTestDriverTest

[jira] [Created] (KAFKA-9779) Add version 2.5 to streams system tests

Boyang Chen created KAFKA-9779: -- Summary: Add version 2.5 to streams system tests Key: KAFKA-9779 URL: https://issues.apache.org/jira/browse/KAFKA-9779 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-9778) Add validateConnector functionality to the EmbeddedConnectCluster

Daniel Osvath created KAFKA-9778: Summary: Add validateConnector functionality to the EmbeddedConnectCluster Key: KAFKA-9778 URL: https://issues.apache.org/jira/browse/KAFKA-9778 Project: Kafka

Build failed in Jenkins: kafka-2.5-jdk8 #80

See Changes: [konstantine] KAFKA-9771: Port patch for inter-worker Connect SSL from Jetty 9.4.25 -- [...truncated 2.90 MB...]

Build failed in Jenkins: kafka-trunk-jdk11 #1296

See Changes: [github] MINOR: optimize integration test shutdown (#8366) -- [...truncated 5.99 MB...] org.apache.kafka.streams.TestTopicsTest > testStartTimestamp

Build failed in Jenkins: kafka-trunk-jdk8 #4376

See Changes: [github] KAFKA-9771: Port patch for inter-worker Connect SSL from Jetty 9.4.25 -- [...truncated 2.94 MB...] org.apache.kafka.streams.TopologyTestDriverTest

[jira] [Created] (KAFKA-9777) Purgatory locking bug can lead to hanging transaction

Jason Gustafson created KAFKA-9777: -- Summary: Purgatory locking bug can lead to hanging transaction Key: KAFKA-9777 URL: https://issues.apache.org/jira/browse/KAFKA-9777 Project: Kafka

Build failed in Jenkins: kafka-trunk-jdk8 #4375

See Changes: [github] MINOR: optimize integration test shutdown (#8366) -- [...truncated 2.95 MB...] org.apache.kafka.streams.test.ConsumerRecordFactoryTest >

[jira] [Created] (KAFKA-9776) Producer should automatically downgrade CommitTxRequest

Matthias J. Sax created KAFKA-9776: -- Summary: Producer should automatically downgrade CommitTxRequest Key: KAFKA-9776 URL: https://issues.apache.org/jira/browse/KAFKA-9776 Project: Kafka

Re: [VOTE] KIP-574: CLI Dynamic Configuration with file input

+1 (non-binding). Thanks for the KIP! On Fri, Mar 27, 2020 at 9:16 PM Gwen Shapira wrote: > Vote is still good. We can always add things later if needed. > > On Fri, Mar 27, 2020, 8:15 AM Aneel Nazareth wrote: > > > Hi Colin and Gwen, > > > > I wanted to double-check that your +1 votes were

Re: [VOTE] KIP-580: Exponential Backoff for Kafka Clients

Thank you to all that voted. I have 4 binding votes and 4 non-binding votes. I will begin work on this KIP soon. Thanks, Sanjana On Mar 26, 2020, 3:03 PM -0700, Konstantine Karantasis , wrote: > Thank you Sanjana! > > +1 (binding) from me too. > > Konstantine > > > On Wed, Mar 25, 2020 at 1:57

[jira] [Resolved] (KAFKA-9771) Inter-worker SSL is broken for keystores with multiple certificates

[ https://issues.apache.org/jira/browse/KAFKA-9771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantine Karantasis resolved KAFKA-9771. --- Resolution: Fixed The fix was merged in `trunk` and the `2.5` release branch

Re: [VOTE] KIP-574: CLI Dynamic Configuration with file input

Vote is still good. We can always add things later if needed. On Fri, Mar 27, 2020, 8:15 AM Aneel Nazareth wrote: > Hi Colin and Gwen, > > I wanted to double-check that your +1 votes were still good, since the > proposal has been simplified (removing the --delete-config-file option > and taking

Re: [VOTE] KIP-574: CLI Dynamic Configuration with file input

Hi Colin and Gwen, I wanted to double-check that your +1 votes were still good, since the proposal has been simplified (removing the --delete-config-file option and taking out the support for reading from STDIN). Thanks! On Fri, Mar 27, 2020 at 10:01 AM Rajini Sivaram wrote: > > +1 (binding) >

Re: [VOTE] KIP-574: CLI Dynamic Configuration with file input

+1 (binding) Thanks for the KIP, Aneel! Regards, Rajini On Wed, Mar 25, 2020 at 5:06 AM Gwen Shapira wrote: > +1 (binding), thank you > > On Wed, Mar 18, 2020, 2:26 PM Colin McCabe wrote: > > > +1 (binding). > > > > Thanks, Aneel. > > > > best, > > Colin > > > > On Wed, Mar 18, 2020, at

Re: [DISCUSS] KIP-574: CLI Dynamic Configuration with file input

Update: I have simplified the KIP down to just adding the single new --add-config-file option. Thanks for your input, everyone! On Thu, Mar 26, 2020 at 10:13 AM Aneel Nazareth wrote: > > Hi Kamal, > > Thanks for taking a look at this KIP. > > Unfortunately the user actually can't pass the

TLS failures and map I/O faults

Dear community, I recently faced an unexpected type of failures in the middle of an incident related to the exhaustion of memory-map handles on a Kafka broker. The use case is as follows - a broker, not overloaded, manages enough indexes to reach the limit on mmap count per process. This leads

[jira] [Created] (KAFKA-9775) IllegalFormatConversionException from kafka-consumer-perf-test.sh

Tom Bentley created KAFKA-9775: -- Summary: IllegalFormatConversionException from kafka-consumer-perf-test.sh Key: KAFKA-9775 URL: https://issues.apache.org/jira/browse/KAFKA-9775 Project: Kafka

[jira] [Created] (KAFKA-9774) Create official Docker image for Kafka Connect

Jordan Moore created KAFKA-9774: --- Summary: Create official Docker image for Kafka Connect Key: KAFKA-9774 URL: https://issues.apache.org/jira/browse/KAFKA-9774 Project: Kafka Issue Type: Task

[jira] [Created] (KAFKA-9773) Option combination "[bootstrap-server],[config]" can't be used with option "[alter]"

startjava created KAFKA-9773: Summary: Option combination "[bootstrap-server],[config]" can't be used with option "[alter]" Key: KAFKA-9773 URL: https://issues.apache.org/jira/browse/KAFKA-9773 Project:

Build failed in Jenkins: kafka-2.4-jdk8 #178

See Changes: [konstantine] KAFKA-9707: Fix InsertField.Key should apply to keys of tombstone -- [...truncated 7.71 MB...]

Build failed in Jenkins: kafka-trunk-jdk11 #1295

See Changes: [github] KAFKA-9756: Process more than one record of one task at a time (#8358) -- [...truncated 2.96 MB...]

Build failed in Jenkins: kafka-trunk-jdk8 #4374

See Changes: [github] KAFKA-9756: Process more than one record of one task at a time (#8358) -- [...truncated 2.95 MB...] org.apache.kafka.streams.MockTimeTest >