[jira] [Updated] (KAFKA-13759) Disable producer idempotence by default in producers instantiated by Connect
[ https://issues.apache.org/jira/browse/KAFKA-13759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantine Karantasis updated KAFKA-13759: --- Description: https://issues.apache.org/jira/browse/KAFKA-7077 was merged recently referring to KIP-318. Before that in AK 3.0 idempotence was enabled by default across Kafka producers. However, some compatibility implications were missed in both cases. If idempotence is enabled by default Connect won't be able to communicate via its producers with Kafka brokers older than version 0.11. Perhaps more importantly, for brokers older than version 2.8 the {{IDEMPOTENT_WRITE}} ACL is required to be granted to the principal of the Connect worker. Given the above caveats, this ticket proposes to explicitly disable producer idempotence in Connect by default. This feature, as it happens today, can be enabled by setting worker and/or connector properties. However, enabling it by default should be considered in a major version upgrade and after KIP-318 is updated to mention the compatibility requirements and gets officially approved. was: https://issues.apache.org/jira/browse/KAFKA-7077 was merged recently referring to KIP-318. Before that in AK 3.0 idempotency was enabled by default across Kafka producers. However, some compatibility implications were missed in both cases. If idempotency is enabled by default Connect won't be able to communicate via its producers with Kafka brokers older than version 0.11. Perhaps more importantly, for brokers older than version 2.8 the {{IDEMPOTENT_WRITE}} ACL is required to be granted to the principal of the Connect worker. Given the above caveats, this ticket proposes to explicitly disable producer idempotency in Connect by default. This feature, as it happens today, can be enabled by setting worker and/or connector properties. However, enabling it by default should be considered in a major version upgrade and after KIP-318 is updated to mention the compatibility requirements and gets officially approved. > Disable producer idempotence by default in producers instantiated by Connect > > > Key: KAFKA-13759 > URL: https://issues.apache.org/jira/browse/KAFKA-13759 > Project: Kafka > Issue Type: Bug > Components: KafkaConnect >Reporter: Konstantine Karantasis >Assignee: Konstantine Karantasis >Priority: Major > > https://issues.apache.org/jira/browse/KAFKA-7077 was merged recently > referring to KIP-318. Before that in AK 3.0 idempotence was enabled by > default across Kafka producers. > However, some compatibility implications were missed in both cases. > If idempotence is enabled by default Connect won't be able to communicate via > its producers with Kafka brokers older than version 0.11. Perhaps more > importantly, for brokers older than version 2.8 the {{IDEMPOTENT_WRITE}} ACL > is required to be granted to the principal of the Connect worker. > Given the above caveats, this ticket proposes to explicitly disable producer > idempotence in Connect by default. This feature, as it happens today, can be > enabled by setting worker and/or connector properties. However, enabling it > by default should be considered in a major version upgrade and after KIP-318 > is updated to mention the compatibility requirements and gets officially > approved. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (KAFKA-13759) Disable producer idempotence by default in producers instantiated by Connect
[ https://issues.apache.org/jira/browse/KAFKA-13759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantine Karantasis updated KAFKA-13759: --- Fix Version/s: 3.2.0 3.1.1 3.0.2 > Disable producer idempotence by default in producers instantiated by Connect > > > Key: KAFKA-13759 > URL: https://issues.apache.org/jira/browse/KAFKA-13759 > Project: Kafka > Issue Type: Bug > Components: KafkaConnect >Reporter: Konstantine Karantasis >Assignee: Konstantine Karantasis >Priority: Major > Fix For: 3.2.0, 3.1.1, 3.0.2 > > > https://issues.apache.org/jira/browse/KAFKA-7077 was merged recently > referring to KIP-318. Before that in AK 3.0 idempotence was enabled by > default across Kafka producers. > However, some compatibility implications were missed in both cases. > If idempotence is enabled by default Connect won't be able to communicate via > its producers with Kafka brokers older than version 0.11. Perhaps more > importantly, for brokers older than version 2.8 the {{IDEMPOTENT_WRITE}} ACL > is required to be granted to the principal of the Connect worker. > Given the above caveats, this ticket proposes to explicitly disable producer > idempotence in Connect by default. This feature, as it happens today, can be > enabled by setting worker and/or connector properties. However, enabling it > by default should be considered in a major version upgrade and after KIP-318 > is updated to mention the compatibility requirements and gets officially > approved. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (KAFKA-13759) Disable producer idempotence by default in producers instantiated by Connect
[ https://issues.apache.org/jira/browse/KAFKA-13759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantine Karantasis updated KAFKA-13759: --- Summary: Disable producer idempotence by default in producers instantiated by Connect (was: Disable producer idempotency by default in producers instantiated by Connect) > Disable producer idempotence by default in producers instantiated by Connect > > > Key: KAFKA-13759 > URL: https://issues.apache.org/jira/browse/KAFKA-13759 > Project: Kafka > Issue Type: Bug > Components: KafkaConnect >Reporter: Konstantine Karantasis >Assignee: Konstantine Karantasis >Priority: Major > > https://issues.apache.org/jira/browse/KAFKA-7077 was merged recently > referring to KIP-318. Before that in AK 3.0 idempotency was enabled by > default across Kafka producers. > However, some compatibility implications were missed in both cases. > If idempotency is enabled by default Connect won't be able to communicate via > its producers with Kafka brokers older than version 0.11. Perhaps more > importantly, for brokers older than version 2.8 the {{IDEMPOTENT_WRITE}} ACL > is required to be granted to the principal of the Connect worker. > Given the above caveats, this ticket proposes to explicitly disable producer > idempotency in Connect by default. This feature, as it happens today, can be > enabled by setting worker and/or connector properties. However, enabling it > by default should be considered in a major version upgrade and after KIP-318 > is updated to mention the compatibility requirements and gets officially > approved. -- This message was sent by Atlassian Jira (v8.20.1#820001)