Build failed in Jenkins: kafka-2.5-jdk8 #128

2020-05-20 Thread Apache Jenkins Server
See Changes: [konstantine] KAFKA-9950: Construct new ConfigDef for MirrorTaskConfig before defining -- Started by an SCM change Started by an SCM change Running as SYSTEM [

Build failed in Jenkins: kafka-2.4-jdk8 #212

2020-05-20 Thread Apache Jenkins Server
See Changes: [konstantine] KAFKA-9950: Construct new ConfigDef for MirrorTaskConfig before defining -- [...truncated 27.51 KB...] org.apache.kafka.common.network.SslSelect

Build failed in Jenkins: kafka-trunk-jdk8 #4555

2020-05-20 Thread Apache Jenkins Server
See Changes: [github] KAFKA-8869: Remove task configs for deleted connectors from config [github] KAFKA-9950: Construct new ConfigDef for MirrorTaskConfig before defining [github] KAFKA-9855 - return cached St

Build failed in Jenkins: kafka-trunk-jdk11 #1484

2020-05-20 Thread Apache Jenkins Server
See Changes: [github] KAFKA-9950: Construct new ConfigDef for MirrorTaskConfig before defining [github] KAFKA-9855 - return cached Structs for Schemas with no fields (#8472) -

Build failed in Jenkins: kafka-2.5-jdk8 #127

2020-05-20 Thread Apache Jenkins Server
See Changes: [konstantine] KAFKA-8869: Remove task configs for deleted connectors from config -- [...truncated 1.83 MB...] kafka.security.authorizer.AclAuthorizerTest > tes

Build failed in Jenkins: kafka-2.3-jdk8 #203

2020-05-20 Thread Apache Jenkins Server
See Changes: [konstantine] KAFKA-8869: Remove task configs for deleted connectors from config -- [...truncated 2.24 MB...] kafka.log.LogSegmentTest > testRecoveryWithCorrup

Build failed in Jenkins: kafka-trunk-jdk14 #112

2020-05-20 Thread Apache Jenkins Server
See Changes: [github] KAFKA-9950: Construct new ConfigDef for MirrorTaskConfig before defining [github] KAFKA-9855 - return cached Structs for Schemas with no fields (#8472) --

Build failed in Jenkins: kafka-2.4-jdk8 #211

2020-05-20 Thread Apache Jenkins Server
See Changes: [konstantine] KAFKA-8869: Remove task configs for deleted connectors from config -- [...truncated 2.26 MB...] kafka.api.SslEndToEndAuthorizationTest > testNoC

Build failed in Jenkins: kafka-trunk-jdk11 #1483

2020-05-20 Thread Apache Jenkins Server
See Changes: [github] KAFKA-9409: Supplement immutability of ClusterConfigState class in [github] KAFKA-8869: Remove task configs for deleted connectors from config --

Build failed in Jenkins: kafka-trunk-jdk14 #111

2020-05-20 Thread Apache Jenkins Server
See Changes: [github] KAFKA-9409: Supplement immutability of ClusterConfigState class in [github] KAFKA-8869: Remove task configs for deleted connectors from config -- [

Build failed in Jenkins: kafka-trunk-jdk8 #4554

2020-05-20 Thread Apache Jenkins Server
See Changes: [github] KAFKA-9409: Supplement immutability of ClusterConfigState class in -- [...truncated 3.08 MB...] org.apache.kafka.streams.test.ConsumerRecordFactory

[jira] [Resolved] (KAFKA-9950) MirrorMaker2 sharing of ConfigDef can lead to ConcurrentModificationException

2020-05-20 Thread Konstantine Karantasis (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantine Karantasis resolved KAFKA-9950. --- Resolution: Fixed > MirrorMaker2 sharing of ConfigDef can lead to ConcurrentM

Re: [VOTE] KIP-545 support automated consumer offset sync across clusters in MM 2.0

2020-05-20 Thread Maulin Vasavada
Thank you for the KIP. I sincerely hope we get enough votes on this KIP. I was thinking of similar changes while working on DR capabilities and offsets are Achilles Heels and this KIP addresses it. On Mon, May 18, 2020 at 6:10 PM Maulin Vasavada wrote: > +1 (non-binding) > > On Mon, May 18, 2020

[jira] [Resolved] (KAFKA-8869) Map taskConfigs in KafkaConfigBackingStore grows monotonically despite of task removals

2020-05-20 Thread Konstantine Karantasis (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantine Karantasis resolved KAFKA-8869. --- Resolution: Fixed > Map taskConfigs in KafkaConfigBackingStore grows monotoni

[jira] [Resolved] (KAFKA-9409) Increase Immutability of ClusterConfigState

2020-05-20 Thread Konstantine Karantasis (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantine Karantasis resolved KAFKA-9409. --- Resolution: Fixed > Increase Immutability of ClusterConfigState > ---

Build failed in Jenkins: kafka-trunk-jdk8 #4553

2020-05-20 Thread Apache Jenkins Server
See Changes: [github] MINOR: Increase gradle daemon’s heap size to 2g (#8700) -- [...truncated 1.78 MB...] kafka.server.epoch.EpochDrivenReplicationProtocolAcceptanceTes

Build failed in Jenkins: kafka-trunk-jdk14 #110

2020-05-20 Thread Apache Jenkins Server
See Changes: [github] MINOR: Increase gradle daemon’s heap size to 2g (#8700) -- [...truncated 1.83 MB...] kafka.api.SslAdminIntegrationTest > testAttemptToCreateInvalid

Build failed in Jenkins: kafka-trunk-jdk11 #1482

2020-05-20 Thread Apache Jenkins Server
See Changes: [github] MINOR: Increase gradle daemon’s heap size to 2g (#8700) -- [...truncated 1.40 MB...] org.apache.kafka.common.security.auth.DefaultKafkaPrincipalBui

Re: [VOTE]: KIP-604: Remove ZooKeeper Flags from the Administrative Tools

2020-05-20 Thread Jason Gustafson
Sounds good. +1 from me. On Tue, May 19, 2020 at 5:41 PM Colin McCabe wrote: > On Tue, May 19, 2020, at 09:31, Jason Gustafson wrote: > > Hi Colin, > > > > Looks good. I just had one question. It sounds like your intent is to > > change kafka-configs.sh so that the --zookeeper flag is only suppo

[jira] [Resolved] (KAFKA-1056) Evenly Distribute Intervals in OffsetIndex

2020-05-20 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-1056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-1056. -- Resolution: Fixed > Evenly Distribute Intervals in OffsetIndex > --

Build failed in Jenkins: kafka-trunk-jdk14 #109

2020-05-20 Thread Apache Jenkins Server
See Changes: [github] KAFKA-9603: Do not turn on bulk loading for segmented stores on stand-by -- [...truncated 1.55 MB...] kafka.utils.ExitTest > shouldNotInvokeShutdo

Build failed in Jenkins: kafka-trunk-jdk8 #4552

2020-05-20 Thread Apache Jenkins Server
See Changes: [github] KAFKA-9603: Do not turn on bulk loading for segmented stores on stand-by -- [...truncated 1.60 MB...] kafka.admin.ReassignPartitionsIntegrationTes

Build failed in Jenkins: kafka-trunk-jdk11 #1481

2020-05-20 Thread Apache Jenkins Server
See Changes: [github] KAFKA-9603: Do not turn on bulk loading for segmented stores on stand-by -- [...truncated 1.40 MB...] org.apache.kafka.clients.consumer.KafkaCons

Re: [DISCUSS] KIP-609: Use Pre-registration and Blocking Calls for Better Transaction Efficiency

2020-05-20 Thread Boyang Chen
Thanks for the check! Makes sense to me. On Wed, May 20, 2020 at 3:27 PM Guozhang Wang wrote: > Just to clarify on the implementation details: today inside > Sender#runOnce(), we have the following: > > ``` > > if (maybeSendAndPollTransactionalRequest()) { > return; > } > > ``` > > > Which b

Re: [DISCUSS] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

2020-05-20 Thread Jorge Quilcate
Thank you both for the great feedback. I like the "fancy" proposal :), and how it removes the need for additional API methods. And with a feature flag on `StateStore`, disabled by default, should no break current users. The only side-effect I can think of is that: by moving the flag upwards, all

Re: [DISCUSS] KIP-609: Use Pre-registration and Blocking Calls for Better Transaction Efficiency

2020-05-20 Thread Guozhang Wang
Just to clarify on the implementation details: today inside Sender#runOnce(), we have the following: ``` if (maybeSendAndPollTransactionalRequest()) { return; } ``` Which basically means that as long as we still have any in-flight txn request; so we are not really blocking on the first sen

Re: [DISCUSS] KIP-609: Use Pre-registration and Blocking Calls for Better Transaction Efficiency

2020-05-20 Thread Boyang Chen
Thanks Guozhang for the new proposal. I agree that we could deliver https://issues.apache.org/jira/browse/KAFKA-9878 first and measure the following metrics: 1. The total volume of AddPartitionToTxn requests 2. The time used in propa

Re: [DISCUSS] KIP-609: Use Pre-registration and Blocking Calls for Better Transaction Efficiency

2020-05-20 Thread Guozhang Wang
Hello Matthias, I have a quick question regarding the motivation of the long-blocking and batch-add-partitions behavior: do we think the latency primarily comes from the network round-trips, or from the coordinator-side transaction-log appends? If we believe it is coming from the latter, then perh

Re: [DISCUSS] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

2020-05-20 Thread Sophie Blee-Goldman
> There's no possibility that someone could be relying > on iterating over that range in increasing order, because that's not what > happens. However, they could indeed be relying on getting an empty iterator I just meant that they might be relying on the assumption that the range query will never

Re: [VOTE] KIP-572: Improve timeouts and retires in Kafka Streams

2020-05-20 Thread Guozhang Wang
Thanks Matthias, I agree with you on all the bullet points above. Regarding the admin-client outer-loop retries inside partition assignor, I think we should treat error codes differently from those two blocking calls: Describe-topic: * unknown-topic (3): add this topic to the to-be-created topic

Build failed in Jenkins: kafka-trunk-jdk14 #108

2020-05-20 Thread Apache Jenkins Server
See Changes: [github] KAFKA-9859 / kafka-streams-application-reset tool doesn't take into -- [...truncated 1.88 MB...] org.apache.kafka.streams.integration.StoreQueryInt

[VOTE] KIP-589: Add API to update Replica state in Controller

2020-05-20 Thread David Arthur
Hello, all. I'd like to start the vote for KIP-589 which proposes to add a new AlterReplicaState RPC. https://cwiki.apache.org/confluence/display/KAFKA/KIP-589+Add+API+to+update+Replica+state+in+Controller Cheers, David

Build failed in Jenkins: kafka-trunk-jdk8 #4551

2020-05-20 Thread Apache Jenkins Server
See Changes: [github] KAFKA-9859 / kafka-streams-application-reset tool doesn't take into -- [...truncated 3.08 MB...] org.apache.kafka.streams.test.ConsumerRecordFactory

Build failed in Jenkins: kafka-trunk-jdk11 #1480

2020-05-20 Thread Apache Jenkins Server
See Changes: [github] KAFKA-9859 / kafka-streams-application-reset tool doesn't take into -- [...truncated 3.04 MB...] > Task :streams:upgrade-system-tests-11:testClasse

Re: [DISCUSS] Apache Kafka 2.6.0 release

2020-05-20 Thread Sophie Blee-Goldman
Hey Randall, Can you also add KIP-613 which was accepted yesterday? Thanks! Sophie On Wed, May 20, 2020 at 6:47 AM Randall Hauch wrote: > Hi, Tom. I saw last night that the KIP had enough votes before today’s > deadline and I will add it to the roadmap today. Thanks for driving this! > > On We

[jira] [Resolved] (KAFKA-9859) kafka-streams-application-reset tool doesn't take into account topics generated by KTable foreign key join operation

2020-05-20 Thread Levani Kokhreidze (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Levani Kokhreidze resolved KAFKA-9859. -- Fix Version/s: 2.6.0 Resolution: Fixed fixed with PR [https://github.com/apache/

Re: [DISCUSS] KIP-587 Suppress detailed responses for handled exceptions in security-sensitive environments

2020-05-20 Thread Connor Penhale
Hi Chris, I agree that Connect shouldn't obtusely refuse operator-helpful information on known, handled exceptions. The situation you describe here feels like a great example. In cases like this, I would suggest printing the message, and in the field that would contain the stack trace, replacin

Build failed in Jenkins: kafka-trunk-jdk11 #1479

2020-05-20 Thread Apache Jenkins Server
See Changes: [github] MINOR: Fix redundant typos in comments and javadocs (#8693) -- [...truncated 1.77 MB...] kafka.controller.ControllerIntegrationTest > testTopicCrea

Re: [DISCUSS] KIP-602 - Change default value for client.dns.lookup

2020-05-20 Thread Rajini Sivaram
Deprecating for removal in 3.0 sounds good. On Wed, May 20, 2020 at 3:33 PM Ismael Juma wrote: > Is there any reason to use "use_first_dns_ip"? Should we remove it > completely? Or at least deprecate it for removal in 3.0? > > Ismael > > > On Wed, May 20, 2020, 1:39 AM Rajini Sivaram > wrote: >

Re: [DISCUSS] KIP-602 - Change default value for client.dns.lookup

2020-05-20 Thread Ismael Juma
Is there any reason to use "use_first_dns_ip"? Should we remove it completely? Or at least deprecate it for removal in 3.0? Ismael On Wed, May 20, 2020, 1:39 AM Rajini Sivaram wrote: > Hi Badai, > > Thanks for the KIP, sounds like a useful change. Perhaps we should call the > new option `use_f

Re: [DISCUSS] Apache Kafka 2.6.0 release

2020-05-20 Thread Randall Hauch
Hi, Tom. I saw last night that the KIP had enough votes before today’s deadline and I will add it to the roadmap today. Thanks for driving this! On Wed, May 20, 2020 at 6:18 AM Tom Bentley wrote: > Hi Randall, > > Can we add KIP-585? (I'm not quite sure of the protocol here, but thought > it bet

Build failed in Jenkins: kafka-trunk-jdk8 #4550

2020-05-20 Thread Apache Jenkins Server
See Changes: [github] MINOR: Fix redundant typos in comments and javadocs (#8693) -- [...truncated 3.08 MB...] org.apache.kafka.streams.test.ConsumerRecordFactoryTest >

Re: Want to remove the archive

2020-05-20 Thread Satya Kotni
Any update on this? Thanks & Regards Satya Kotni On Mon, 11 May 2020 at 10:54, Satya Kotni wrote: > > Hi, >> Please help me in removing this from the below archive >> >> https://www.mail-archive.com/dev@kafka.apache.org/msg104541.html >> >> Best Regards >> Satya Kotni >> >

Re: [DISCUSS] Apache Kafka 2.6.0 release

2020-05-20 Thread Tom Bentley
Hi Randall, Can we add KIP-585? (I'm not quite sure of the protocol here, but thought it better to ask than to just add it myself). Thanks, Tom On Tue, May 5, 2020 at 6:54 PM Randall Hauch wrote: > Greetings! > > I'd like to volunteer to be release manager for the next time-based feature > re

Re: [VOTE] KIP 585: Filter and conditional SMTs

2020-05-20 Thread Tom Bentley
Hi, The vote has passed with 3 binding votes (Konstantine, Mickael and Bill) and 3 non-binding votes (Andrew, Gunnar and Edoardo). Thanks to everyone who participated in the discussion and vote. Tom On Tue, May 19, 2020 at 9:45 PM Bill Bejeck wrote: > Thanks for the KIP Tom, this will be a us

Build failed in Jenkins: kafka-trunk-jdk8 #4549

2020-05-20 Thread Apache Jenkins Server
See Changes: -- Started by an SCM change Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on H44 (ubuntu) in workspace

[jira] [Resolved] (KAFKA-10026) KIP-584: Implement read path for versioning scheme for features

2020-05-20 Thread Kowshik Prakasam (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kowshik Prakasam resolved KAFKA-10026. -- Resolution: Duplicate Duplicate of KAFKA-10027 > KIP-584: Implement read path for ver

[jira] [Created] (KAFKA-10027) KIP-584: Implement read path for versioning scheme for features

2020-05-20 Thread Kowshik Prakasam (Jira)
Kowshik Prakasam created KAFKA-10027: Summary: KIP-584: Implement read path for versioning scheme for features Key: KAFKA-10027 URL: https://issues.apache.org/jira/browse/KAFKA-10027 Project: Kafk

[jira] [Created] (KAFKA-10026) KIP-584: Implement read path for versioning scheme for features

2020-05-20 Thread Kowshik Prakasam (Jira)
Kowshik Prakasam created KAFKA-10026: Summary: KIP-584: Implement read path for versioning scheme for features Key: KAFKA-10026 URL: https://issues.apache.org/jira/browse/KAFKA-10026 Project: Kafk

Build failed in Jenkins: kafka-trunk-jdk8 #4548

2020-05-20 Thread Apache Jenkins Server
See Changes: -- Started by an SCM change Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on H44 (ubuntu) in workspace

Build failed in Jenkins: kafka-trunk-jdk14 #107

2020-05-20 Thread Apache Jenkins Server
See Changes: [github] MINOR: Fix redundant typos in comments and javadocs (#8693) -- [...truncated 3.09 MB...] org.apache.kafka.streams.TopologyTestDriverTest > shouldCl

Re: [DISCUSS] KIP-602 - Change default value for client.dns.lookup

2020-05-20 Thread Rajini Sivaram
Hi Badai, Thanks for the KIP, sounds like a useful change. Perhaps we should call the new option `use_first_dns_ip` (not `_ips` since it refers to one). We should also mention in the KIP that only one type of address (ipv4 or ipv6, based on the first one) will be used - that is the current behavio

Build failed in Jenkins: kafka-trunk-jdk8 #4547

2020-05-20 Thread Apache Jenkins Server
See Changes: -- Started by an SCM change Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on H44 (ubuntu) in workspace

Re: [DISCUSS] KIP-553: Enable TLSv1.3 by default and disable all protocols except [TLSV1.2, TLSV1.3]

2020-05-20 Thread Nikolay Izhikov
Hello, Ismael. > What I meant to ask is if we changed the configuration so that TLS 1.3 is > exercised in the system tests by default. Are you suggesting just use TLSv1.3 instead of TLSv1.2 if the new version supported? Or you suggest introducing one more parameter for applicable tests like `s

Build failed in Jenkins: kafka-trunk-jdk8 #4546

2020-05-20 Thread Apache Jenkins Server
See Changes: -- Started by an SCM change Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on H44 (ubuntu) in workspace