Jenkins build is back to normal : kafka-2.1-jdk8 #146

See

Jenkins build is back to normal : kafka-2.0-jdk8 #238

See

[jira] [Created] (KAFKA-8083) Flaky Test DelegationTokenRequestsTest#testDelegationTokenRequests

Matthias J. Sax created KAFKA-8083: -- Summary: Flaky Test DelegationTokenRequestsTest#testDelegationTokenRequests Key: KAFKA-8083 URL: https://issues.apache.org/jira/browse/KAFKA-8083 Project: Kafka

[jira] [Created] (KAFKA-8082) Flaky Test ProducerFailureHandlingTest#testNotEnoughReplicasAfterBrokerShutdown

Matthias J. Sax created KAFKA-8082: -- Summary: Flaky Test ProducerFailureHandlingTest#testNotEnoughReplicasAfterBrokerShutdown Key: KAFKA-8082 URL: https://issues.apache.org/jira/browse/KAFKA-8082

Re: [DISCUSS] KIP-345: Reduce multiple consumer rebalances by specifying member id

Hi Mike, Yes that's the plan! From: Mike Freyberger Sent: Saturday, March 9, 2019 10:04 AM To: dev@kafka.apache.org Subject: Re: [DISCUSS] KIP-345: Reduce multiple consumer rebalances by specifying member id Hi Boyang, Is this work targeted for Kafka 2.3? I

Re: KIP-213 - Scalable/Usable Foreign-Key KTable joins - Rebooted.

SGTM. I also had the impression that those duplicates are rather an error than an case of eventual consistency. Using hashing to avoid sending the payload is a good idea IMHO. @Adam: can you update the KIP accordingly? - add the optimization to not send a reply from RHS to LHS on unsubscribe

[jira] [Created] (KAFKA-8081) Flaky Test TopicCommandWithAdminClientTest#testDescribeUnderMinIsrPartitions

Matthias J. Sax created KAFKA-8081: -- Summary: Flaky Test TopicCommandWithAdminClientTest#testDescribeUnderMinIsrPartitions Key: KAFKA-8081 URL: https://issues.apache.org/jira/browse/KAFKA-8081

Re: [DISCUSS] KIP-345: Reduce multiple consumer rebalances by specifying member id

Hi Boyang, Is this work targeted for Kafka 2.3? I am eager to use this new feature. Thanks, Mike Freyberger On 12/21/18, 1:21 PM, "Mayuresh Gharat" wrote: Hi Boyang, Regarding "However, we shall still attempt to remove the member static info if the given `member.id` points

Build failed in Jenkins: kafka-trunk-jdk8 #3450

See Changes: [bbejeck] MINOR: cleanup deprectaion annotations (#6290) -- [...truncated 2.33 MB...] org.apache.kafka.streams.test.OutputVerifierTest >

Build failed in Jenkins: kafka-2.2-jdk8 #52

See Changes: [rajinisivaram] KAFKA-7980 - Fix timing issue in [bill] KAFKA-8040: Streams handle initTransactions timeout (#6372) [rajinisivaram] KAFKA-8070: Increase consumer startup timeout in system tests

[jira] [Created] (KAFKA-8080) Remove streams_eos_test system test

John Roesler created KAFKA-8080: --- Summary: Remove streams_eos_test system test Key: KAFKA-8080 URL: https://issues.apache.org/jira/browse/KAFKA-8080 Project: Kafka Issue Type: Improvement

Re: Using Kafka Internals from Within Plugin

Since you have the Kafka configuration, you can open your own connection to ZK. You also have the advertised listeners from same file, if you want to connect back to the Kafka cluster to check things. I'd use that if possible for your use-case, accessing the log files directly seems a bit risky

Using Kafka Internals from Within Plugin

Hello! I'm experimenting with an implementation of AuthenticateCallbackHandler in an external JAR I’m loading, and I'd like to use some of the methods / properties from ReplicaManager (or KafkaServer which has a ReplicaManager), but I don't see anything that's passed to me or any singletons

[jira] [Reopened] (KAFKA-7288) Transient failure in SslSelectorTest.testCloseConnectionInClosingState

[ https://issues.apache.org/jira/browse/KAFKA-7288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram reopened KAFKA-7288: --- The check added to fix this issue was wrong, submitted new PR to fix properly. > Transient

Re: Speeding up integration tests

It's a classic problem: you can't string N things together serially and expect high reliability. 5,000 tests in a row isn't going to give you a bunch of 9's. It feels to me that the test frameworks themselves should support a more robust model -- like a way to tag a test as "retry me up to N

Jenkins build is back to normal : kafka-trunk-jdk8 #3448

See

[jira] [Created] (KAFKA-8079) Flaky Test EpochDrivenReplicationProtocolAcceptanceTest#shouldSurviveFastLeaderChange

Matthias J. Sax created KAFKA-8079: -- Summary: Flaky Test EpochDrivenReplicationProtocolAcceptanceTest#shouldSurviveFastLeaderChange Key: KAFKA-8079 URL: https://issues.apache.org/jira/browse/KAFKA-8079

[jira] [Created] (KAFKA-8078) Flaky Test TableTableJoinIntegrationTest#testInnerInner

Matthias J. Sax created KAFKA-8078: -- Summary: Flaky Test TableTableJoinIntegrationTest#testInnerInner Key: KAFKA-8078 URL: https://issues.apache.org/jira/browse/KAFKA-8078 Project: Kafka

[jira] [Created] (KAFKA-8077) Flaky Test AdminClientIntegrationTest#testConsumeAfterDeleteRecords

Matthias J. Sax created KAFKA-8077: -- Summary: Flaky Test AdminClientIntegrationTest#testConsumeAfterDeleteRecords Key: KAFKA-8077 URL: https://issues.apache.org/jira/browse/KAFKA-8077 Project: Kafka

Re: [VOTE] KIP-415: Incremental Cooperative Rebalancing in Kafka Connect

Thanks for the great KIP Konstantine! +1 (non-binding) Robert On Thu, Mar 7, 2019 at 2:56 PM Guozhang Wang wrote: > Thanks Konstantine, I've read the updated section on > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-415%3A+Incremental+Cooperative+Rebalancing+in+Kafka+Connect > and

Re: [VOTE] KIP-427: Add AtMinIsr topic partition category (new metric & TopicCommand option)

Hi All, Thanks for voting! I have moved the KIP to ACCEPTED. Stay tuned for the PR. Regards, Kevin On Fri, Mar 8, 2019 at 9:43 AM Dongjin Lee wrote: > With 3 binding with 3 non-binding +1, this proposal is now passed. > > Thanks for the KIP, Kevin! > > On Sat, 9 Mar 2019 at 2:40 AM Harsha

Build failed in Jenkins: kafka-2.1-jdk8 #145

See Changes: [jason] KAFKA-8069; Fix early expiration of offsets due to invalid loading of -- [...truncated 91.03 KB...]

Re: [VOTE] 2.2.0 RC1 [CANCELED]

A blocker was found: https://issues.apache.org/jira/browse/KAFKA-8069 I am canceling this VOTE in favor of a new RC. -Matthias On 3/7/19 10:13 AM, Jonathan Santilli wrote: > Hello Matthias, I have run the tests without issue. > Also, I have performed the quick start successfully, thanks for

Re: [VOTE] KIP-436 Add a metric indicating start time

With 3 binding with 3 non-binding +1, this proposal is now passed. On Sat, 9 Mar 2019 at 2:37 AM Harsha wrote: > +1 (binding) > > Thanks, > Harsha > > On Fri, Mar 8, 2019, at 2:55 AM, Dongjin Lee wrote: > > +1 (non binding) > > > > 2 bindings, 3 non-bindings until now. (Colin, Manikumar /

Re: [VOTE] KIP-427: Add AtMinIsr topic partition category (new metric & TopicCommand option)

With 3 binding with 3 non-binding +1, this proposal is now passed. Thanks for the KIP, Kevin! On Sat, 9 Mar 2019 at 2:40 AM Harsha wrote: > > +1 (binding) > > -Harsha > > On Thu, Mar 7, 2019, at 6:48 PM, hacker win7 wrote: > > +1 (non-binding) > > > > > On Mar 8, 2019, at 02:32, Stanislav

Re: [VOTE] KIP-427: Add AtMinIsr topic partition category (new metric & TopicCommand option)

+1 (binding) -Harsha On Thu, Mar 7, 2019, at 6:48 PM, hacker win7 wrote: > +1 (non-binding) > > > On Mar 8, 2019, at 02:32, Stanislav Kozlovski > > wrote: > > > > Thanks for the KIP, Kevin! This change will be a good improvement to > > Kafka's observability story > > > > +1 (non-binding)

Re: [VOTE] KIP-436 Add a metric indicating start time

+1 (binding) Thanks, Harsha On Fri, Mar 8, 2019, at 2:55 AM, Dongjin Lee wrote: > +1 (non binding) > > 2 bindings, 3 non-bindings until now. (Colin, Manikumar / Satish, Mickael, > Dongjin) > > On Fri, Mar 8, 2019 at 7:44 PM Mickael Maison > wrote: > > > +1 (non binding) > > Thanks > > > > On

[jira] [Resolved] (KAFKA-8069) Committed offsets get cleaned up right after the coordinator loading them back from __consumer_offsets in broker with old inter-broker protocol version (< 2.2)

[ https://issues.apache.org/jira/browse/KAFKA-8069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-8069. Resolution: Fixed Fix Version/s: 2.1.2 2.0.2 > Committed offsets

Build failed in Jenkins: kafka-2.1-jdk8 #144

See Changes: [bill] KAFKA-8040: Streams handle initTransactions timeout (#6372) -- [...truncated 92.11 KB...] where K,V are type-variables: K extends Object declared

[jira] [Reopened] (KAFKA-2933) Failure in kafka.api.PlaintextConsumerTest.testMultiConsumerDefaultAssignment

[ https://issues.apache.org/jira/browse/KAFKA-2933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-2933: Reopening this. Failed again in 2.2:

[jira] [Created] (KAFKA-8076) Flaky Test ProduceRequestTest#testSimpleProduceRequest

Matthias J. Sax created KAFKA-8076: -- Summary: Flaky Test ProduceRequestTest#testSimpleProduceRequest Key: KAFKA-8076 URL: https://issues.apache.org/jira/browse/KAFKA-8076 Project: Kafka

[jira] [Created] (KAFKA-8075) Flaky Test GroupAuthorizerIntegrationTest#testTransactionalProducerTopicAuthorizationExceptionInCommit

Matthias J. Sax created KAFKA-8075: -- Summary: Flaky Test GroupAuthorizerIntegrationTest#testTransactionalProducerTopicAuthorizationExceptionInCommit Key: KAFKA-8075 URL:

[jira] [Resolved] (KAFKA-7980) Flaky Test SocketServerTest#testConnectionRateLimit

[ https://issues.apache.org/jira/browse/KAFKA-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck resolved KAFKA-7980. Resolution: Fixed Resolving this as the PR build was started before the fix for this test was

[jira] [Resolved] (KAFKA-8040) Streams needs to retry initTransactions

[ https://issues.apache.org/jira/browse/KAFKA-8040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck resolved KAFKA-8040. Resolution: Fixed > Streams needs to retry initTransactions >

[jira] [Resolved] (KAFKA-8070) System test ConsumerGroupCommandTest fails intermittently with SSL

[ https://issues.apache.org/jira/browse/KAFKA-8070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-8070. --- Resolution: Fixed Reviewer: Ismael Juma > System test ConsumerGroupCommandTest fails

[jira] [Created] (KAFKA-8074) Create SSL keystore/truststore only once for each node in system tests

Rajini Sivaram created KAFKA-8074: - Summary: Create SSL keystore/truststore only once for each node in system tests Key: KAFKA-8074 URL: https://issues.apache.org/jira/browse/KAFKA-8074 Project:

Re: KIP-213 - Scalable/Usable Foreign-Key KTable joins - Rebooted.

Hi all, This proposal sounds good to me, especially since we observe that people are already confused when the see duplicate results coming out of 1:1 joins (which is a bug). I take this as "evidence" that we're better off eliminating those duplicates from the start. Guozhang's proposal seems

Re: Speeding up integration tests

> We internally have an improvement for a half a year now which reruns the flaky test classes at the end of the test gradle task, lets you know that they were rerun and probably flaky. It fails the build only if the second run of the test class was also unsuccessful. I think it works pretty good,

[jira] [Reopened] (KAFKA-7980) Flaky Test SocketServerTest#testConnectionRateLimit

[ https://issues.apache.org/jira/browse/KAFKA-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck reopened KAFKA-7980: Assignee: (was: Rajini Sivaram) Failed again in build

[jira] [Created] (KAFKA-8072) Transient failure in SslSelectorTest.testCloseOldestConnectionWithMultipleStagedReceives

Bill Bejeck created KAFKA-8072: -- Summary: Transient failure in SslSelectorTest.testCloseOldestConnectionWithMultipleStagedReceives Key: KAFKA-8072 URL: https://issues.apache.org/jira/browse/KAFKA-8072

[jira] [Created] (KAFKA-8073) Transient failure in kafka.api.UserQuotaTest.testThrottledProducerConsumer

Bill Bejeck created KAFKA-8073: -- Summary: Transient failure in kafka.api.UserQuotaTest.testThrottledProducerConsumer Key: KAFKA-8073 URL: https://issues.apache.org/jira/browse/KAFKA-8073 Project: Kafka

[jira] [Resolved] (KAFKA-7980) Flaky Test SocketServerTest#testConnectionRateLimit

[ https://issues.apache.org/jira/browse/KAFKA-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-7980. --- Resolution: Fixed Reviewer: Ismael Juma > Flaky Test

Re: KIP-213 - Scalable/Usable Foreign-Key KTable joins - Rebooted.

Hi Guozhang That would certainly work for eliminating those duplicate values. As it stands right now, this would be consistent with swallowing changes due to out-of-order processing with multiple threads, and seems like a very reasonable way forward. Thank you for the suggestion! I have been

[jira] [Created] (KAFKA-8071) Specify default partitions and replication factor for regex based topics in kafka

Abhi created KAFKA-8071: --- Summary: Specify default partitions and replication factor for regex based topics in kafka Key: KAFKA-8071 URL: https://issues.apache.org/jira/browse/KAFKA-8071 Project: Kafka

Build failed in Jenkins: kafka-trunk-jdk8 #3447

See Changes: [manikumar] KAFKA-8060: The Kafka protocol generator should allow null defaults -- [...truncated 4.67 MB...]

[jira] [Created] (KAFKA-8070) System test ConsumerGroupCommandTest fails intermittently with SSL

Rajini Sivaram created KAFKA-8070: - Summary: System test ConsumerGroupCommandTest fails intermittently with SSL Key: KAFKA-8070 URL: https://issues.apache.org/jira/browse/KAFKA-8070 Project: Kafka

Re: [VOTE] KIP-436 Add a metric indicating start time

+1 (non binding) 2 bindings, 3 non-bindings until now. (Colin, Manikumar / Satish, Mickael, Dongjin) On Fri, Mar 8, 2019 at 7:44 PM Mickael Maison wrote: > +1 (non binding) > Thanks > > On Fri, Mar 8, 2019 at 6:39 AM Satish Duggana > wrote: > > > > Thanks for the KIP, > > +1 (non-binding) > >

Re: [VOTE] KIP-436 Add a metric indicating start time

+1 (non binding) Thanks On Fri, Mar 8, 2019 at 6:39 AM Satish Duggana wrote: > > Thanks for the KIP, > +1 (non-binding) > > ~Satish. > > On Thu, Mar 7, 2019 at 11:58 PM Manikumar wrote: > > > +1 (binding). > > > > Thanks for the KIP. > > > > Thanks, > > Manikumar > > > > > > On Thu, Mar 7, 2019

[jira] [Reopened] (KAFKA-7976) Flaky Test DynamicBrokerReconfigurationTest#testUncleanLeaderElectionEnable

[ https://issues.apache.org/jira/browse/KAFKA-7976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram reopened KAFKA-7976: --- Test has failed again, so the fix wasn't sufficient. > Flaky Test

Build failed in Jenkins: kafka-trunk-jdk8 #3446

See Changes: [github] KAFKA-7831; Do not modify subscription state from background thread -- [...truncated 4.68 MB...] org.apache.kafka.streams.TopologyTestDriverTest >