Build failed in Jenkins: kafka-trunk-jdk8 #4204

2020-02-03 Thread Apache Jenkins Server
See Changes: [github] KAFKA-9490: Fix generics for Grouped (#8028) -- [...truncated 2.85 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

Re: [DISCUSS] 2.4.1 Bug Fix Release

2020-02-03 Thread Guozhang Wang
Hi Bill, thanks for driving this. +1 On Mon, Feb 3, 2020 at 6:40 PM Ismael Juma wrote: > Thanks for volunteering, +1. > > On Mon, Feb 3, 2020, 5:27 PM Bill Bejeck wrote: > > > Hi All, > > > > I'd like to volunteer for the release manager of the 2.4.1 bug fix > release. > > > > Kafka 2.4.0 was

Re: [KAFKA-557] Add emit on change support for Kafka Streams

2020-02-03 Thread John Roesler
Hi Matthias, Richard, and Bruno, I hope you don't mind if I try to reply to your conversation holistically instead of individually: 1. Regarding whether to propose emit-on-change for KStream aggregations, I think I misunderstood your prior points. The spirit of my response was simply to say

Build failed in Jenkins: kafka-trunk-jdk11 #1127

2020-02-03 Thread Apache Jenkins Server
See Changes: [github] Bump trunk to 2.6.0-SNAPSHOT (#8026) -- [...truncated 2.86 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

Re: [DISCUSS] 2.4.1 Bug Fix Release

2020-02-03 Thread Ismael Juma
Thanks for volunteering, +1. On Mon, Feb 3, 2020, 5:27 PM Bill Bejeck wrote: > Hi All, > > I'd like to volunteer for the release manager of the 2.4.1 bug fix release. > > Kafka 2.4.0 was released on December 16, 2019, and so far 19 issues have > been fixed since then. > > Here is a complete

[DISCUSS] 2.4.1 Bug Fix Release

2020-02-03 Thread Bill Bejeck
Hi All, I'd like to volunteer for the release manager of the 2.4.1 bug fix release. Kafka 2.4.0 was released on December 16, 2019, and so far 19 issues have been fixed since then. Here is a complete list:

Build failed in Jenkins: kafka-trunk-jdk11 #1126

2020-02-03 Thread Apache Jenkins Server
See Changes: [github] MINOR: Refactor CheckpointFile to improve testability (#7391) [github] KAFKA-9027, KAFKA-9028: Convert create/delete acls requests/response to --

[jira] [Created] (KAFKA-9503) TopologyTestDriver processes intermediate results in the wrong order

2020-02-03 Thread John Roesler (Jira)
John Roesler created KAFKA-9503: --- Summary: TopologyTestDriver processes intermediate results in the wrong order Key: KAFKA-9503 URL: https://issues.apache.org/jira/browse/KAFKA-9503 Project: Kafka

Re: [DISCUSS] KIP-158 UPDATED: Enable source connectors to create new topics with specific configs in Kafka Connect during runtime

2020-02-03 Thread Jose Garcia Sancio
Thanks Konstantine. Looking forward to this feature. The KIP mentions: > For the *default* group this configuration is required. For any other group defined in topic.creation.groups this config is optional and if it's missing it gets the value the *default* group For the properties

[jira] [Resolved] (KAFKA-9422) Track the set of topics a connector is using

2020-02-03 Thread Konstantine Karantasis (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantine Karantasis resolved KAFKA-9422. --- Resolution: Fixed > Track the set of topics a connector is using >

[jira] [Created] (KAFKA-9502) Use explicit "purge data" for windowed changelog topics instead of "delete,compact" topic config

2020-02-03 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-9502: -- Summary: Use explicit "purge data" for windowed changelog topics instead of "delete,compact" topic config Key: KAFKA-9502 URL:

Build failed in Jenkins: kafka-trunk-jdk8 #4203

2020-02-03 Thread Apache Jenkins Server
See Changes: [github] Bump trunk to 2.6.0-SNAPSHOT (#8026) -- [...truncated 2.85 MB...] org.apache.kafka.streams.test.OutputVerifierTest >

Re: [DISCUSS] KIP-491: Preferred Leader Deprioritized List (Temporary Blacklist)

2020-02-03 Thread George Li
Hi Stanislav/Colin, A couple people ran into issues with auto.leader.rebalance.enable=true in  https://issues.apache.org/jira/browse/KAFKA-4084 And I think KIP-491 can help solve that issue.  We have implemented KIP-491 internally together with another feature called latest offset for quickly

[jira] [Created] (KAFKA-9501) Promote Standby tasks to active tasks without closing them

2020-02-03 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-9501: -- Summary: Promote Standby tasks to active tasks without closing them Key: KAFKA-9501 URL: https://issues.apache.org/jira/browse/KAFKA-9501 Project: Kafka

[jira] [Created] (KAFKA-9500) Foreign-Key Join creates an invalid topology

2020-02-03 Thread John Roesler (Jira)
John Roesler created KAFKA-9500: --- Summary: Foreign-Key Join creates an invalid topology Key: KAFKA-9500 URL: https://issues.apache.org/jira/browse/KAFKA-9500 Project: Kafka Issue Type: Bug

Build failed in Jenkins: kafka-2.5-jdk8 #2

2020-02-03 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-9027, KAFKA-9028: Convert create/delete acls requests/response to -- [...truncated 2.85 MB...] org.apache.kafka.streams.test.OutputVerifierTest >

Build failed in Jenkins: kafka-trunk-jdk8 #4202

2020-02-03 Thread Apache Jenkins Server
See Changes: [github] MINOR: Refactor CheckpointFile to improve testability (#7391) [github] KAFKA-9027, KAFKA-9028: Convert create/delete acls requests/response to --

Re: [KAFKA-557] Add emit on change support for Kafka Streams

2020-02-03 Thread John Roesler
Hi Richard and Ted, Wow, really good catch! Yes, we absolutely need metrics and logs if we're going to drop any records. And, yes, we should propose metrics and logs that are similar to the existing ones when we drop records for other reasons. Please go ahead and add the proposal to the KIP.

Re: [KAFKA-557] Add emit on change support for Kafka Streams

2020-02-03 Thread John Roesler
Hi Tommy, Thanks for the context. I can see the attraction of considering these use cases together. To answer your question, if a part of the record is not relevant to downstream consumers, I was thinking you could just use a mapValue to remove it. E.g., suppose you wanted to do a join between

[jira] [Resolved] (KAFKA-9027) Replace CreateAcls request/response with automated protocol

2020-02-03 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-9027. Fix Version/s: 2.5.0 Assignee: Ismael Juma (was: Mickael Maison) Resolution: Fixed

[jira] [Resolved] (KAFKA-9028) Replace DeleteAcls request/response with automated protocol

2020-02-03 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-9028. Fix Version/s: 2.5.0 Assignee: Ismael Juma (was: Mickael Maison) Resolution: Fixed

[jira] [Created] (KAFKA-9499) Batch topics deletion

2020-02-03 Thread David Jacot (Jira)
David Jacot created KAFKA-9499: -- Summary: Batch topics deletion Key: KAFKA-9499 URL: https://issues.apache.org/jira/browse/KAFKA-9499 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-9498) Topic validation during the creation trigger unnecessary TopicChange events

2020-02-03 Thread David Jacot (Jira)
David Jacot created KAFKA-9498: -- Summary: Topic validation during the creation trigger unnecessary TopicChange events Key: KAFKA-9498 URL: https://issues.apache.org/jira/browse/KAFKA-9498 Project:

Re: [KAFKA-557] Add emit on change support for Kafka Streams

2020-02-03 Thread Thomas Becker
Hi John, Can you describe how you'd use filtering/mapping to deduplicate records? To give some background on my suggestion we currently have a small stream processor that exists solely to deduplicate, which we do using a process that I assume would be similar to what would be done here (with a

[jira] [Created] (KAFKA-9497) Brokers start up even if SASL provider is not loaded and throw NPE when clients connect

2020-02-03 Thread Rajini Sivaram (Jira)
Rajini Sivaram created KAFKA-9497: - Summary: Brokers start up even if SASL provider is not loaded and throw NPE when clients connect Key: KAFKA-9497 URL: https://issues.apache.org/jira/browse/KAFKA-9497

Build failed in Jenkins: kafka-trunk-jdk8 #4201

2020-02-03 Thread Apache Jenkins Server
See Changes: [github] MINOR: updated documentation where RocksDBStore was being used as the -- [...truncated 2.37 MB...] org.apache.kafka.streams.StreamsConfigTest >