Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #105

2020-10-01 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10134 Follow-up: Set the re-join flag in heartbeat failure (#9354) -- [...truncated 3.33 MB...]

Build failed in Jenkins: Kafka » kafka-2.6-jdk8 #22

2020-10-01 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-10134 Follow-up: Set the re-join flag in heartbeat failure (#9354) -- [...truncated 3.16 MB...]

Re: [DISCUSS] KIP-516: Topic Identifiers

2020-10-01 Thread Justine Olshan
Hi Jun, Thanks for looking at it again. Here's the new spec. (I fixed the typo in it too.) {"name": "id", "type": "string", "doc": option[UUID]} Justine On Thu, Oct 1, 2020 at 5:03 PM Jun Rao wrote: > Hi, Justine, > > Thanks for the update. The KIP looks good to me now. Just a minor comment >

Re: [DISCUSS] KIP-630: Kafka Raft Snapshot

2020-10-01 Thread Jose Garcia Sancio
Comments below. Here are the change to the KIP: https://cwiki.apache.org/confluence/pages/diffpagesbyversion.action?pageId=158864763=34=33 > 41. That's a good point. With compacted topic, the cleaning won't be done > until the active segment rolls. With snapshots, I guess we don't have this >

Re: [VOTE] KIP-478 Strongly Typed Streams Processor API

2020-10-01 Thread Matthias J. Sax
Thanks John. SGTM. On 10/1/20 2:50 PM, John Roesler wrote: > Hello again, all, > > I'm sorry to make another tweak to this KIP, but during the > implementation of the design we've just agreed on, I > realized that Processors would almost never need to > reference the RecordMetadata. Therefore,

Re: [DISCUSS] KIP-516: Topic Identifiers

2020-10-01 Thread Jun Rao
Hi, Justine, Thanks for the update. The KIP looks good to me now. Just a minor comment below. 30. Perhaps "option[UUID]" can be put in the doc. Jun On Thu, Oct 1, 2020 at 3:28 PM Justine Olshan wrote: > Hi Jun, > Thanks for the response! > > 30. I think I might have changed this in between.

[jira] [Created] (KAFKA-10565) Console producer displays interactive prompt even when input is not interactive

2020-10-01 Thread Sergei Morozov (Jira)
Sergei Morozov created KAFKA-10565: -- Summary: Console producer displays interactive prompt even when input is not interactive Key: KAFKA-10565 URL: https://issues.apache.org/jira/browse/KAFKA-10565

Build failed in Jenkins: Kafka » kafka-2.4-jdk8 #8

2020-10-01 Thread Apache Jenkins Server
See Changes: [github] Backport Jenkinsfile to 2.4 branch (#9329) -- [...truncated 2.90 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

Re: [DISCUSS] KIP-516: Topic Identifiers

2020-10-01 Thread Justine Olshan
Hi Jun, Thanks for the response! 30. I think I might have changed this in between. The current version says: {"name": "id", "type": "option[UUID]"}, "doc": topic id} I have switched to the option type to cover the migration case where a TopicZNode does not yet have a topic ID. I understand that

Re: [DISCUSS] KIP-630: Kafka Raft Snapshot

2020-10-01 Thread Guozhang Wang
Thanks for the clarification Jose, that clears my confusions already :) Guozhang On Thu, Oct 1, 2020 at 10:51 AM Jose Garcia Sancio wrote: > Thanks for the email Guozhang. > > > Thanks for the replies and the KIP updates. Just want to clarify one more > > thing regarding my previous comment

Re: [VOTE] KIP-478 Strongly Typed Streams Processor API

2020-10-01 Thread John Roesler
Hello again, all, I'm sorry to make another tweak to this KIP, but during the implementation of the design we've just agreed on, I realized that Processors would almost never need to reference the RecordMetadata. Therefore, I'm proposing to streamline the API by moving the Optional to the new

Re: [DISCUSS] KIP-630: Kafka Raft Snapshot

2020-10-01 Thread Jun Rao
Hi, Jose, Thanks for the reply. A few more comments. 41. That's a good point. With compacted topic, the cleaning won't be done until the active segment rolls. With snapshots, I guess we don't have this restriction? So, it would be useful to guard against too frequent snapshotting. Does the new

[jira] [Created] (KAFKA-10564) Continuous logging about deleting obsolete state directories

2020-10-01 Thread Michael Bingham (Jira)
Michael Bingham created KAFKA-10564: --- Summary: Continuous logging about deleting obsolete state directories Key: KAFKA-10564 URL: https://issues.apache.org/jira/browse/KAFKA-10564 Project: Kafka

[jira] [Created] (KAFKA-10563) Make sure task directories don't remain locked by dead threads

2020-10-01 Thread Sophie Blee-Goldman (Jira)
Sophie Blee-Goldman created KAFKA-10563: --- Summary: Make sure task directories don't remain locked by dead threads Key: KAFKA-10563 URL: https://issues.apache.org/jira/browse/KAFKA-10563

Re: [DISCUSS] KIP-630: Kafka Raft Snapshot

2020-10-01 Thread Jose Garcia Sancio
Thanks for the email Guozhang. > Thanks for the replies and the KIP updates. Just want to clarify one more > thing regarding my previous comment 3): I understand that when a snapshot > has completed loading, then we can use it in our handling logic of vote > request. And I understand that: > > 1)

Re: [DISCUSS] Apache Kafka 2.7.0 release

2020-10-01 Thread Bill Bejeck
All, With the KIP acceptance deadline passing yesterday, I've updated the planned KIP content section of the 2.7.0 release plan . Removed proposed KIPs for 2.7.0 not getting approval 1. KIP-653

Re: [DISCUSS] Apache Kafka 2.6.1 release

2020-10-01 Thread Bill Bejeck
Thanks, Mickael it's a + 1 for me. -Bill On Thu, Oct 1, 2020 at 1:17 PM Matthias J. Sax wrote: > +1 > > On 10/1/20 8:24 AM, Ismael Juma wrote: > > Thanks Mickael! +1 > > > > Ismael > > > > On Thu, Oct 1, 2020 at 7:40 AM Mickael Maison > > wrote: > > > >> Hi, > >> > >> I'd like to volunteer to

Re: [DISCUSS] Apache Kafka 2.6.1 release

2020-10-01 Thread Matthias J. Sax
+1 On 10/1/20 8:24 AM, Ismael Juma wrote: > Thanks Mickael! +1 > > Ismael > > On Thu, Oct 1, 2020 at 7:40 AM Mickael Maison > wrote: > >> Hi, >> >> I'd like to volunteer to be the release manager for the next bugfix >> release, 2.6.1. >> I created the release plan on the wiki: >>

Re: [DISCUSS] KIP-630: Kafka Raft Snapshot

2020-10-01 Thread Jose Garcia Sancio
Thank you for the quick response Jun. Excuse the delayed response but I wanted to confirm some things regarding IBP. See comments below. Here are my changes to the KIP: https://cwiki.apache.org/confluence/pages/diffpagesbyversion.action?pageId=158864763=30=28 > 40. LBO: Code wise, logStartOffset

Re: [DISCUSS] KIP-660: Pluggable ReplicaAssignor

2020-10-01 Thread Mickael Maison
Thanks Tom for the feedback! 1. If the data returned by the ReplicaAssignor implementation does not match that was requested, we'll also throw a ReplicaAssignorException 2. Good point, I'll update the KIP 3. The KIP mentions an error code associated with ReplicaAssignorException:

Jenkins build is back to normal : Kafka » kafka-trunk-jdk15 #138

2020-10-01 Thread Apache Jenkins Server
See

Re: [DISCUSS] Apache Kafka 2.6.1 release

2020-10-01 Thread Ismael Juma
Thanks Mickael! +1 Ismael On Thu, Oct 1, 2020 at 7:40 AM Mickael Maison wrote: > Hi, > > I'd like to volunteer to be the release manager for the next bugfix > release, 2.6.1. > I created the release plan on the wiki: > https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+2.6.1 > >

[jira] [Created] (KAFKA-10562) Delegate the store wrappers to the new init method

2020-10-01 Thread John Roesler (Jira)
John Roesler created KAFKA-10562: Summary: Delegate the store wrappers to the new init method Key: KAFKA-10562 URL: https://issues.apache.org/jira/browse/KAFKA-10562 Project: Kafka Issue

[DISCUSS] Apache Kafka 2.6.1 release

2020-10-01 Thread Mickael Maison
Hi, I'd like to volunteer to be the release manager for the next bugfix release, 2.6.1. I created the release plan on the wiki: https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+2.6.1 Thanks

[jira] [Reopened] (KAFKA-10017) Flaky Test EosBetaUpgradeIntegrationTest.shouldUpgradeFromEosAlphaToEosBeta

2020-10-01 Thread Bill Bejeck (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck reopened KAFKA-10017: - > Flaky Test EosBetaUpgradeIntegrationTest.shouldUpgradeFromEosAlphaToEosBeta >

Re: [DISCUSS] KIP-567: Kafka Cluster Audit (new discussion)

2020-10-01 Thread Tom Bentley
Hi Viktor, Like Mickael, I can see that there's value in having an audit trail. For me the KIP raises a number of questions in its current form: Why is it necessary to introduce this interface to produce the audit trail when there is logging that can already record a lot of the same information,

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #104

2020-10-01 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10556: NPE if sasl.mechanism is unrecognized (#9356) -- [...truncated 3.33 MB...]

[VOTE] KIP-665 Kafka Connect Hash SMT

2020-10-01 Thread bran...@bbrownsound.com
Hey Kafka Developers, I’ve created the following KIP and updated it based on feedback from Mickael. I was wondering if we could get a vote on my proposal and move forward with the proposed pr. Thanks so much! -Brandon

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #137

2020-10-01 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10503: MockProducer doesn't throw ClassCastException when no partition for topic exists (#9309) -- [...truncated 6.71 MB...]

Re: [DISCUSS] KIP-567: Kafka Cluster Audit (new discussion)

2020-10-01 Thread Dániel Urbán
Hi Viktor, I think the current state of the proposal is flexible enough to support use-cases where the response data is of interest to the auditor. This part ensures that: "... doing the auditing before sending the response back ...". Additionally, event classes could be extended with additional

Jenkins build is back to normal : Kafka » kafka-trunk-jdk15 #136

2020-10-01 Thread Apache Jenkins Server
See

Jenkins build is back to normal : Kafka » kafka-trunk-jdk8 #102

2020-10-01 Thread Apache Jenkins Server
See

Jenkins build is back to normal : Kafka » kafka-trunk-jdk11 #104

2020-10-01 Thread Apache Jenkins Server
See

Re: [VOTE] KIP-673: Emit JSONs with new auto-generated schema

2020-10-01 Thread David Jacot
Thanks for the KIP, Anastasia. +1 (non-binding) On Thu, Oct 1, 2020 at 8:06 AM Tom Bentley wrote: > Thanks Anastasia, > > +1 (non-binding) > > > On Thu, Oct 1, 2020 at 6:30 AM Gwen Shapira wrote: > > > Thank you, this will be quite helpful. > > > > +1 (binding) > > > > On Wed, Sep 30, 2020 at

Re: [VOTE] KIP-673: Emit JSONs with new auto-generated schema

2020-10-01 Thread Tom Bentley
Thanks Anastasia, +1 (non-binding) On Thu, Oct 1, 2020 at 6:30 AM Gwen Shapira wrote: > Thank you, this will be quite helpful. > > +1 (binding) > > On Wed, Sep 30, 2020 at 11:19 AM Anastasia Vela > wrote: > > > > Hi everyone, > > > > Thanks again for the discussion. I'd like to start the