Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #259

See Changes: [github] MINOR: Make Histogram#clear more readable (#9679) [github] KAFKA-10803: Fix improper removal of bad dynamic config (#9682) -- [...trunc

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #260

See Changes: [github] KAFKA-10500: Add failed-stream-threads metric for adding + removing stream threads (#9614) -- [...truncated 2.37 MB...] org.apache.kafk

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #305

See Changes: [github] KAFKA-10500: Add failed-stream-threads metric for adding + removing stream threads (#9614) -- [...truncated 2.40 MB...] org.apache.kaf

[jira] [Created] (KAFKA-10808) Improve LogCleaner logs

Omnia Ibrahim created KAFKA-10808: - Summary: Improve LogCleaner logs Key: KAFKA-10808 URL: https://issues.apache.org/jira/browse/KAFKA-10808 Project: Kafka Issue Type: Improvement C

Jenkins build is back to normal : Kafka » kafka-trunk-jdk11 #282

See

Re: [DISCUSS] KIP-687: Automatic Reloading of Security Store

Hi Boyang, I think that it would improve the ergonomics of dealing with short lived certificates to have this be the default behaviour. It should be noted that transparently reloading certificates and keys when they changed on disk can be implemented right now registering a custom KeyManagerFa

Re: [DISCUSS] KIP-687: Automatic Reloading of Security Store

Hello, Boyang Chen. I think this KIP overlaps with my idea [1] of exposing information about certificates Kafka uses. Kafka administrator should initiate renewal certificates procedure not long before the certificate expires. But, for now, there is no way for administrators to know the expiratio

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #283

See Changes: [github] KAFKA-10500: Add failed-stream-threads metric for adding + removing stream threads (#9614) -- [...truncated 2.40 MB...] org.apache.kaf

[jira] [Created] (KAFKA-10809) Make all system tests run on Travis CI stably

Chia-Ping Tsai created KAFKA-10809: -- Summary: Make all system tests run on Travis CI stably Key: KAFKA-10809 URL: https://issues.apache.org/jira/browse/KAFKA-10809 Project: Kafka Issue Type:

create KIP permission

Could you please grant me access to Create KIP's. thank you, My ID is dengziming

Re: [DISCUSS] KIP-687: Automatic Reloading of Security Store

Hi Boyang, The proposed change relies on a file watch, why not also have a polling interval to check the file for changes? What happens if the file is changed into an invalid store? Does the previous store stay in use? Thanks, -- Igor On Fri, Dec 4, 2020, at 1:28 AM, Boyang Chen wrote: > He

[jira] [Resolved] (KAFKA-10308) fix flaky core/round_trip_fault_test.py

[ https://issues.apache.org/jira/browse/KAFKA-10308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-10308. Fix Version/s: 2.7.0 Resolution: Fixed > fix flaky core/round_trip_fault_test.py >

[jira] [Resolved] (KAFKA-10799) AlterIsr path does not update ISR shrink/expand meters

[ https://issues.apache.org/jira/browse/KAFKA-10799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck resolved KAFKA-10799. - Resolution: Fixed > AlterIsr path does not update ISR shrink/expand meters > ---

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #306

See Changes: [github] MINOR: a small refactor for LogManage#shutdown (#9680) -- [...truncated 2.40 MB...] org.apache.kafka.streams.test.OutputVerifierTest >

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #284

See Changes: [github] MINOR: a small refactor for LogManage#shutdown (#9680) [github] KAFKA-10665: close all kafkaStreams before purgeLocalStreamsState (#9674) ---

[VOTE] 2.7.0 RC4

Hello Kafka users, developers, and client-developers, This is the fifth candidate for the release of Apache Kafka 2.7.0. This is a major release that includes many new features, including: * Configurable TCP connection timeout and improve the initial metadata fetch * Enforce broker-wide and per-

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #261

See Changes: [github] MINOR: a small refactor for LogManage#shutdown (#9680) [github] KAFKA-10665: close all kafkaStreams before purgeLocalStreamsState (#9674)

Build failed in Jenkins: Kafka » kafka-2.7-jdk8 #69

See Changes: [Bill Bejeck] KAFKA-10665: close all kafkaStreams before purgeLocalStreamsState (#9674) -- [...truncated 3.43 MB...] org.apache.kafka.streams.test

Re: [DISCUSS] KIP-690: Add additional configuration to control MirrorMaker 2 internal topics naming convention

Thanks Omnia, this looks great. I like the approach of introducing another policy class. Ryanne On Tue, Dec 1, 2020, 9:36 AM Omnia Ibrahim wrote: > Hi everyone > I want to start discussion of the KIP 690, the proposal is here > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-690%3A+Add+

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #307

See Changes: [github] KAFKA-10665: close all kafkaStreams before purgeLocalStreamsState (#9674) -- [...truncated 2.40 MB...] org.apache.kafka.streams.test.

Re: [DISCUSS] KIP-687: Automatic Reloading of Security Store

Hey Igor, thanks for the feedback. On Fri, Dec 4, 2020 at 5:24 AM Igor Soarez wrote: > Hi Boyang, > > The proposed change relies on a file watch, why not also have a polling > interval to check the file for changes? > > The periodical check could work, the slight downside is that we need additio

Re: create KIP permission

Hello Ziming, I saw your ID has been added, you should be able to create KIP page now. On Fri, Dec 4, 2020 at 5:24 AM deng ziming wrote: > Could you please grant me access to Create KIP's. thank you, My ID is > dengziming > -- -- Guozhang

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #285

See Changes: [github] MINOR: Leaves lock() outside the try block (#9687) -- [...truncated 2.40 MB...] org.apache.kafka.streams.test.MockProcessorContextStat

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #262

See Changes: [github] MINOR: Leaves lock() outside the try block (#9687) -- [...truncated 2.37 MB...] org.apache.kafka.streams.TopologyTestDriverTest > shou

Re: [DISCUSS] KIP-691: Transactional Producer Exception Handling

Thanks Boyang for the proposal! I made a pass over the list and here are some thoughts: 0) Although this is not part of the public API, I think we should make sure that the suggested pattern (i.e. user can always call abortTxn() when handling non-fatal errors) are indeed supported. E.g. if the txn

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #308

See Changes: [github] MINOR: Leaves lock() outside the try block (#9687) -- [...truncated 2.40 MB...] org.apache.kafka.streams.test.OutputVerifierTest > sh

Re: [DISCUSS] KIP-687: Automatic Reloading of Security Store

Thanks for the feedback Nikolay. I think our proposals are solving orthogonal issues. The KIP is proposing to deprecate the reloading path on AlterConfig, which has nothing to do with general certification expire issue. Best, Boyang On Fri, Dec 4, 2020 at 4:26 AM Nikolay Izhikov wrote: > Hello,

[VOTE] KIP-679: Producer will enable the strongest delivery guarantee by default

Hi all, I’m proposing a new KIP for enabling the strongest delivery guarantee by default. Today Kafka support EOS and N-1 concurrent failure tolerance but the default settings haven’t bring them out of the box. The proposal changes include the producer defaults change to `ack=all` and `enable.

Re: [DISCUSS] KIP-687: Automatic Reloading of Security Store

Thanks Noa for the suggested path. Like you mentioned, I feel this mechanism is a little bit overkill for a simple security file reloading case. Could you provide more context on the benefit of doing a customized KeyManager setup? TBH, I don't see Kafka going deep into these low level security deta

[jira] [Created] (KAFKA-10810) Add a replace thread option to the streams uncaught exception handler

Walker Carlson created KAFKA-10810: -- Summary: Add a replace thread option to the streams uncaught exception handler Key: KAFKA-10810 URL: https://issues.apache.org/jira/browse/KAFKA-10810 Project:

Re: [DISCUSS] KIP-622 Add currentSystemTimeMs and currentStreamTimeMs to ProcessorContext

1. We don't need to worry about impl detail. But yes, we can remove the method from the interanl context that extends `ProcessorContext` already 2. Same here: we can discuss on the PR. Btw: it seems you got enough votes. Can you close the vote? Looking forward to your PR. -Matthias On 11/27/2

Build failed in Jenkins: Kafka » kafka-2.7-jdk8 #70

See Changes: -- [...truncated 3.43 MB...] org.apache.kafka.streams.test.OutputVerifierTest > shouldPassIfValueAndTimestampIsEqualWithNullForCompareValueTimestamp PASSED org

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #286

See Changes: [github] KAFKA-10792: Prevent source task shutdown from blocking herder thread (#9669) -- [...truncated 2.41 MB...] org.apache.kafka.streams.t

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #263

See Changes: [github] KAFKA-10792: Prevent source task shutdown from blocking herder thread (#9669) -- [...truncated 2.37 MB...] org.apache.kafka.streams.To

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #309

See Changes: [github] KAFKA-10792: Prevent source task shutdown from blocking herder thread (#9669) -- [...truncated 2.40 MB...] org.apache.kafka.streams.t

Re: [DISCUSSION] KIP-650: Enhance Kafkaesque Raft semantics

Hi Boyang, Thanks for raising this up. I have a few thoughts about the "Non-leader Linearizable Read", and I think there are two goals we can consider achieving here from a user's perspective: 1) that each of your queries on the raft log is always going to return the latest committed result. 2)

Build failed in Jenkins: Kafka » kafka-2.7-jdk8 #71

See Changes: [Randall Hauch] KAFKA-10792: Prevent source task shutdown from blocking herder thread (#9669) [Randall Hauch] Revert "KAFKA-10792: Prevent source task shutdown from blocking herder thread

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #264

See Changes: [github] KAFKA-10629: TopologyTestDriver should not require a Properties argument (#9660) [github] HOTFIX: fix failed build caused by StreamThreadTest (#9691) [github] KAFKA-10500: All

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #287

See Changes: [github] KAFKA-10629: TopologyTestDriver should not require a Properties argument (#9660) [github] HOTFIX: fix failed build caused by StreamThreadTest (#9691) [github] KAFKA-10500: Al

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #310

See Changes: [github] KAFKA-10629: TopologyTestDriver should not require a Properties argument (#9660) [github] HOTFIX: fix failed build caused by StreamThreadTest (#9691) [github] KAFKA-10500: Al

[DISCUSS] KIP-695: Improve Streams Time Synchronization

Hello all, I'd like to propose KIP-695 to improve on the "task idling" feature we introduced in KIP-353. This KIP will allow Streams to offer deterministic time semantics in join-type topologies. For example, it makes sure that when you join two topics, that we collate the topics by timestamp. Tha

[jira] [Resolved] (KAFKA-10792) Source tasks can block herder thread by hanging during stop

[ https://issues.apache.org/jira/browse/KAFKA-10792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-10792. --- Fix Version/s: 2.7.1 Resolution: Fixed > Source tasks can block herder thread by hang

[jira] [Created] (KAFKA-10811) System exit from MirrorConnectorsIntegrationTest#testReplication

Randall Hauch created KAFKA-10811: - Summary: System exit from MirrorConnectorsIntegrationTest#testReplication Key: KAFKA-10811 URL: https://issues.apache.org/jira/browse/KAFKA-10811 Project: Kafka

[jira] [Created] (KAFKA-10812) Unclean worker shutdown in MirrorConnectorsIntegrationTest

Chris Egerton created KAFKA-10812: - Summary: Unclean worker shutdown in MirrorConnectorsIntegrationTest Key: KAFKA-10812 URL: https://issues.apache.org/jira/browse/KAFKA-10812 Project: Kafka

[jira] [Created] (KAFKA-10813) StreamsProducer should catch InvalidProducerEpoch and throw TaskMigrated in all cases

Boyang Chen created KAFKA-10813: --- Summary: StreamsProducer should catch InvalidProducerEpoch and throw TaskMigrated in all cases Key: KAFKA-10813 URL: https://issues.apache.org/jira/browse/KAFKA-10813 P

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #265

See Changes: [github] MINOR: Do not print log4j for memberId required (#9667) -- [...truncated 3.45 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #311

See Changes: [github] MINOR: Do not print log4j for memberId required (#9667) -- [...truncated 3.48 MB...] org.apache.kafka.streams.test.OutputVerifierTest

Build failed in Jenkins: Kafka » kafka-2.7-jdk8 #72

See Changes: [Matthias J. Sax] KAFKA-8147: Update upgrade notes for KIP-446 (#8965) -- [...truncated 6.87 MB...] org.apache.kafka.streams.test.OutputVerifierTes

Re: [VOTE] KIP-622 Add currentSystemTimeMs and currentStreamTimeMs to ProcessorContext

Hello all, I am closing the vote for this KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-622%3A+Add+currentSystemTimeMs+and+currentStreamTimeMs+to+ProcessorContext Summary of the KIP: Planning to add two new methods to ProcessorContext: 1. long currentSystemTimeMs() to fetch wall-cloc

Re: [VOTE] KIP-689: Extend `StreamJoined` to allow more store configs

Sorry I missed the discussion, but I just read the KIP and the discussion. It all looks good to me. +1 (binding) -John On Thu, 2020-12-03 at 14:00 -0700, Matthias J. Sax wrote: > +1 (binding) > > On 12/3/20 11:21 AM, Guozhang Wang wrote: > > +1 (binding) > > > > Thanks Leah! > > > > On Wed, D