[jira] [Resolved] (KAFKA-7930) StreamsResetter makes "changelog" topic naming assumptions

2019-02-20 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-7930. Resolution: Fixed Fix Version/s: 2.3.0 > StreamsResetter makes "changelog" topic nam

Build failed in Jenkins: kafka-trunk-jdk8 #3402

2019-02-20 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-4730: Streams does not have an in-memory windowed store (#6239) -- [...truncated 4.28 MB...] org.apache.kafka.streams.test.OutputVerifierTes

[jira] [Resolved] (KAFKA-7283) mmap indexes lazily and skip sanity check for segments below recovery point

2019-02-20 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-7283. Resolution: Fixed Fix Version/s: 2.3.0 Merged the PR to trunk. > mmap indexes lazily and skip sanit

[jira] [Created] (KAFKA-7967) Kafka Streams: some values in statestore rollback to old value

2019-02-20 Thread Ziming Dong (JIRA)
Ziming Dong created KAFKA-7967: -- Summary: Kafka Streams: some values in statestore rollback to old value Key: KAFKA-7967 URL: https://issues.apache.org/jira/browse/KAFKA-7967 Project: Kafka Iss

Build failed in Jenkins: kafka-trunk-jdk11 #301

2019-02-20 Thread Apache Jenkins Server
See Changes: [github] HOT_FIX: Change flag so plain RocksDB instance returned (#6297) [mjsax] MINOR: refactor topic check to make sure all topics exist by name vs -- [...

Jenkins build is back to normal : kafka-2.2-jdk8 #26

2019-02-20 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-300: Add Windowed KTable API in StreamsBuilder

2019-02-20 Thread Boyang Chen
Great, thank you Matthias! From: Matthias J. Sax Sent: Thursday, February 21, 2019 10:55 AM To: dev@kafka.apache.org Subject: Re: [DISCUSS] KIP-300: Add Windowed KTable API in StreamsBuilder Thanks. LGTM. -Matthias On 1/20/19 8:39 PM, Boyang Chen wrote: > Hey

Re: [VOTE] KIP-412: Extend Admin API to support dynamic application log levels

2019-02-20 Thread Harsha
+1 (binding). Thanks, Harsha On Tue, Feb 19, 2019, at 7:53 AM, Andrew Schofield wrote: > Thanks for the KIP. > > +1 (non-binding) > > On 18/02/2019, 12:48, "Stanislav Kozlovski" wrote: > > Hey everybody, I'm starting a VOTE thread for KIP-412. This feature should > significantly impr

Build failed in Jenkins: kafka-trunk-jdk8 #3401

2019-02-20 Thread Apache Jenkins Server
See Changes: [rajinisivaram] KAFKA-7945: Calc refresh time correctly when token created in the past [github] HOT_FIX: Change flag so plain RocksDB instance returned (#6297) [mjsax] MINOR: refactor topic check

[jira] [Resolved] (KAFKA-4730) Streams does not have an in-memory windowed store

2019-02-20 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-4730. -- Resolution: Fixed Fix Version/s: 2.3.0 > Streams does not have an in-memory windowed sto

Re: [VOTE] KIP-300: Add Windowed KTable API in StreamsBuilder

2019-02-20 Thread Matthias J. Sax
Thanks for the KIP Boyang! +1 (binding) -Matthias On 1/16/19 9:15 AM, Boyang Chen wrote: > Hey friends, > > I would like to start the vote thread for KIP-300 so that we could agree on > the high level API. Feel free to continue making comment on the discussion > thread. > > Best, > Boyang

Re: [DISCUSS] KIP-300: Add Windowed KTable API in StreamsBuilder

2019-02-20 Thread Matthias J. Sax
Thanks. LGTM. -Matthias On 1/20/19 8:39 PM, Boyang Chen wrote: > Hey Mattihas, > > I have addressed the comments in KIP. Feel free to take another look. > > Also you are right, those are implementation details that we could discuss in > diff 😊 > > Boyang > >

Re: [DISCUSS] KIP-307: Allow to define custom processor names with KStreams DSL

2019-02-20 Thread Matthias J. Sax
Florian, thanks for updating the KIP (and no worries for late reply -- 2.2 release kept us busy anyway...). Overall LGTM. Just some nits: KStream-Table: Do we need to list the existing stream-globalTable join methods in the first table (thought it should only contain new/changing methods). ty

Re: [DISCUSS] KIP-424: Allow suppression of intermediate events based on wall clock time

2019-02-20 Thread Matthias J. Sax
Jonathan, thanks for the KIP. Corner case question: What happens if an application is stopped an restarted? - Should suppress() flush all records (would be _before_ the time elapsed)? - Or should it preserve buffered records and reload on restart? For this case, should the record be flushed on

Re: Statestore restoration & scaling questions - possible KIP as well.

2019-02-20 Thread Guozhang Wang
Hello Adam, Sorry for being late replying on this thread, I've put my comments inlined below. On Sun, Feb 3, 2019 at 7:34 AM Adam Bellemare wrote: > Hey Folks > > I have a few questions around the operations of stateful processing while > scaling nodes up/down, and a possible KIP in question #4

Build failed in Jenkins: kafka-2.0-jdk8 #228

2019-02-20 Thread Apache Jenkins Server
See Changes: [github] MINOR: Add check all topics created check streams broker bounce test -- [...truncated 436.02 KB...] kafka.server.ClientQuotaManagerTest > testUserQuotaP

Build failed in Jenkins: kafka-2.1-jdk8 #133

2019-02-20 Thread Apache Jenkins Server
See Changes: [rajinisivaram] KAFKA-7945: Calc refresh time correctly when token created in the past -- [...truncated 701.42 KB...] kafka.utils.json.JsonValueTest > testDecod

[jira] [Created] (KAFKA-7966) Flaky Test DynamicBrokerReconfigurationTest#testLogCleanerConfig

2019-02-20 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created KAFKA-7966: -- Summary: Flaky Test DynamicBrokerReconfigurationTest#testLogCleanerConfig Key: KAFKA-7966 URL: https://issues.apache.org/jira/browse/KAFKA-7966 Project: Kafka

[jira] [Created] (KAFKA-7965) Flaky Test ConsumerBounceTest#testRollingBrokerRestartsWithSmallerMaxGroupSizeConfigDisruptsBigGroup

2019-02-20 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created KAFKA-7965: -- Summary: Flaky Test ConsumerBounceTest#testRollingBrokerRestartsWithSmallerMaxGroupSizeConfigDisruptsBigGroup Key: KAFKA-7965 URL: https://issues.apache.org/jira/browse/KAFKA-

[jira] [Created] (KAFKA-7964) Flaky Test ConsumerBounceTest#testConsumerReceivesFatalExceptionWhenGroupPassesMaxSize

2019-02-20 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created KAFKA-7964: -- Summary: Flaky Test ConsumerBounceTest#testConsumerReceivesFatalExceptionWhenGroupPassesMaxSize Key: KAFKA-7964 URL: https://issues.apache.org/jira/browse/KAFKA-7964

Build failed in Jenkins: kafka-2.2-jdk8 #25

2019-02-20 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-7920; Do not permit zstd produce requests until IBP is updated to [github] MINOR: Add all topics created check streams broker bounce test (2.2) --

Re: [VOTE] KIP-382 MirrorMaker 2.0

2019-02-20 Thread Ryanne Dolan
Hey y'all, I'm happy to announce that I've created a PR for MM2: https://github.com/apache/kafka/pull/6295 Please take a look! Ryanne On Tue, Jan 22, 2019 at 11:43 AM Ryanne Dolan wrote: > Thanks all, this is a large KIP and has sparked a lot of great > discussion, both on and off the dev li

[jira] [Resolved] (KAFKA-7945) ExpiringCredentialRefreshingLogin - timeout value is negative

2019-02-20 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-7945. --- Resolution: Fixed Reviewer: Rajini Sivaram Fix Version/s: 2.1.2

Jenkins build is back to normal : kafka-trunk-jdk8 #3399

2019-02-20 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-411: Add option to make Kafka Connect task client ID values unique

2019-02-20 Thread Ryanne Dolan
Thanks Paul, this is great. This will make monitoring Connect a ton easier. Ryanne On Wed, Feb 20, 2019 at 1:24 PM Paul Davidson wrote: > I have updated KIP-411 to propose changing the default client id - see: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-411%3A+Make+default+Kafka+C

Re: [DISCUSS] KIP-236 Interruptible Partition Reassignment

2019-02-20 Thread George Li
Hi, After discussing with Tom, Harsha and I are picking up KIP-236.  The work focused on safely/cleanly cancel / rollback pending reassignments in a timely fashion.  Pull Request #6296  Still working on more integration/system tests.  Please review and provide feedbacks/suggestions.  Thanks,Georg

[jira] [Created] (KAFKA-7963) Extract hard-coded strings to centralized place

2019-02-20 Thread Sophie Blee-Goldman (JIRA)
Sophie Blee-Goldman created KAFKA-7963: -- Summary: Extract hard-coded strings to centralized place Key: KAFKA-7963 URL: https://issues.apache.org/jira/browse/KAFKA-7963 Project: Kafka Iss

[jira] [Created] (KAFKA-7962) StickyAssignor: throws NullPointerException during assignments if topic is deleted

2019-02-20 Thread Oleg Smirnov (JIRA)
Oleg Smirnov created KAFKA-7962: --- Summary: StickyAssignor: throws NullPointerException during assignments if topic is deleted Key: KAFKA-7962 URL: https://issues.apache.org/jira/browse/KAFKA-7962 Projec

Re: [DISCUSS] KIP-411: Add option to make Kafka Connect task client ID values unique

2019-02-20 Thread Paul Davidson
I have updated KIP-411 to propose changing the default client id - see: https://cwiki.apache.org/confluence/display/KAFKA/KIP-411%3A+Make+default+Kafka+Connect+worker+task+client+IDs+distinct There is also an PR ready to go here: https://github.com/apache/kafka/pull/6097 On Fri, Jan 11, 2019 at

Re: Troubleshooting custom implementation for a org.apache.kafka.common.metrics.MetricsReporter

2019-02-20 Thread Guozhang Wang
Hello Artem, Your observation is correct: for Streams as well as many other clients, MetricsReporter#metricChange() are primarily used for registering new metrics, this is because at the construction time of the client (hence when MetricsReporter#init() is called) those finer-grained metrics, like

Re: [VOTE] KIP-428: Add in-memory window store

2019-02-20 Thread Sophie Blee-Goldman
With three +1 (binding) votes this KIP is now accepted. Thanks for the votes everyone. -Sophie On Wed, Feb 20, 2019 at 7:45 AM Bill Bejeck wrote: > Hi Sophie, > > Thanks for the KIP! My apologies for the delay in voting. > > +1(binding) > > -Bill > > On Thu, Feb 14, 2019 at 8:59 PM Guozhang Wa

[jira] [Created] (KAFKA-7961) Handle subscription changes with a rebalance in progress

2019-02-20 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-7961: -- Summary: Handle subscription changes with a rebalance in progress Key: KAFKA-7961 URL: https://issues.apache.org/jira/browse/KAFKA-7961 Project: Kafka Is

[jira] [Created] (KAFKA-7960) KIP-432: Additional Broker-Side Opt-In for Default, Unsecure SASL/OAUTHBEARER Implementation

2019-02-20 Thread Ron Dagostino (JIRA)
Ron Dagostino created KAFKA-7960: Summary: KIP-432: Additional Broker-Side Opt-In for Default, Unsecure SASL/OAUTHBEARER Implementation Key: KAFKA-7960 URL: https://issues.apache.org/jira/browse/KAFKA-7960

[DISCUSS] KIP-432: Additional Broker-Side Opt-In for Default, Unsecure SASL/OAUTHBEARER Implementation

2019-02-20 Thread Ron Dagostino
Hi everyone. I created KIP-432: Additional Broker-Side Opt-In for Default, Unsecure SASL/OAUTHBEARER Implementation (https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=103091238). The motivation for this KIP

[jira] [Created] (KAFKA-7959) Clear/delete epoch cache if old message format is in use

2019-02-20 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-7959: -- Summary: Clear/delete epoch cache if old message format is in use Key: KAFKA-7959 URL: https://issues.apache.org/jira/browse/KAFKA-7959 Project: Kafka Is

Re: [VOTE] KIP-428: Add in-memory window store

2019-02-20 Thread Bill Bejeck
Hi Sophie, Thanks for the KIP! My apologies for the delay in voting. +1(binding) -Bill On Thu, Feb 14, 2019 at 8:59 PM Guozhang Wang wrote: > +1 (binding). > > On Thu, Feb 14, 2019 at 4:07 PM Matthias J. Sax > wrote: > > > +1 (binding) > > > > > > -Matthias > > > > On 2/14/19 3:36 PM, Sophie

Re: [DISCUSS] KIP-430 - Return Authorized Operations in Describe Responses

2019-02-20 Thread Rajini Sivaram
If there are no other concerns or suggestions, I will start vote on this KIP later today. Thanks, Rajini On Mon, Feb 18, 2019 at 10:09 AM Rajini Sivaram wrote: > Hi Magnus, > > Have your concerns been addressed in the KIP? > > Thanks, > > Rajini > > On Wed, Feb 13, 2019 at 3:33 PM Satish Dugga