Re: [VOTE] KIP-328: Ability to suppress updates for KTables

2018-11-16 Thread Bill Bejeck
entInterval", for the same > reasons. > >>>> I > >>>> >>>> simply > >>>> >>>>>>> overlooked it previously. I've updated the KIP accordingly. > >>>> >>>>>>> > >>&

[jira] [Resolved] (KAFKA-4601) Avoid duplicated repartitioning in KStream DSL

2018-11-13 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck resolved KAFKA-4601. Resolution: Fixed Marking this resolved with [https://github.com/apache/kafka/pull/5451.] As

[jira] [Resolved] (KAFKA-7552) StatefulProcessorNode tries to connect state store to processor before it is added

2018-10-27 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck resolved KAFKA-7552. Resolution: Fixed Fixed with PR  [https://github.com/apache/kafka/pull/5740|https://github.com

[jira] [Created] (KAFKA-7534) Error during CachingKeyValueStore.flush may not allow RocksDB to close

2018-10-23 Thread Bill Bejeck (JIRA)
Bill Bejeck created KAFKA-7534: -- Summary: Error during CachingKeyValueStore.flush may not allow RocksDB to close Key: KAFKA-7534 URL: https://issues.apache.org/jira/browse/KAFKA-7534 Project: Kafka

Re: [ANNOUNCE] New Committer: Manikumar Reddy

2018-10-11 Thread Bill Bejeck
Congrats Manikumar! On Thu, Oct 11, 2018 at 2:07 PM Hugo Louro wrote: > Congrats Manikumar! > Hugo > > > On Oct 11, 2018, at 11:04 AM, Kamal Chandraprakash < > kamal.chandraprak...@gmail.com> wrote: > > > > Congratulations, Manikumar! > > > >> On Thu, 11 Oct 2018, 23:29 Rajini Sivaram, > wrote:

Re: [VOTE] KIP-369 Alternative Partitioner to Support "Always Round-Robin" Selection

2018-10-03 Thread Bill Bejeck
+1 from me. As for closing the vote, it needs to be open for a minimum of 72 and requires three binding +1 votes. Additionally, there needs more +1 binding votes than -1 votes. The description for the lazy majority vote process is described here https://cwiki.apache.org/confluence/display/KAFKA/

Re: [VOTE] KIP-372: Naming Repartition Topics for Joins and Grouping

2018-10-03 Thread Bill Bejeck
All, One additional minor change "Grouped.named" has been changed to "Grouped.as". I've updated the KIP with this change. Thanks, Bill

Re: [VOTE] KIP-372: Naming Repartition Topics for Joins and Grouping

2018-09-28 Thread Bill Bejeck
All, I've made a slight adjustment to the KIP and changed the "Joined.name" to "Joined.named" Thanks, Bill On Thu, Sep 20, 2018 at 4:49 PM Bill Bejeck wrote: > Hi All, > > KIP-372 is now accepted with: > - 3 Binding +1 (Damian, Guozhang, Matthias) >

Re: [DISCUSSION] KIP-376: Implement AutoClosable on appropriate classes that has close()

2018-09-26 Thread Bill Bejeck
Hi Yishun, Thanks for the KIP, seems like a useful addition. Just a couple of minor comments. Can you list all the changes in the list under "Public Interfaces" in the "Proposed Changes" section that way it's clear what's changing? I realize they all will be very similar, but it's better to be

Re: [ANNOUNCE] New committer: Colin McCabe

2018-09-25 Thread Bill Bejeck
Congrats Colin! On Tue, Sep 25, 2018 at 8:11 AM Manikumar wrote: > Congrats Colin! > > On Tue, Sep 25, 2018 at 4:39 PM Mickael Maison > wrote: > > > Congratulations Colin! > > > > On Tue, Sep 25, 2018, 11:17 Viktor Somogyi-Vass > > > wrote: > > > > > Congrats Colin, well deserved! :) > > > > >

Re: [VOTE] KIP-372: Naming Repartition Topics for Joins and Grouping

2018-09-20 Thread Bill Bejeck
Hi All, KIP-372 is now accepted with: - 3 Binding +1 (Damian, Guozhang, Matthias) - 3 Non-binding +1 (Dongjin, John, Bill) Thanks to everyone for the votes. -Bill On Thu, Sep 20, 2018 at 7:30 AM Damian Guy wrote: > +1 (binding) > > On Tue, 18 Sep 2018 at 16:33 Bill Bejeck wrote:

Re: Accessing Topology Builder

2018-09-18 Thread Bill Bejeck
Jorge: I have a crazy idea off the top of my head. Would something as low-tech using KSteam.peek calls on either side of certain processors to record start and end times work? Thanks, Bill On Tue, Sep 18, 2018 at 4:38 PM Guozhang Wang wrote: > Jorge: > > My suggestion was to let your users to

Re: [VOTE] KIP-372: Naming Repartition Topics for Joins and Grouping

2018-09-18 Thread Bill Bejeck
ongjin Lee wrote: > > > Great improvements. +1. (Non-binding) > > > > On Tue, Sep 18, 2018 at 5:14 AM Matthias J. Sax > > wrote: > > > > > +1 (binding) > > > > > > -Matthias > > > > > > On 9/17/18 1:12 PM, Guozhang Wang wrote

[VOTE] KIP-372: Naming Repartition Topics for Joins and Grouping

2018-09-17 Thread Bill Bejeck
All, I'd like to start the voting process for KIP-372. Here's the link to the updated proposal https://cwiki.apache.org/confluence/display/KAFKA/KIP-372%3A+Naming+Repartition+Topics+for+Joins+and+Grouping I'll start with my own +1. Thanks, Bill

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

2018-09-15 Thread Bill Bejeck
Congrats! On Sat, Sep 15, 2018 at 1:27 PM Jorge Esteban Quilcate Otoya < quilcate.jo...@gmail.com> wrote: > Congratulations!! > > El sáb., 15 sept. 2018 a las 15:18, Dongjin Lee () > escribió: > > > Congratulations! > > > > Best, > > Dongjin > > > > On Sat, Sep 15, 2018 at 3:00 PM Colin McCabe w

Re: [VOTE] KIP-361: Add Consumer Configuration to Disable Auto Topic Creation

2018-09-15 Thread Bill Bejeck
Thanks for the KIP. This is a great addition. +1(non-binding) Bill On Sat, Sep 15, 2018 at 12:06 PM Gwen Shapira wrote: > Thank you. This has been a source of surprises and confusion for a long > time. > +1 > > On Fri, Sep 14, 2018 at 4:55 PM, Dhruvil Shah > wrote: > > > Hi all, > > > > I wo

Re: [DISCUSS] KIP-372: Naming Joins and Grouping

2018-09-14 Thread Bill Bejeck
; > > I think it is more natural to rename it to > > > > > > > > * [app-id]-[join-name]-left-repartition > > > > > > > > * [app-id]-[join-name]-right-repartition > > > > > > > > > > > > 2. I'd suggest to use the name to

Re: [VOTE] KIP-367 Introduce close(Duration) to Producer and AdminClient instead of close(long, TimeUnit)

2018-09-13 Thread Bill Bejeck
+1 -Bill On Thu, Sep 13, 2018 at 4:44 AM Mickael Maison wrote: > +1 (non-binding) > Thanks! > On Thu, Sep 13, 2018 at 7:05 AM Manikumar > wrote: > > > > +1 (non-binding) > > > > Thanks for the KIP. > > > > On Thu, Sep 13, 2018 at 10:38 AM Harsha wrote: > > > > > +1 (Binding). > > > Thanks, >

[DISCUSS] KIP-372: Naming Joins and Grouping

2018-09-12 Thread Bill Bejeck
All I'd like to start a discussion on KIP-372 for the naming of joins and grouping operations in Kafka Streams. The KIP page can be found here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-372%3A+Naming+Joins+and+Grouping I look forward to feedback and comments. Thanks, Bill

[jira] [Created] (KAFKA-7406) Naming Join and Grouping Operations

2018-09-12 Thread Bill Bejeck (JIRA)
Bill Bejeck created KAFKA-7406: -- Summary: Naming Join and Grouping Operations Key: KAFKA-7406 URL: https://issues.apache.org/jira/browse/KAFKA-7406 Project: Kafka Issue Type: Improvement

Re: [DISCUSS] KIP-358: Migrate Streams API to Duration instead of long ms times

2018-09-10 Thread Bill Bejeck
Hi Nikolay, I'm a +1 to points 1 and 2 above from Guozhang. Thanks, Bill On Mon, Sep 10, 2018 at 6:58 PM Guozhang Wang wrote: > Hello Nikolay, > > Thanks for picking this up! Just sharing my two cents: > > 1) I'd suggest keeping `Punctuator#punctuate(long timestamp)` as is since > comparing wi

Re: [VOTE] KIP-366 - Make FunctionConversations private

2018-09-06 Thread Bill Bejeck
+1 -Bill On Thu, Sep 6, 2018 at 4:29 AM Joan Goyeau wrote: > Sournds good, I'll make the deprecation and copy the class over. > > Thanks > > On Wed, 5 Sep 2018 at 22:48 John Roesler wrote: > > > I'm a +1 (non-binding) because we doubt the class is in use. > > > > If you decide to copy it to a

Re: [VOTE] KIP-358: Migrate Streams API to Duration instead of long ms times

2018-08-31 Thread Bill Bejeck
list of deprecated methods in KIP. > > > > > > 2. Some internal methods can't be deprecated or hid from the user for > now. > > > I was trying to say that we should research possibility to reduce > > > visibility of *internal* methods that are *public* now.

Re: [VOTE] KIP-358: Migrate Streams API to Duration instead of long ms times

2018-08-30 Thread Bill Bejeck
Sorry for chiming in late, there was a lot of detail to catch up on. Overall I'm +1 in the KIP. But I do have one question about the KIP in regards to Matthias's comments about defining dual use. In the "Proposed Changes" section, there is "Try to reduce the visibility of methods in next tickets

Re: [DISCUSS] KIP-369 Alternative Partitioner to Support "Always Round-Robin" Selection

2018-08-30 Thread Bill Bejeck
Hi, NOTE: I sent this earlier, but that message just went to the dev list. I'm including both users and dev now. Thanks for the KIP. Have you considered using the overloaded ProducerRecord constructor where you can specify the partition? I mention this as an option as I encountered the same i

Re: [DISCUSS] KIP-369: Alternative Partitioner to Support "Always Round-Robin" Selection

2018-08-30 Thread Bill Bejeck
Hi, Thanks for the KIP. Have you considered using the overloaded ProducerRecord constructor where you can specify the partition? I mention this as an option as I encountered the same issue on a previous project and that is how we handled round-robin distribution with non-null keys. Would that

Re: [VOTE] KIP-365: Materialized, Serialized, Joined, Consumed and Produced with implicit Serde

2018-08-27 Thread Bill Bejeck
+1 -Bill On Mon, Aug 27, 2018 at 3:24 PM Ted Yu wrote: > +1 > > On Mon, Aug 27, 2018 at 12:18 PM John Roesler wrote: > > > +1 (non-binding) > > > > On Sat, Aug 25, 2018 at 1:16 PM Joan Goyeau wrote: > > > > > Hi, > > > > > > We want to make sure that we always have a serde for all Materialize

Re: [VOTE] KIP-363: Make FunctionConversions private

2018-08-27 Thread Bill Bejeck
+1 -Bill On Mon, Aug 27, 2018 at 10:41 AM John Roesler wrote: > Hey Joan, > > I was thinking more about this... Do any of the conversions in > FunctionConversions convert to types that are used in the public Scala > interface? > > If you've already checked, then carry on. > > Otherwise, we shou

Re: [VOTE] KIP-325: Extend Consumer Group Command to Show Beginning Offsets

2018-08-16 Thread Bill Bejeck
+1 Thanks, Bill On Thu, Aug 16, 2018 at 3:13 PM Ted Yu wrote: > +1 > > On Thu, Aug 16, 2018 at 12:05 PM Vahid S Hashemian < > vahidhashem...@us.ibm.com> wrote: > > > I would like to start a vote on KIP-325 which aims at adding a beginning > > offset column to consumer group command describe out

Re: [VOTE] KIP-353: Allow Users to Configure Multi-Streams Timestamp Synchronization Behavior

2018-08-14 Thread Bill Bejeck
+1 Thanks, Bill On Thu, Aug 9, 2018 at 4:20 PM John Roesler wrote: > +1 non-binding > > On Thu, Aug 9, 2018 at 3:14 PM Matthias J. Sax > wrote: > > > +1 (binding) > > > > On 8/9/18 11:57 AM, Guozhang Wang wrote: > > > Hello all, > > > > > > I would like to start the voting processing on the fo

Re: [VOTE] KIP-356: Add withCachingDisabled() to StoreBuilder

2018-08-14 Thread Bill Bejeck
Thanks for the KIP. +1 -Bill On Tue, Aug 14, 2018 at 1:42 PM Guozhang Wang wrote: > Hello folks, > > I'd like to start a voting thread on the following KIP: > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-356%3A+Add+withCachingDisabled%28%29+to+StoreBuilder > > It is a pretty strai

Re: [DISCUSS] KIP-353: Allow Users to Configure Kafka Streams Timestamp Synchronization

2018-08-09 Thread Bill Bejeck
@Guozhang, I've read the KIP and I don't have any further comments in addition to what's already been discussed. Thanks, Bill On Thu, Aug 9, 2018 at 2:26 PM Matthias J. Sax wrote: > @Guozhang, I think you can start the VOTE for this KIP? I don't have any > further comments. > > One more nit: we

[jira] [Resolved] (KAFKA-7221) Add Build method to StreamsBuilder accepting Properties

2018-07-31 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck resolved KAFKA-7221. Resolution: Fixed Duplicated by KAFKA-7027 > Add Build method to StreamsBuilder accept

[jira] [Created] (KAFKA-7221) Add Build method to StreamsBuilder accepting Properties

2018-07-31 Thread Bill Bejeck (JIRA)
Bill Bejeck created KAFKA-7221: -- Summary: Add Build method to StreamsBuilder accepting Properties Key: KAFKA-7221 URL: https://issues.apache.org/jira/browse/KAFKA-7221 Project: Kafka Issue

Re: [VOTE] KIP-328: Ability to suppress updates for KTables

2018-07-30 Thread Bill Bejeck
Thanks for the KIP! +1 -Bill On Mon, Jul 30, 2018 at 3:42 PM Ted Yu wrote: > +1 > > On Mon, Jul 30, 2018 at 11:46 AM John Roesler wrote: > > > Hello devs, > > > > The discussion of KIP-328 has gone some time with no new comments, so I > am > > calling for a vote! > > > > Here's the KIP: https

Re: [DISCUSS] KIP-258: Allow to Store Record Timestamps in RocksDB

2018-07-27 Thread Bill Bejeck
;>>>>>> > >>>>>>>> @Bill: I think a filter predicate should be part of user code. And > >>>> even > >>>>>>>> if we want to add something like this, I would prefer to do it in > a > >&g

Re: [Vote] KIP-321: Update TopologyDescription to better represent Source and Sink Nodes

2018-07-27 Thread Bill Bejeck
Thanks for the KIP! +1 -Bill On Thu, Jul 26, 2018 at 2:39 AM Guozhang Wang wrote: > +1 > > On Wed, Jul 25, 2018 at 11:13 PM, Matthias J. Sax > wrote: > > > +1 (binding) > > > > -Matthias > > > > On 7/25/18 7:47 PM, Ted Yu wrote: > > > +1 > > > > > > On Wed, Jul 25, 2018 at 7:24 PM Nishanth Pr

[jira] [Created] (KAFKA-7201) Optimize repartition operations

2018-07-24 Thread Bill Bejeck (JIRA)
Bill Bejeck created KAFKA-7201: -- Summary: Optimize repartition operations Key: KAFKA-7201 URL: https://issues.apache.org/jira/browse/KAFKA-7201 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-7200) Preserve serdes used

2018-07-24 Thread Bill Bejeck (JIRA)
Bill Bejeck created KAFKA-7200: -- Summary: Preserve serdes used Key: KAFKA-7200 URL: https://issues.apache.org/jira/browse/KAFKA-7200 Project: Kafka Issue Type: Improvement Components

[jira] [Created] (KAFKA-7198) Enhance KafkaStreams start method javadoc

2018-07-24 Thread Bill Bejeck (JIRA)
Bill Bejeck created KAFKA-7198: -- Summary: Enhance KafkaStreams start method javadoc Key: KAFKA-7198 URL: https://issues.apache.org/jira/browse/KAFKA-7198 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-7190) Under low traffic conditions purging repartition topics cause WARN statements about UNKNOWN_PRODUCER_ID

2018-07-20 Thread Bill Bejeck (JIRA)
Bill Bejeck created KAFKA-7190: -- Summary: Under low traffic conditions purging repartition topics cause WARN statements about UNKNOWN_PRODUCER_ID Key: KAFKA-7190 URL: https://issues.apache.org/jira/browse/KAFKA

Re: [VOTE] KIP-331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde

2018-07-08 Thread Bill Bejeck
Thanks for the KIP! +1 from me. -Bill On Sun, Jul 8, 2018 at 9:55 PM Ismael Juma wrote: > The KIP needs 3 binding votes to pass. I still think we should include the > details of how things will look like with the headers being passed to > serializers/deserializers to ensure things actually make

Re: [DISCUSS] KIP-328: Ability to suppress updates for KTables

2018-06-29 Thread Bill Bejeck
g (k:2). When it > later gets to time 3, it's time to emit (k:2) downstream. Because k is no > longer buffered, the suppress operator will log (k:null). Thus, when > recovering, > it can rebuild the buffer by reading its changelog. > > What do you think about this? > > Thank

Re: [DISCUSS] KIP-326: Schedulable KTable as Graph source

2018-06-29 Thread Bill Bejeck
Hi Flávio, Thanks for creating the KIP. I agree with Guozhang on comparing the pros and cons of the approach he outlined vs the one in the proposed KIP. I also have a few clarification questions on the current KIP Will the triggering mechanism always be time, or would it make sense to expand to

Re: [VOTE] KIP-312: Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties

2018-06-29 Thread Bill Bejeck
72 hours have passed, so I'm going to close out the vote. KIP-312 is accepted with the following votes: +1 (binding) Dongjin Lee, Damian Guy, Guozhang Wang, and Matthias J. Sax +1 (community) Ted Yu, Bill Bejeck -1 none Thanks to all for participating. -Bill On Wed, Jun 27, 2018 at 2:

Re: [VOTE] KIP-330: Add retentionPeriod in SessionBytesStoreSupplier

2018-06-27 Thread Bill Bejeck
+1 -Bill On Wed, Jun 27, 2018 at 7:39 PM Guozhang Wang wrote: > Hello folks, > > I'd like to start a voting thread on KIP-330. I've intentionally skipped > the discuss phase since it is a pretty straight-forward public API change > and should actually be added since day one. The bug fix of KAFK

Re: [DISCUSS] KIP-328: Ability to suppress updates for KTables

2018-06-27 Thread Bill Bejeck
Hi John, thanks for the KIP. Early on in the KIP, you mention the current approaches for controlling the rate of downstream records from a KTable, cache size configuration and commit time. Will these configuration parameters still be in effect for tables that don't use suppression? For tables t

Re: [VOTE] KIP-324: Add method to get metrics() in AdminClient

2018-06-27 Thread Bill Bejeck
+1 -Bill On Wed, Jun 27, 2018 at 12:47 PM Manikumar wrote: > +1 (non-binding) > > Thanks. > > On Wed, Jun 27, 2018 at 10:15 PM Matthias J. Sax > wrote: > > > +1 (binding) > > > > On 6/26/18 2:33 PM, Guozhang Wang wrote: > > > +1. Thanks. > > > > > > On Tue, Jun 26, 2018 at 2:31 PM, Yishun Guan

Re: [VOTE] KIP-319: Replace numSegments to segmentInterval in Streams window configurations

2018-06-26 Thread Bill Bejeck
+1 On Mon, Jun 25, 2018 at 11:07 PM Matthias J. Sax wrote: > +1 (binding) > > On 6/25/18 3:00 PM, Guozhang Wang wrote: > > +1 > > > > On Mon, Jun 25, 2018 at 2:58 PM, Ted Yu wrote: > > > >> +1 > >> > >> On Mon, Jun 25, 2018 at 2:56 PM, John Roesler > wrote: > >> > >>> Hello All, > >>> > >>> Th

Re: [Discuss] KIP-321: Add method to get TopicNameExtractor in TopologyDescription

2018-06-25 Thread Bill Bejeck
Thanks for the KIP! Overall I'm +1 on the KIP. I have one question. The KIP states that the method "topicNameExtractor()" is added to the InternalTopologyBuilder.java. It could be that I'm missing something, but wow does this work if a user has provided different TopicNameExtractor instances t

Re: [DISCUSS] KIP-319: Replace segments with segmentSize in WindowBytesStoreSupplier

2018-06-25 Thread Bill Bejeck
05 PM, John Roesler > > wrote: > > > > > > > >> Thanks for the feedback, Bill and Guozhang, > > > >> > > > >> I've updated the KIP accordingly. > > > >> > > > >> Thanks, > > > >> -Joh

[VOTE] KIP-312: Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties

2018-06-25 Thread Bill Bejeck
All, I'd like to start a vote for this KIP now. Thanks, Bill

Re: [DISCUSS] KIP-319: Replace segments with segmentSize in WindowBytesStoreSupplier

2018-06-22 Thread Bill Bejeck
Hi John, Thanks for the KIP, and overall it's a +1 for me. In the JavaDoc for the segmentInterval method, there's no mention of the number of segments there can be at any one time. While it's implied that the number of segments is potentially unbounded, would be better to explicitly state that t

Re: [VOTE] KIP-313: Add KStream.flatTransform and KStream.flatTransformValues

2018-06-22 Thread Bill Bejeck
Thanks for the KIP, +1. -Bill On Fri, Jun 22, 2018 at 1:08 PM Ted Yu wrote: > +1 > > On Fri, Jun 22, 2018 at 2:50 AM, Bruno Cadonna wrote: > > > Hi list, > > > > I would like to voting on this KIP. > > > > I created a first PR[1] that adds flatTransform. Once I get some > > feedback, I will st

Re: [DISCUSS] KIP-312: Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties

2018-06-18 Thread Bill Bejeck
. > > On Tue, Jun 12, 2018 at 9:21 AM, Bill Bejeck wrote: > > > > Since there're only two values for the optional optimization config > > > introduced by KAFKA-6935, I wonder the overloaded build method (with > > Properties > > > instance) would

Re: [VOTE] KIP-228 Negative record timestamp support

2018-06-12 Thread Bill Bejeck
+1 Thanks, Bill On Sun, Jun 10, 2018 at 5:32 PM Ted Yu wrote: > +1 > > On Sun, Jun 10, 2018 at 2:17 PM, Matthias J. Sax > wrote: > > > +1 (binding) > > > > Thanks for the KIP. > > > > > > -Matthias > > > > On 5/29/18 9:14 AM, Konstantin Chukhlomin wrote: > > > Thanks, updated the KIP. > > > ht

Re: [DISCUSS] KIP-312: Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties

2018-06-12 Thread Bill Bejeck
ew KafkaStreams(builder, props); > > >>> > > >>> such that it would internally call builder.build(props) ? > > >>> > > >>> Thanks, > > >>> -John > > >>> > > >>> > > >>> &

Re: [DISCUSS] KIP-313: Add KStream.flatTransform and KStream.flatTransformValues

2018-06-11 Thread Bill Bejeck
Thanks for the KIP, it's a +1 for me. Looking forward to having a look at the PR. On Mon, Jun 11, 2018 at 9:58 AM Damian Guy wrote: > Thanks for the KIP. LGTM > > On Mon, 11 Jun 2018 at 00:44 Matthias J. Sax > wrote: > > > Thanks for the KIP. > > > > I don't have any comments at this pint. O

[DISCUSS] KIP-312: Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties

2018-06-08 Thread Bill Bejeck
All, I'd like to start the discussion for adding an overloaded method to StreamsBuilder taking a java.util.Properties instance. The KIP is located here : https://cwiki.apache.org/confluence/display/KAFKA/KIP-312%3A+Add+Overloaded+StreamsBuilder+Build+Method+to+Accept+java.util.Properties I look

[jira] [Created] (KAFKA-7027) Overloaded StreamsBuilder Build Method to Accept java.util.Properties

2018-06-08 Thread Bill Bejeck (JIRA)
Bill Bejeck created KAFKA-7027: -- Summary: Overloaded StreamsBuilder Build Method to Accept java.util.Properties Key: KAFKA-7027 URL: https://issues.apache.org/jira/browse/KAFKA-7027 Project: Kafka

Re: [VOTE] KIP-266: Add TimeoutException for KafkaConsumer#position

2018-06-05 Thread Bill Bejeck
31, 2018 at 6:00 PM, Jason Gustafson > > > wrote: > > > > > > > Thanks everyone for the feedback. I've updated the KIP and added > > > > KAFKA-6979. > > > > > > > > -Jason > > > > > > > > On Wed, May 30, 2018 at 3:

Re: [VOTE] KIP-266: Add TimeoutException for KafkaConsumer#position

2018-05-30 Thread Bill Bejeck
t; > > > > > > > rajinisiva...@gmail.com> > > > > > > > >> wrote: > > > > > > > >>> Hi Richard, Thanks for the KIP. > > > > > > > >>> > > > > > > > >>> +1

[jira] [Created] (KAFKA-6964) Add ability to print all internal topic names

2018-05-29 Thread Bill Bejeck (JIRA)
Bill Bejeck created KAFKA-6964: -- Summary: Add ability to print all internal topic names Key: KAFKA-6964 URL: https://issues.apache.org/jira/browse/KAFKA-6964 Project: Kafka Issue Type: New

Re: [DISCUSS] KIP-307: Allow to define custom processor names with KStreams DSL

2018-05-29 Thread Bill Bejeck
Hi Florian, Thanks for the KIP. I think being able to add more context to the processor names would be useful. I like the idea of adding a "withProcessorName" to Produced, Consumed and Joined. But instead of adding the "Processed" parameter to a large percentage of the methods, which would resu

[jira] [Created] (KAFKA-6935) KIP-295 Add Streams Config for Optional Optimization

2018-05-23 Thread Bill Bejeck (JIRA)
Bill Bejeck created KAFKA-6935: -- Summary: KIP-295 Add Streams Config for Optional Optimization Key: KAFKA-6935 URL: https://issues.apache.org/jira/browse/KAFKA-6935 Project: Kafka Issue Type

Re: [VOTE] KIP-303: Add Dynamic Routing Support in Kafka Streams' Topology Sink

2018-05-22 Thread Bill Bejeck
+1 On Tue, May 22, 2018 at 3:46 AM, Ismael Juma wrote: > Breaking API without a deprecation cycle doesn't seem good. Are we sure > about this? > > Ismael > > On Mon, 21 May 2018, 15:04 Guozhang Wang, wrote: > > > Hello Matthias, > > > > I've tried it out on the PR, the implementation should b

Re: [VOTE] KIP-306: Configuration for Delaying Response to Failed Client Authentication

2018-05-21 Thread Bill Bejeck
Thanks for the KIP. +1 -Bill On Mon, May 21, 2018 at 1:41 PM, Ted Yu wrote: > +1 > > On Mon, May 21, 2018 at 9:02 AM, Guozhang Wang wrote: > > > Thanks Dhruvil for the KIP, +1 from me (binding). > > > > > > Guozhang > > > > On Mon, May 21, 2018 at 7:52 AM, Dhruvil Shah > > wrote: > > > > > H

Re: [VOTE] KIP-295: Add Streams Configuration Allowing for Optional Topology Optimization

2018-05-21 Thread Bill Bejeck
nal Topology > > Optimization > > +1 (binding). > > > > On Tue, May 15, 2018 at 2:16 PM, Matthias J. Sax > > wrote: > > > > > +1 (binding) > > > > > > > > > On 5/15/18 1:45 PM, Bill Bejeck wrote: > > > > Hi all, > >

Re: [VOTE] KIP-303: Add Dynamic Routing Support in Kafka Streams' Topology Sink

2018-05-17 Thread Bill Bejeck
Thanks for the KIP. +1 -Bill On Thu, May 17, 2018 at 2:51 PM, Damian Guy wrote: > Thanks Guozhang. +1 > > Note: the link to the KIP is broken > > On Thu, 17 May 2018 at 11:38 Guozhang Wang wrote: > > > Hello folks, > > > > I'd like to start a voting thread on adding dynamic routing functional

Re: [DISCUSS] KIP-303: Add Dynamic Routing in Streams Sink

2018-05-15 Thread Bill Bejeck
Thanks for the KIP Guozhang, it's a +1 for me. As for re-using the KeyValueMapper for choosing the topic, I am on the fence, a more explicitly named class would be more clear, but I'm not sure it's worth a new class that will primarily perform the same actions as the KeyValueMapper. Thanks, Bill

[VOTE] KIP-295: Add Streams Configuration Allowing for Optional Topology Optimization

2018-05-15 Thread Bill Bejeck
Hi all, I'd like to start a vote on KIP-295: Add Streams Configuration Allowing for Optional Topology Optimization. KIP wiki page: https://cwiki.apache.org/confluence/display/KAFKA/KIP-295%3A+Add+Streams+Configuration+Allowing+for+Optional+Topology+Optimization Discussion thread: https://www.mai

Re: [DISCUSS] KIP-295: Add Streams Configuration Allowing for Optional Topology Optimization

2018-05-15 Thread Bill Bejeck
At this point, I think the overall discussion on the new config is completed and I'll start a voting thread. Thanks, Bill On Tue, May 15, 2018 at 4:37 PM, Bill Bejeck wrote: > Thanks for the comments, John. I've updated the config name on the KIP.. > > -Bill > > &g

Re: [DISCUSS] KIP-295: Add Streams Configuration Allowing for Optional Topology Optimization

2018-05-15 Thread Bill Bejeck
ot; and "all", should we change the config name > to just "topology.optimizations"? > > The "enable." feels like a holdover from the boolean-valued config. > > Thanks, > -John > > On Tue, May 8, 2018 at 9:13 PM, Bill Bejeck wrote: > > > T

Re: [VOTE] KIP-244: Add Record Header support to Kafka Streams

2018-05-15 Thread Bill Bejeck
Thanks for the KIP! +1 -Bill On Tue, May 15, 2018 at 1:47 PM, Damian Guy wrote: > Thanks. +1 (binding) > > On Tue, 15 May 2018 at 01:04 Jorge Esteban Quilcate Otoya < > quilcate.jo...@gmail.com> wrote: > > > @Guozhang added. Thanks! > > > > El mar., 15 may. 2018 a las 5:50, Matthias J. Sax (<

Re: [DISCUSS] KIP-295: Add Streams Configuration Allowing for Optional Topology Optimization

2018-05-08 Thread Bill Bejeck
vidual optimizations on/off is too > >> fine grained and hard to maintain. However, for compatibility, it might > >> make sense, to have certain "levels of optimizations" (based on the > >> release) that allow users to stay with on an older level for upgrade >

Re: [DISCUSS] KIP-295: Add Streams Configuration Allowing for Optional Topology Optimization

2018-05-08 Thread Bill Bejeck
n the future? > > > > > > Hi Ted, > > > > The cover JIRA for topology optimization can be found here: > > https://issues.apache.org/jira/browse/KAFKA-6034 > > > > > > Guozhang > > > > > > On Mon, May 7, 2018 at 11:04 AM, Ted Yu wr

Re: [VOTE] KIP-266: Add TimeoutException for KafkaConsumer#position

2018-05-07 Thread Bill Bejeck
+1 Thanks, Bill On Fri, May 4, 2018 at 7:21 PM, Richard Yu wrote: > Hi all, I would like to bump this thread since discussion in the KIP > appears to be reaching its conclusion. > > > > On Thu, Mar 15, 2018 at 3:30 PM, Richard Yu > wrote: > > > Hi all, > > > > Since there does not seem to be t

[DISCUSS] KIP-295: Add Streams Configuration Allowing for Optional Topology Optimization

2018-05-07 Thread Bill Bejeck
All, I'd like to start a discussion about adding a configuration parameter allowing for the forthcoming topology optimization to be optional via configuration. The KIP can be found here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-295%3A+Add+Streams+Configuration+Allowing+for+Optional+T

[jira] [Created] (KAFKA-6874) Add Configuration Allowing for Optional Topology Optimization

2018-05-07 Thread Bill Bejeck (JIRA)
Bill Bejeck created KAFKA-6874: -- Summary: Add Configuration Allowing for Optional Topology Optimization Key: KAFKA-6874 URL: https://issues.apache.org/jira/browse/KAFKA-6874 Project: Kafka

[jira] [Created] (KAFKA-6844) Race condition between StreamThread and GlobalStreamThread stopping

2018-05-01 Thread Bill Bejeck (JIRA)
Bill Bejeck created KAFKA-6844: -- Summary: Race condition between StreamThread and GlobalStreamThread stopping Key: KAFKA-6844 URL: https://issues.apache.org/jira/browse/KAFKA-6844 Project: Kafka

[jira] [Created] (KAFKA-6829) Consumer should retry when encountering unknown topic or partition error

2018-04-26 Thread Bill Bejeck (JIRA)
Bill Bejeck created KAFKA-6829: -- Summary: Consumer should retry when encountering unknown topic or partition error Key: KAFKA-6829 URL: https://issues.apache.org/jira/browse/KAFKA-6829 Project: Kafka

Re: [VOTE] KIP-276 Add StreamsConfig prefix for different consumers

2018-04-20 Thread Bill Bejeck
+1 Thanks, Bill On Thu, Apr 19, 2018 at 9:50 AM, Boyang Chen wrote: > Thanks guys! > > Sent from my iPhone > > > On Apr 19, 2018, at 8:28 PM, Matthias J. Sax > wrote: > > > > +1 (binding) > > > > -Matthias > > > >> On 4/19/18 9:08 AM, Ted Yu wrote: > >> +1 > >> Original message --

Re: [DISCUSS]KIP-216: IQ should throw different exceptions for different errors

2018-04-20 Thread Bill Bejeck
Hi Vito, Thanks for the KIP, overall it's a +1 from me. At this point, the only thing I would change is possibly removing the listing of all methods called by the user and the listing of all store types and focus on what states result in which exceptions thrown to the user. Thanks, Bill On Fri,

Re: [VOTE] Kafka 2.0.0 in June 2018

2018-04-18 Thread Bill Bejeck
+1 Thanks, Bill On Wed, Apr 18, 2018 at 6:07 PM, Edoardo Comar wrote: > thanks Ismael > > +1 (non-binding) > > -- > > Edoardo Comar > > IBM Message Hub > > IBM UK Ltd, Hursley Park, SO21 2JN > > > > From: Rajini Sivaram > To: dev > Date:

[jira] [Created] (KAFKA-6802) Improve logging when topics aren't known and assignments skipped

2018-04-18 Thread Bill Bejeck (JIRA)
Bill Bejeck created KAFKA-6802: -- Summary: Improve logging when topics aren't known and assignments skipped Key: KAFKA-6802 URL: https://issues.apache.org/jira/browse/KAFKA-6802 Project:

Re: [VOTE] KIP-270 A Scala wrapper library for Kafka Streams

2018-04-16 Thread Bill Bejeck
+1 -Bill On Mon, Apr 16, 2018 at 5:14 AM, Matthias J. Sax wrote: > +1 (binding) > > On 4/16/18 9:33 AM, Michael Noll wrote: > > +1 (non-binding) > > > > Thanks for contributing and shepherding this, Debasish and team! > > > > And thanks also to Alexis Seigneurin for the original start of the Sc

Re: [VOTE] KIP-284 Set default retention ms for Streams repartition topics to Long.MAX_VALUE

2018-04-09 Thread Bill Bejeck
Thanks for the KIP. +1 -Bill On Mon, Apr 9, 2018 at 7:57 AM, zhenya Sun wrote: > +1 > > > from my iphone! > On 04/09/2018 17:27, khaireddine Rezgui wrote: > Hi guys, > > I created this thread to get your agreement about the new default value of > the retention_ms in kafka stream repartion topi

[jira] [Created] (KAFKA-6761) Reduce Kafka Streams Footprint

2018-04-06 Thread Bill Bejeck (JIRA)
Bill Bejeck created KAFKA-6761: -- Summary: Reduce Kafka Streams Footprint Key: KAFKA-6761 URL: https://issues.apache.org/jira/browse/KAFKA-6761 Project: Kafka Issue Type: Improvement

Re: [DISCUSS] KIP-276: Add StreamsConfig prefix for different consumers

2018-04-03 Thread Bill Bejeck
Boyang, Thanks for making changes to the KIP, I'm +1 on the updated version. -Bill On Tue, Apr 3, 2018 at 1:14 AM, Boyang Chen wrote: > Hey friends, > > > both KIP 276+Add+StreamsConfig+prefix+for+different+consumers> and pull request<

Re: [DISCUSS] KIP-274: Kafka Streams Skipped Records Metrics

2018-04-03 Thread Bill Bejeck
t; > > > >>>>> > > > >>>>> > > > >>>>> On your last note, yeah, I got that impression from Guozhang as > > well. > > > >>>>> Thanks for the clarification. > > > >>>>> > >

Re: [VOTE] KIP-274: Kafka Streams Skipped Records Metrics

2018-04-02 Thread Bill Bejeck
Thanks for the KIP. +1 -Bill On Mon, Apr 2, 2018 at 10:09 AM, John Roesler wrote: > Dear Kafka community, > > I am proposing KIP-274 to improve visibility when Streams skips invalid > records. > > The proposal is to simplify the metrics and add warning logs. > > Please find details in the wiki

Re: [DISCUSS] KIP-274: Kafka Streams Skipped Records Metrics

2018-03-30 Thread Bill Bejeck
Thanks for the KIP John, and sorry for the late comments. I'm on the fence with providing a single level metrics, but I think we'll have that discussion outside of this KIP. > * maintain one skipped-record metric (could be per-thread, per-task, or > per-processor-node) with no "reason" > * introd

Re: [ANNOUNCE] New Committer: Dong Lin

2018-03-28 Thread Bill Bejeck
Congrats Dong! On Wed, Mar 28, 2018 at 1:58 PM, Ted Yu wrote: > Congratulations, Dong. > > On Wed, Mar 28, 2018 at 10:58 AM, Becket Qin wrote: > > > Hello everyone, > > > > The PMC of Apache Kafka is pleased to announce that Dong Lin has accepted > > our invitation to be a new Kafka committer.

[jira] [Created] (KAFKA-6708) Review JavaDocs and Documentation with regards to Serde Useage

2018-03-23 Thread Bill Bejeck (JIRA)
Bill Bejeck created KAFKA-6708: -- Summary: Review JavaDocs and Documentation with regards to Serde Useage Key: KAFKA-6708 URL: https://issues.apache.org/jira/browse/KAFKA-6708 Project: Kafka

[jira] [Created] (KAFKA-6704) Checking hasNext from SegementIterator could throw InvalidStateStoreException

2018-03-22 Thread Bill Bejeck (JIRA)
Bill Bejeck created KAFKA-6704: -- Summary: Checking hasNext from SegementIterator could throw InvalidStateStoreException Key: KAFKA-6704 URL: https://issues.apache.org/jira/browse/KAFKA-6704 Project

Re: Gradle strategy for exposing and using public test-utils modules

2018-03-22 Thread Bill Bejeck
John, Thanks for the clear, detailed explanation. I'm +1 on what you have proposed. While I agree with you manually pulling in transitive test dependencies is not ideal, in this case, I think it's worth it to get over the circular dependency hurdle and use streams:test-utils ourselves. -Bill On

Re: [VOTE] KIP-268: Simplify Kafka Streams Rebalance Metadata Upgrade

2018-03-20 Thread Bill Bejeck
+1 Thanks, Bill On Tue, Mar 20, 2018 at 9:23 PM, Ted Yu wrote: > +1 > > On Tue, Mar 20, 2018 at 5:56 PM, Richard Yu > wrote: > > > Hi Matthias, > > Thanks for setting up the upgrade path. > > > > +1 (non-binding) > > > > On Tue, Mar 20, 2018 at 3:42 PM, Matthias J. Sax > > wrote: > > > > > Hi

Re: [VOTE] KIP-267: Add Processor Unit Test Support to Kafka Streams Test Utils

2018-03-09 Thread Bill Bejeck
Thanks for the KIP. +1 -Bill On Fri, Mar 9, 2018 at 3:16 PM, John Roesler wrote: > Hello all, > > I'd like to start voting on KIP-267, to introduce a MockProcessorContent > enabling Processor, Transformer, and ValueTransformer authors to unit-test > their components. > > https://cwiki.apache.o

Re: [DISCUSS] KIP-258: Allow to Store Record Timestamps in RocksDB

2018-03-09 Thread Bill Bejeck
Matthias, Thanks for the KIP, it's a +1 from me. I do have one question regarding the retrieval methods on the new interfaces. Would want to consider adding one method with a Predicate that would allow for filtering records by the timestamp stored with the record? Or is this better left for use

Re: [DISCUSS] KIP-267: Add Processor Unit Test Support to Kafka Streams Test Utils

2018-03-09 Thread Bill Bejeck
John, Sorry for the delayed response. Thanks for the KIP, I'm +1 on it, and I don't have any further comments on the KIP itself aside from the comments that others have raised. Regarding the existing MockProcessorContext and its removal in favor of the one added from this KIP, I'm actually in fa

<    2   3   4   5   6   7   8   9   10   11   >