[jira] [Created] (KAFKA-7434) DeadLetterQueueReporter throws NPE if transform throws NPE

2018-09-24 Thread Michal Borowiecki (JIRA)
Michal Borowiecki created KAFKA-7434: Summary: DeadLetterQueueReporter throws NPE if transform throws NPE Key: KAFKA-7434 URL: https://issues.apache.org/jira/browse/KAFKA-7434 Project: Kafka

Re: [VOTE] KIP-138: Change punctuate semantics

2017-08-31 Thread Michal Borowiecki
nt-326043657)? Guozhang On Sat, May 13, 2017 at 8:13 AM, Michal Borowiecki < michal.borowie...@openbet.com> wrote: Thank you all! This KIP passed the vote with 3 binding and 5 non-binding +1s: +1 (binding) from Guozhang Wang, Ismael Juma and Ewen Cheslack-Postava +1 (non-binding) from Mat

[jira] [Created] (KAFKA-5677) Remove deprecated punctuate method

2017-07-29 Thread Michal Borowiecki (JIRA)
Michal Borowiecki created KAFKA-5677: Summary: Remove deprecated punctuate method Key: KAFKA-5677 URL: https://issues.apache.org/jira/browse/KAFKA-5677 Project: Kafka Issue Type: Task

Re: [DISCUSS] 2017 October release planning and release version

2017-07-21 Thread Michal Borowiecki
gt; > Change introduced contrary to the SLO, is OK to be reported as bug. > > > > > > Everything else is improvement or feature request. > > > > > > > > > > > > If this was the case, and 1.0.0 was released toda

Re: [DISCUSS] KIP-147: Add missing type parameters to StateStoreSupplier factories and KGroupedStream/Table methods

2017-06-24 Thread Michal Borowiecki
I think the discussion on Streams DSL refactoring will render this KIP obsolete. I'll leave is as under discussion until something is agreed and then move it to discarded. Cheers, Michał On 03/06/17 10:02, Michal Borowiecki wrote: I agree maintaining backwards-compatibility here adds

Re: Re: [DISCUSS] KIP-165: Extend Interactive Queries for return latest update timestamp per key

2017-06-24 Thread Michal Borowiecki
/KAFKA/KIP- 165%3A+Extend+Interactive+Queries+for+return+latest+ update+timestamp+per+key [2] https://issues.apache.org/jira/browse/KAFKA-4304 Cheers, Jeyhun -- Signature <http://www.openbet.com/> Michal Borowiecki Senior Software Engineer L4 T: +44

Re: [DISCUSS] KIP-163: Lower the Minimum Required ACL Permission of OffsetFetch

2017-06-20 Thread Michal Borowiecki
IP accordingly. --Vahid From: Michal Borowiecki <michal.borowie...@openbet.com> To:us...@kafka.apache.org, Vahid S Hashemian < vahidhashem...@us.ibm.com>, dev@kafka.apache.org Date:06/13/2017 01:35 AM Subject:Re: [DISCUSS] KIP-163: Lower the Minimum Re

Re: Kafka Streams vs Spark Streaming : reduce by window

2017-06-18 Thread Michal Borowiecki
. Perhaps this is in fact what you are proposing? -Jay On Fri, Jun 16, 2017 at 2:38 AM, Michal Borowiecki <michal.borowie...@openbet.com <mailto:michal.borowie...@openbet.com>> wrote: I wonder if it's a frequent enough use case that Kafka Streams should consider provid

Re: Kafka Streams vs Spark Streaming : reduce by window

2017-06-16 Thread Michal Borowiecki
evel ? Thanks, Paolo Paolo Patierno Senior Software Engineer (IoT) @ Red Hat Microsoft MVP on Windows Embedded & IoT Microsoft Azure Advisor Twitter : @ppatierno<http://twitter.com/ppatierno> Linkedin : paolopatierno<http://it.linkedin.com/in/paolopatierno> Blog : Dev

Re: [DISCUSS] KIP-150 - Kafka-Streams Cogroup

2017-06-13 Thread Michal Borowiecki
aggregators after each call so we must return a ktable just to possibly not need to have created it. On Jun 13, 2017 5:20 AM, "Michal Borowiecki" <michal.borowie...@openbet.com> wrote: Actually, just had a thought. It started with naming. Are we actually co-grouping these stre

[jira] [Commented] (KAFKA-5245) KStream builder should capture serdes

2017-06-13 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16047608#comment-16047608 ] Michal Borowiecki commented on KAFKA-5245: -- Just wanted to say it's great to see there's a ticket

Re: [DISCUSS] KIP-163: Lower the Minimum Required ACL Permission of OffsetFetch

2017-06-13 Thread Michal Borowiecki
ACL+Permission+of+OffsetFetch The KIP is to address KAFKA-4585. Feedback and suggestions are welcome! Thanks. --Vahid -- Signature <http://www.openbet.com/> Michal Borowiecki Senior Software Engineer L4 T: +44 208 742 1600 +44 203 249 8448

Re: Test fail reason on doc fix

2017-06-12 Thread Michal Borowiecki
witter.com/ppatierno> Linkedin : paolopatierno<http://it.linkedin.com/in/paolopatierno> Blog : DevExperience<http://paolopatierno.wordpress.com/> -- Signature <http://www.openbet.com/> Michal Borowiecki Senior Software Engineer L4 T: +44 208

[jira] [Comment Edited] (KAFKA-5419) Console consumer --key-deserializer and --value-deserializer are always overwritten by ByteArrayDeserializer

2017-06-09 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044557#comment-16044557 ] Michal Borowiecki edited comment on KAFKA-5419 at 6/9/17 3:42 PM: -- I

[jira] [Comment Edited] (KAFKA-5419) Console consumer --key-deserializer and --value-deserializer are always overwritten by ByteArrayDeserializer

2017-06-09 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044557#comment-16044557 ] Michal Borowiecki edited comment on KAFKA-5419 at 6/9/17 3:41 PM: -- I

[jira] [Commented] (KAFKA-5419) Console consumer --key-deserializer and --value-deserializer are always overwritten by ByteArrayDeserializer

2017-06-09 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044557#comment-16044557 ] Michal Borowiecki commented on KAFKA-5419: -- I think it's a duplicate of KAFKA-2526 > Cons

Re: Re: synchronous request response using kafka

2017-06-09 Thread Michal Borowiecki
: Can someone please share some thoughts whether we can do synchronous call (request response) using kafka similar to JMS Thanks Sanjay 913-221-9164 -- Signature <http://www.openbet.com/> Michal Borowiecki Senior Software Engineer L4 T: +44 208 742 1600

[jira] [Commented] (KAFKA-5246) Remove backdoor that allows any client to produce to internal topics

2017-06-09 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044179#comment-16044179 ] Michal Borowiecki commented on KAFKA-5246: -- Would it instead perhaps make sense to document

Re: [DISCUSS] KIP-147: Add missing type parameters to StateStoreSupplier factories and KGroupedStream/Table methods

2017-06-03 Thread Michal Borowiecki
code and increasing the surface area for what is minimal benefit. It is one of those cases where i'd love to not have to maintain backward compatibility. Thanks, Damian On Fri, 2 Jun 2017 at 08:20 Michal Borowiecki <michal.borowie...@openbet.com <mailto:michal.

Re: Sink Processor definition

2017-06-03 Thread Michal Borowiecki
the terminology is incorrect as strictly speaking a processor that writes data to anything could be considered a Sink Processor. On Sat, 3 Jun 2017 at 09:23 Michal Borowiecki <michal.borowie...@openbet.com <mailto:michal.borowie...@openbet.com>> wrote: Hi all, Stre

Sink Processor definition

2017-06-03 Thread Michal Borowiecki
to a kafka topic (directly) but only updates a state store also be considered a sink processor? I think yes. I'll submit a PR to that effect unless I hear otherwise. Cheers, Michał -- Signature <http://www.openbet.com/> Michal Borowiecki Senior Software Engineer L4 T: +44 2

Re: [DISCUSS] KIP-138: Change punctuate semantics

2017-06-02 Thread Michal Borowiecki
. One minor comment: can you add `ValueTransformer#punctuate()` to the list of deprecated methods? -Matthias On 5/4/17 1:41 AM, Michal Borowiecki wrote: Further in this direction I've updated the main proposal to incorporate the Cancellable return type for ProcessorContext.schedule

Re: 0.11.0.0 Release Update

2017-06-02 Thread Michal Borowiecki
release notes/email for the release. I added some items to get it going. Please add to this list anything you think is worth noting. I'll plan to give another update next week just before the KIP freeze. Ismael -- Signature <http://www.openbet.com/> Michal Borowiecki Senior Software Engin

Re: [VOTE] KIP-164 Add unavailablePartitionCount and per-partition Unavailable metrics

2017-06-02 Thread Michal Borowiecki
isplay/KAFKA/KIP-164-+Add+UnderMinIsrPartitionCount+and+per-partition+UnderMinIsr+metrics . Thanks, Dong -- Signature <http://www.openbet.com/> Michal Borowiecki Senior Software Engineer L4 T: +44 208 742 1600 +44 203 249 8448

Re: [DISCUSS] KIP-147: Add missing type parameters to StateStoreSupplier factories and KGroupedStream/Table methods

2017-06-02 Thread Michal Borowiecki
AM, Michal Borowiecki wrote: Hi all, I've updated the KIP to reflect the proposed backwards-compatible approach: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=69408481 Given the vast area of APIs affected, I think the PR is easier to read than the code excerpts in the KIP

Re: Jira-Spam on Dev-Mailinglist

2017-05-31 Thread Michal Borowiecki
archives. regards Marc -- -- Guozhang -- -- Guozhang -- Signature <http://www.openbet.com/> Michal Borowiecki Senior Software Engineer L4 T: +44 208 742 1600 +44 203 249 8448 E: michal.borowie...@openbet.com

[jira] [Commented] (KAFKA-5155) Messages can be deleted prematurely when some producers use timestamps and some not

2017-05-27 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027521#comment-16027521 ] Michal Borowiecki commented on KAFKA-5155: -- Hi [~plavjanik], do you care to submit a pull request

Re: [DISCUSS] KIP-147: Add missing type parameters to StateStoreSupplier factories and KGroupedStream/Table methods

2017-05-27 Thread Michal Borowiecki
/apache/kafka/pull/2992/files Thanks, Michał On 07/05/17 10:16, Eno Thereska wrote: I like this KIP in general and I agree it’s needed. Perhaps Damian can comment on the session store issue? Thanks Eno On May 6, 2017, at 10:32 PM, Michal Borowiecki <michal.borowie...@openbet.com> wrot

[jira] [Commented] (KAFKA-5319) Add a tool to make cluster replica and leader balance

2017-05-24 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022695#comment-16022695 ] Michal Borowiecki commented on KAFKA-5319: -- [~markTC], shouldn't this be in "Patch Avai

Re: [DISCUSS]: KIP-159: Introducing Rich functions to Streams

2017-05-23 Thread Michal Borowiecki
. Thanks. Cheers, Jeyhun On Mon, May 22, 2017 at 11:02 AM, Michal Borowiecki <michal.borowie...@openbet.com <mailto:michal.borowie...@openbet.com>> wrote: Hi Jeyhun, I'd like to understand better the premise of RichFunctions and why |init(Some params)|,|close() |ar

[jira] [Commented] (KAFKA-5243) Request to add row limit in ReadOnlyKeyValueStore range function

2017-05-23 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16020911#comment-16020911 ] Michal Borowiecki commented on KAFKA-5243: -- Just a note, replacing the second argument

[jira] [Updated] (KAFKA-5233) Changes to punctuate semantics (KIP-138)

2017-05-23 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michal Borowiecki updated KAFKA-5233: - Fix Version/s: (was: 0.11.0.0) 0.11.1.0 > Changes to punctu

Re: [DISCUSS]: KIP-159: Introducing Rich functions to Streams

2017-05-22 Thread Michal Borowiecki
+Rich+functions+to+Streams Cheers, Jeyhun -- Signature <http://www.openbet.com/> Michal Borowiecki Senior Software Engineer L4 T: +44 208 742 1600 +44 203 249 8448 E: michal.borowie...@openbet.com

[jira] [Updated] (KAFKA-5233) Changes to punctuate semantics (KIP-138)

2017-05-15 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michal Borowiecki updated KAFKA-5233: - Status: Patch Available (was: In Progress) Pull request here: https://github.com/apache

[jira] [Work started] (KAFKA-5233) Changes to punctuate semantics (KIP-138)

2017-05-15 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-5233 started by Michal Borowiecki. > Changes to punctuate semantics (KIP-

[jira] [Commented] (KAFKA-3455) Connect custom processors with the streams DSL

2017-05-15 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16010530#comment-16010530 ] Michal Borowiecki commented on KAFKA-3455: -- Hi [~bobbycalderwood], Can you please describe your

[jira] [Updated] (KAFKA-5233) Changes to punctuate semantics (KIP-138)

2017-05-13 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michal Borowiecki updated KAFKA-5233: - Labels: kip (was: ) > Changes to punctuate semantics (KIP-

Re: [VOTE] KIP-138: Change punctuate semantics

2017-05-13 Thread Michal Borowiecki
ael On Sat, May 6, 2017 at 6:18 PM, Michal Borowiecki < michal.borowie...@openbet.com> wrote: Hi all, Given I'm not seeing any contentious issues remaining on the discussion thread, I'd like to initiate the vote for: KIP-138: Change punctuate semantics https://cwiki.apache.org/confluence/d

[jira] [Commented] (KAFKA-3514) Stream timestamp computation needs some further thoughts

2017-05-13 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009365#comment-16009365 ] Michal Borowiecki commented on KAFKA-3514: -- I've created KAFKA-5233 to track work related to KIP

[jira] [Created] (KAFKA-5233) Changes to punctuate semantics (KIP-138)

2017-05-13 Thread Michal Borowiecki (JIRA)
Michal Borowiecki created KAFKA-5233: Summary: Changes to punctuate semantics (KIP-138) Key: KAFKA-5233 URL: https://issues.apache.org/jira/browse/KAFKA-5233 Project: Kafka Issue Type

Re: [VOTE] KIP-155 Add range scan for windowed state stores

2017-05-11 Thread Michal Borowiecki
V of the WindowStoreIterator. All-in-all, I'd still prefer KeyValueIterator<Windowed, V> as it more clearly names what's what. What do you think? Thanks, Michal On 11/05/17 07:51, Michal Borowiecki wrote: Well, another concern, apart from potential confusion, is that you won't be able

Re: [VOTE] KIP-155 Add range scan for windowed state stores

2017-05-11 Thread Michal Borowiecki
ge method. Hope this make sense? Let me know if you still have concerns about this. Thank you, Xavier On Wed, May 10, 2017 at 12:25 PM Michal Borowiecki < michal.borowie...@openbet.com> wrote: > Apologies, I missed the discussion (or lack thereof) about the return > type of: > >

Re: [VOTE] KIP-155 Add range scan for windowed state stores

2017-05-10 Thread Michal Borowiecki
Apologies, I missed the discussion (or lack thereof) about the return type of: WindowStoreIterator> fetch(K from, K to, long timeFrom, long timeTo) WindowStoreIterator (as the KIP mentions) is a subclass of KeyValueIterator KeyValueIterator has the following

Re: [VOTE] KIP-138: Change punctuate semantics

2017-05-10 Thread Michal Borowiecki
, 2017, at 11:01 PM, Bill Bejeck <bbej...@gmail.com> wrote: +1 Thanks, Bill On Sat, May 6, 2017 at 5:58 PM, Matthias J. Sax <matth...@confluent.io> wrote: +1 Thanks a lot for this KIP! -Matthias On 5/6/17 10:18 AM, Michal Borowiecki wrote: Hi all, Given I'm not seeing any conten

Re: [DISCUSS]: KIP-149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner

2017-05-09 Thread Michal Borowiecki
+1 :) On 08/05/17 23:52, Matthias J. Sax wrote: Hi, I was reading the updated KIP and I am wondering, if we should do the design a little different. Instead of distinguishing between a RichFunction and non-RichFunction at runtime level, we would use RichFunctions all the time. Thus, on the

[jira] [Commented] (KAFKA-5201) Compacted topic could be misused to fill up a disk but deletion policy can't retain legitimate keys

2017-05-09 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16002311#comment-16002311 ] Michal Borowiecki commented on KAFKA-5201: -- Hi Edoardo, >From the broker's perspect

Re: [DISCUSS] KIP-155 Add range scan for windowed state stores

2017-05-08 Thread Michal Borowiecki
://cwiki.apache.org/confluence/display/KAFKA/KIP+155+-+Add+range+scan+for+windowed+state+stores https://issues.apache.org/jira/browse/KAFKA-5192 Thank you, Xavier -- Signature <http://www.openbet.com/> Michal Borowiecki Senior Software Engineer L4 T: +44 208 74

Re: [DISCUSS] KIP-147: Add missing type parameters to StateStoreSupplier factories and KGroupedStream/Table methods

2017-05-07 Thread Michal Borowiecki
on the session store issue? Thanks Eno On May 6, 2017, at 10:32 PM, Michal Borowiecki <michal.borowie...@openbet.com> wrote: Hi Matthias, Agreed. I tried your proposal and indeed it would work. However, I think to maintain full backward compatibility we would also need to deprecate Stores.

Re: [DISCUSS]: KIP-149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner

2017-05-07 Thread Michal Borowiecki
. Cheers, Jeyhun On Sun, May 7, 2017 at 11:46 AM Michal Borowiecki <michal.borowie...@openbet.com <mailto:michal.borowie...@openbet.com>> wrote: Do I understanding correctly, that with the proposed pattern one could not pass a lambda expression and access the context fro

Re: [DISCUSS]: KIP-149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner

2017-05-07 Thread Michal Borowiecki
lueJoiner [2] https://issues.apache.org/jira/browse/KAFKA-4218 [3] https://issues.apache.org/jira/browse/KAFKA-4726 [4] https://issues.apache.org/jira/browse/KAFKA-3745 [5] https://github.com/apache/kafka/pull/2946 Cheers, Jeyhun -- -Cheers Jeyhun -- -Cheers Jeyhun -- -Cheers Jeyhun

Re: [DISCUSS] KIP-147: Add missing type parameters to StateStoreSupplier factories and KGroupedStream/Table methods

2017-05-06 Thread Michal Borowiecki
ld). -Matthias On 5/4/17 11:32 AM, Matthias J. Sax wrote: Did not have time to have a look. But backward compatibility is a must from my point of view. -Matthias On 5/4/17 12:56 AM, Michal Borowiecki wrote: Hello, I've updated the KIP with missing information. I would especially appreciat

[VOTE] KIP-138: Change punctuate semantics

2017-05-06 Thread Michal Borowiecki
ttp://www.openbet.com/> Michal Borowiecki Senior Software Engineer L4 T: +44 208 742 1600 +44 203 249 8448 E: michal.borowie...@openbet.com W: www.openbet.com <http://www.openbet.com/>

Re: [DISCUSS] KIP-147: Add missing type parameters to StateStoreSupplier factories and KGroupedStream/Table methods

2017-05-04 Thread Michal Borowiecki
/04/17 23:11, Michal Borowiecki wrote: Hi community! I have just drafted KIP-147: Add missing type parameters to StateStoreSupplier factories and KGroupedStream/Table methods <https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=69408481> Please let me know if this

[jira] [Comment Edited] (KAFKA-5155) Messages can be deleted prematurely when some producers use timestamps and some not

2017-05-03 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994575#comment-15994575 ] Michal Borowiecki edited comment on KAFKA-5155 at 5/3/17 9:44 AM: -- Hi

Re: Support for Kafka Consumer over SASL_SSL

2017-05-01 Thread Michal Borowiecki
9) Nixon -- Signature <http://www.openbet.com/> Michal Borowiecki Senior Software Engineer L4 T: +44 208 742 1600 +44 203 249 8448 E: michal.borowie...@openbet.com W: www.openbet.com <htt

[jira] [Commented] (KAFKA-5144) MinTimestampTracker does not correctly add timestamps lower than the current max

2017-05-01 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990683#comment-15990683 ] Michal Borowiecki commented on KAFKA-5144: -- I understand now, thanks a lot for the thorough

[DISCUSS] KIP-147: Add missing type parameters to StateStoreSupplier factories and KGroupedStream/Table methods

2017-04-30 Thread Michal Borowiecki
elcome. Thanks, Michal -- Signature <http://www.openbet.com/> Michal Borowiecki Senior Software Engineer L4 T: +44 208 742 1600 +44 203 249 8448 E: michal.borowie...@openbet.com W: www.openbet.com <http://

Re: [DISCUSS] KIP-138: Change punctuate semantics

2017-04-30 Thread Michal Borowiecki
e merit of this vs lastPunctuationTime = ctx.timestamp(); but that's what PunctuationQueue does currently } // do some other business logic here } Looking forward to your thoughts. Cheers, Michal -- Signature <http://www.openbet.com/> Michal Borowiecki Senior Software

[jira] [Commented] (KAFKA-5144) MinTimestampTracker does not correctly add timestamps lower than the current max

2017-04-30 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990335#comment-15990335 ] Michal Borowiecki commented on KAFKA-5144: -- Added a second [PR|https://github.com/apache/kafka

[jira] [Commented] (KAFKA-5144) MinTimestampTracker does not correctly add timestamps lower than the current max

2017-04-30 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990329#comment-15990329 ] Michal Borowiecki commented on KAFKA-5144: -- [PR|https://github.com/apache/kafka/pull/2947/commits

[jira] [Created] (KAFKA-5144) MinTimestampTracker does not correctly add timestamps lower than the current max

2017-04-30 Thread Michal Borowiecki (JIRA)
Michal Borowiecki created KAFKA-5144: Summary: MinTimestampTracker does not correctly add timestamps lower than the current max Key: KAFKA-5144 URL: https://issues.apache.org/jira/browse/KAFKA-5144

[jira] [Commented] (KAFKA-3514) Stream timestamp computation needs some further thoughts

2017-04-30 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990288#comment-15990288 ] Michal Borowiecki commented on KAFKA-3514: -- Agreed. That's what I meant. Beyond the scope of KIP

[jira] [Commented] (KAFKA-3514) Stream timestamp computation needs some further thoughts

2017-04-30 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990176#comment-15990176 ] Michal Borowiecki commented on KAFKA-3514: -- I think the description of this ticket is missing

[jira] [Updated] (KAFKA-4593) Task migration during rebalance callback process could lead the obsoleted task's IllegalStateException

2017-04-29 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michal Borowiecki updated KAFKA-4593: - Description: 1. Assume 2 running threads A and B, and one task t1 just for simplicity

Re: [DISCUSS] KIP 141 - ProducerRecordBuilder Interface

2017-04-23 Thread Michal Borowiecki
However, if you're used to working with immutables, it can feel natural that withPartition would return a new object, so it could be more prone to mistakes. Cheers, Michal On 23/04/17 10:41, Michal Borowiecki wrote: IMHO, the ProducerRecord is anyway not immutable until send, since key

Re: [DISCUSS] KIP 141 - ProducerRecordBuilder Interface

2017-04-23 Thread Michal Borowiecki
(register number 195355) and IG Index Limited (register number 114059) are authorised and regulated by the Financial Conduct Authority. -- Signature <http://www.openbet.com/> Michal Borowiecki Senior Software Engineer L4 T: +44 208 742 1600 +44 2

Re: [VOTE] 0.10.2.1 RC3

2017-04-22 Thread Michal Borowiecki
s://twitter.com/ConfluentInc> | blog <http://www.confluent.io/blog> -- Signature <http://www.openbet.com/> Michal Borowiecki Senior Software Engineer L4 T: +44 208 742 1600 +44 203 249 8448 E: michal.bo

[jira] [Updated] (KAFKA-5090) Kafka Streams SessionStore.findSessions javadoc broken

2017-04-19 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michal Borowiecki updated KAFKA-5090: - Affects Version/s: 0.10.2.1 > Kafka Streams SessionStore.findSessions javadoc bro

[jira] [Issue Comment Deleted] (KAFKA-5090) Kafka Streams SessionStore.findSessions javadoc broken

2017-04-19 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michal Borowiecki updated KAFKA-5090: - Comment: was deleted (was: https://github.com/apache/kafka/pull/2874) > Kafka Stre

[jira] [Updated] (KAFKA-5090) Kafka Streams SessionStore.findSessions javadoc broken

2017-04-19 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michal Borowiecki updated KAFKA-5090: - Status: Patch Available (was: Open) https://github.com/apache/kafka/pull/2874 > Ka

[jira] [Created] (KAFKA-5090) Kafka Streams SessionStore.findSessions javadoc broken

2017-04-19 Thread Michal Borowiecki (JIRA)
Michal Borowiecki created KAFKA-5090: Summary: Kafka Streams SessionStore.findSessions javadoc broken Key: KAFKA-5090 URL: https://issues.apache.org/jira/browse/KAFKA-5090 Project: Kafka

Re: [DISCUSS] KIP-138: Change punctuate semantics

2017-04-16 Thread Michal Borowiecki
access yet [arunmathew88]. Should I be > sending a separate mail for this? > > I thought one of the person following this thread would be able to give me > access. > > > > *From: *Michal Borowiecki <michal.borowie...@openbet.com>

Re: 答复: Invoking KafkaConsumer#seek for the same partition

2017-04-13 Thread Michal Borowiecki
ht. I would have been thinking it that way Thank you. ________ 发件人: Michal Borowiecki <michal.borowie...@openbet.com> 发送时间: 2017年4月13日 17:02 收件人: dev@kafka.apache.org 主题: Re: Invoking KafkaConsumer#seek for the same partition Sounds to me the comment is imprecise

Re: Invoking KafkaConsumer#seek for the same partition

2017-04-13 Thread Michal Borowiecki
Sounds to me the comment is imprecisely phrased but was meant to indicate the behaviour you are describing. Perhaps instead of "the latest offset", it should say, "the offset used in the latest seek" to make it super-clear. Cheers, Michal On 13/04/17 08:28, Hu Xi wrote: Hi guys, The

Re: [VOTE] 0.10.2.1 RC0

2017-04-12 Thread Michal Borowiecki
wen Shapira -- Gwen Shapira Product Manager | Confluent 650.450.2760 | @gwenshap Follow us: Twitter | blog -- Signature <http://www.openbet.com/> Michal Borowiecki Senior Software Engineer L4 T: +44 208 742 1600 +44 203 249 8448

Re: [DISCUSS] KIP-138: Change punctuate semantics

2017-04-07 Thread Michal Borowiecki
;>>>>>>> to >>>>>>>> track the time progress per partition (based on the partitions >>>>>>>> they >>>>>>>> obverse via context.partition(). (This alone puts a huge burden >>>>>>>> on >>>>>

[jira] [Commented] (KAFKA-4971) Why is there no difference between kafka benchmark tests on SSD and HDD?

2017-04-04 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955260#comment-15955260 ] Michal Borowiecki commented on KAFKA-4971: -- I'd venture a guess that you are limited by something

Re: [DISCUSS] KIP-138: Change punctuate semantics

2017-04-03 Thread Michal Borowiecki
l callback to Processor that can be scheduled similarly to punctuate() but was always called at fixed, wall clock based intervals? This way you wouldn't have to give up the notion of stream time to be able to do periodic processing. On Mon, 2017-04-03 at 10:34 +0100, Michal Borowiecki wrote: Hi all, I ha

[jira] [Comment Edited] (KAFKA-4971) Why is there no difference between kafka benchmark tests on SSD and HDD?

2017-04-03 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953608#comment-15953608 ] Michal Borowiecki edited comment on KAFKA-4971 at 4/3/17 2:54 PM: -- I

[jira] [Commented] (KAFKA-4971) Why is there no difference between kafka benchmark tests on SSD and HDD?

2017-04-03 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953608#comment-15953608 ] Michal Borowiecki commented on KAFKA-4971: -- I think your question would be easier to respond

[DISCUSS] KIP-138: Change punctuate semantics

2017-04-03 Thread Michal Borowiecki
Hi all, I have created a draft for KIP-138: Change punctuate semantics . Appreciating there can be different views on system-time vs event-time semantics for punctuation depending on use-case and the

[jira] [Commented] (KAFKA-4835) Allow users control over repartitioning

2017-03-13 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15907523#comment-15907523 ] Michal Borowiecki commented on KAFKA-4835: -- My point above was that if the customerRef (which

[jira] [Commented] (KAFKA-4835) Allow users control over repartitioning

2017-03-10 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904785#comment-15904785 ] Michal Borowiecki commented on KAFKA-4835: -- Yes, that's the case. Message key is a concatenation

[jira] [Commented] (KAFKA-3514) Stream timestamp computation needs some further thoughts

2017-03-06 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897771#comment-15897771 ] Michal Borowiecki commented on KAFKA-3514: -- Oh, I wouldn't mind that at all. Just thought

[jira] [Commented] (KAFKA-3514) Stream timestamp computation needs some further thoughts

2017-03-06 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897413#comment-15897413 ] Michal Borowiecki commented on KAFKA-3514: -- Thank you for responding. Just now I had a thought

[jira] [Commented] (KAFKA-3514) Stream timestamp computation needs some further thoughts

2017-03-06 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897371#comment-15897371 ] Michal Borowiecki commented on KAFKA-3514: -- Hi [~enothereska], I have to disagree

[jira] [Commented] (KAFKA-4601) Avoid duplicated repartitioning in KStream DSL

2017-03-03 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15894498#comment-15894498 ] Michal Borowiecki commented on KAFKA-4601: -- Created KAFKA-4835. > Avoid duplica

[jira] [Created] (KAFKA-4835) Allow users control over repartitioning

2017-03-03 Thread Michal Borowiecki (JIRA)
Michal Borowiecki created KAFKA-4835: Summary: Allow users control over repartitioning Key: KAFKA-4835 URL: https://issues.apache.org/jira/browse/KAFKA-4835 Project: Kafka Issue Type

[jira] [Commented] (KAFKA-4601) Avoid duplicated repartitioning in KStream DSL

2017-02-23 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881030#comment-15881030 ] Michal Borowiecki commented on KAFKA-4601: -- Don't know if this belongs in this ticket or warrants

[jira] [Created] (KAFKA-4750) KeyValueIterator returns null values

2017-02-09 Thread Michal Borowiecki (JIRA)
Michal Borowiecki created KAFKA-4750: Summary: KeyValueIterator returns null values Key: KAFKA-4750 URL: https://issues.apache.org/jira/browse/KAFKA-4750 Project: Kafka Issue Type: Bug

[jira] [Commented] (KAFKA-3514) Stream timestamp computation needs some further thoughts

2016-11-21 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15683056#comment-15683056 ] Michal Borowiecki commented on KAFKA-3514: -- IMO, 2) *is* a severe problem. Punctuate methods

[jira] [Commented] (KAFKA-4355) StreamThread intermittently dies with "Topic not found during partition assignment" when broker restarted

2016-11-02 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15628442#comment-15628442 ] Michal Borowiecki commented on KAFKA-4355: -- KAFKA-4366 created for the KafkaSteams.close

[jira] [Created] (KAFKA-4366) KafkaStreams.close() blocks indefinitely

2016-11-02 Thread Michal Borowiecki (JIRA)
Michal Borowiecki created KAFKA-4366: Summary: KafkaStreams.close() blocks indefinitely Key: KAFKA-4366 URL: https://issues.apache.org/jira/browse/KAFKA-4366 Project: Kafka Issue Type

[jira] [Comment Edited] (KAFKA-4355) StreamThread intermittently dies with "Topic not found during partition assignment" when broker restarted

2016-10-29 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15618009#comment-15618009 ] Michal Borowiecki edited comment on KAFKA-4355 at 10/29/16 12:18 PM

[jira] [Commented] (KAFKA-4355) StreamThread intermittently dies with "Topic not found during partition assignment" when broker restarted

2016-10-29 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15618009#comment-15618009 ] Michal Borowiecki commented on KAFKA-4355: -- Trying to work around this issue by calling

[jira] [Commented] (KAFKA-4355) StreamThread intermittently dies with "Topic not found during partition assignment" when broker restarted

2016-10-28 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15616118#comment-15616118 ] Michal Borowiecki commented on KAFKA-4355: -- Perhaps the DefultPartitionGrouper here: https

[jira] [Commented] (KAFKA-4355) StreamThread intermittently dies with "Topic not found during partition assignment" when broker restarted

2016-10-28 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15615967#comment-15615967 ] Michal Borowiecki commented on KAFKA-4355: -- My first suspect so far is the ConsumerCoordinator

[jira] [Created] (KAFKA-4355) StreamThread intermittently dies with "Topic not found during partition assignment" when broker restarted

2016-10-28 Thread Michal Borowiecki (JIRA)
Michal Borowiecki created KAFKA-4355: Summary: StreamThread intermittently dies with "Topic not found during partition assignment" when broker restarted Key: KAFKA-4355 URL: https://issues.apach

[jira] [Updated] (KAFKA-4355) StreamThread intermittently dies with "Topic not found during partition assignment" when broker restarted

2016-10-28 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michal Borowiecki updated KAFKA-4355: - Environment: kafka 0.10.0.0 kafka 0.10.1.0 uname -a Linux lp02485 4.4.0-34-generic #53

[jira] [Updated] (KAFKA-4355) StreamThread intermittently dies with "Topic not found during partition assignment" when broker restarted

2016-10-28 Thread Michal Borowiecki (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michal Borowiecki updated KAFKA-4355: - Description: When (a) starting kafka streams app before the broker or (b) restarting

  1   2   >