[jira] [Created] (KAFKA-14128) Kafka Streams terminates on topic check

2022-08-01 Thread Patrik Kleindl (Jira)
Patrik Kleindl created KAFKA-14128: -- Summary: Kafka Streams terminates on topic check Key: KAFKA-14128 URL: https://issues.apache.org/jira/browse/KAFKA-14128 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-13213) StreamThread: State transition from PARTITIONS_ASSIGNED to PARTITIONS_ASSIGNED

2021-08-18 Thread Patrik Kleindl (Jira)
Patrik Kleindl created KAFKA-13213: -- Summary: StreamThread: State transition from PARTITIONS_ASSIGNED to PARTITIONS_ASSIGNED Key: KAFKA-13213 URL: https://issues.apache.org/jira/browse/KAFKA-13213

Re: Add a customized logo for Kafka Streams

2020-03-13 Thread Patrik Kleindl
, with its head touching the upper > > >>>>> circle and > > >>>>> its tail touching the bottom one. Like Streams, it starts with > Kafka > > >>>>> and ends > > >>>>> with Kafka (ie reading input topics and writing to

Re: [DISCUSS] KIP-552: Add interface to handle unused config

2020-03-12 Thread Patrik Kleindl
s) _cannot_ know which configurations > >>>>>>> are needed by the "extra" components inside the Configurable > >>>>>>> components. Therefore, no approach that involves filtering > >>>>>>> only the "needed" c

Re: Add a customized logo for Kafka Streams

2020-03-03 Thread Patrik Kleindl
Hi Boyang Great idea, that would help in some discussions. To throw in a first idea: https://imgur.com/a/UowXaMk best regards Patrik On Mon, 2 Mar 2020 at 18:23, Boyang Chen wrote: > Hey Apache Kafka committers and community folks, > > over the years Kafka Streams has been widely adopted and

Re: [DISCUSS] KIP-552: Add interface to handle unused config

2020-02-12 Thread Patrik Kleindl
cancelling KIP-552 and instead just > implementing a fix? > > Again, I'm really sorry for not realizing this sooner. And again, thanks > to Gwen for chiming in. > > -John > > On Mon, Feb 10, 2020, at 02:19, Patrik Kleindl wrote: > > Hi John > > Starting an empty

Re: [DISCUSS] KIP-552: Add interface to handle unused config

2020-02-10 Thread Patrik Kleindl
a better fix, > > perhaps the nice thing to do is really a separate logger, so users who > > are not worried about shooting themselves in the foot can make those > > warnings go away. > > > > Gwen Shapira > > Engineering Manager | Confluent > > 650.450.2760 | @g

Re: [DISCUSS] KIP-552: Add interface to handle unused config

2020-02-07 Thread Patrik Kleindl
Hi Gwen Kafka Streams is not a third party library and produces a lot of these warnings, e.g. *The configuration 'main.consumer.max.poll.records' was supplied but isn't a known config.* *The configuration 'admin.retries' was supplied but isn't a known config.* and various others if you try to

Re: [VOTE] KIP-470: TopologyTestDriver test input and output usability improvements

2019-09-20 Thread Patrik Kleindl
+1 (non-binding) Thanks for your efforts Best regards Patrik > Am 20.09.2019 um 19:09 schrieb Bill Bejeck : > > Thanks for the KIP! > > +1(binding) > > -Bill > >> On Fri, Sep 20, 2019 at 10:06 AM Guozhang Wang wrote: >> >> +1 (binding), Thanks! >> >> On Fri, Sep 20, 2019 at 9:56 AM

[jira] [Resolved] (KAFKA-8838) Allow consumer group tool to work with non-existing consumer groups

2019-09-12 Thread Patrik Kleindl (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrik Kleindl resolved KAFKA-8838. --- Resolution: Not A Problem > Allow consumer group tool to work with non-existing consu

[jira] [Created] (KAFKA-8838) Allow consumer group tool to work with non-existing consumer groups

2019-08-27 Thread Patrik Kleindl (Jira)
Patrik Kleindl created KAFKA-8838: - Summary: Allow consumer group tool to work with non-existing consumer groups Key: KAFKA-8838 URL: https://issues.apache.org/jira/browse/KAFKA-8838 Project: Kafka

[jira] [Created] (KAFKA-8766) Allow a custom offset policy for Kafka Streams applications

2019-08-07 Thread Patrik Kleindl (JIRA)
Patrik Kleindl created KAFKA-8766: - Summary: Allow a custom offset policy for Kafka Streams applications Key: KAFKA-8766 URL: https://issues.apache.org/jira/browse/KAFKA-8766 Project: Kafka

Re: [DISCUSS] KIP-471: Expose RocksDB Metrics in Kafka Streams

2019-07-15 Thread Patrik Kleindl
ss to these methods from > user-space code. > > On the other hand, could we just add new metrics to access those > properties? Offhand, it's unclear to me why you said they "may not be > exposed". > > Thanks, > -John > >> On Mon, Jul 15, 2019 at 5:11 AM Patrik Kleind

Re: [DISCUSS] KIP-471: Expose RocksDB Metrics in Kafka Streams

2019-07-15 Thread Patrik Kleindl
store > > instances? > > > > > > > > > > > > > > 2) The "Hit Rates" calculation seems to be referring to the > `Hit > > Ratio` > > > > > > > (which is a percentage) than `Hit Rate`? > > > > >

Re: [VOTE] KIP-471: Expose RocksDB Metrics in Kafka Streams

2019-06-19 Thread Patrik Kleindl
+1 (non-binding) Thanks! Best regards Patrik > Am 19.06.2019 um 21:55 schrieb Bill Bejeck : > > +1 (binding) > > Thanks, > Bill > >> On Wed, Jun 19, 2019 at 1:19 PM John Roesler wrote: >> >> I'm +1 (nonbinding) >> >> Thanks! >> -John >> >>> On Tue, Jun 18, 2019 at 7:48 AM Bruno Cadonna

Re: [VOTE] KIP-464: Defaults for AdminClient#createTopic

2019-06-12 Thread Patrik Kleindl
Good idea, this will prevent a couple of headaches. Regards Patrik > Am 13.06.2019 um 00:24 schrieb Matthias J. Sax : > > We want to make a small additional change and piggy-back it to this KIP. > > To exploit the new feature of AdmintClient in KafkaStreams, we want to > update the default

Re: [DISCUSS] KIP-471: Expose RocksDB Metrics in Kafka Streams

2019-06-07 Thread Patrik Kleindl
u > should already be able to limit the memory used per rocksdb store, though > as you mention there can be a lot of them. I'm not sure you can monitor the > memory usage if you are not limiting it though. > >> On Fri, Jun 7, 2019 at 2:06 AM Patrik Kleindl wrote: >> >> Hi

Re: [DISCUSS] KIP-471: Expose RocksDB Metrics in Kafka Streams

2019-06-07 Thread Patrik Kleindl
Hi Thanks Bruno for the KIP, this is a very good idea. I have one question, are there metrics available for the memory consumption of RocksDB? As they are running outside the JVM we have run into issues because they were using all the other memory. And with multiple streams applications on the

[jira] [Resolved] (KAFKA-8093) Fix JavaDoc markup

2019-05-23 Thread Patrik Kleindl (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrik Kleindl resolved KAFKA-8093. --- Resolution: Fixed Fixed by other commits, see PR for discussion. > Fix JavaDoc mar

Re: [DISCUSS] KIP-444: Augment Metrics for Kafka Streams

2019-05-23 Thread Patrik Kleindl
Hi Guozhang Thanks for the KIP, this looks very helpful. Could you please provide more detail on the metrics planned for the state? We were just considering how to implement this ourselves because we need to track the history of stage changes. The idea was to have an accumulated "seconds in state

Re: [VOTE] 2.2.1 RC0

2019-05-13 Thread Patrik Kleindl
Hi This might be related to https://issues.apache.org/jira/browse/KAFKA-5998 at least the behaviour is described there. Regards Patrik > Am 13.05.2019 um 00:23 schrieb Vahid Hashemian : > > Hi Jonathan, > > Thanks for reporting the issue. > Do you know if it is something that's introduced

Re: [DISCUSS] KIP-456: Helper classes to make it simpler to write test logic with TopologyTestDriver

2019-05-09 Thread Patrik Kleindl
t; TestInputTopic inputTopic = > testDriver.getInputTopic(INPUT_TOPIC); > > This initialization done normally in test setup and after it can be used > with topic object: > > inputTopic.pipeInput("Hello"); > > > Or did you mean something else? > > Jukka &g

Re: [DISCUSS] KIP-456: Helper classes to make it simpler to write test logic with TopologyTestDriver

2019-05-09 Thread Patrik Kleindl
Hi Jukka Regarding your comment > If there would be a way to find out needed serders for the topic, it would make API even simpler. I was wondering if it wouldn't make more sense to have a "topic object" including the Serdes and use this instead of only passing in the name as a string everywhere.

KAFKA-8037 - KTable/GlobalKTable may restore bad data from source topic

2019-04-26 Thread Patrik Kleindl
Hello During an incident analysis it was discovered that the restoration process of state stores which are based directly on a source topic (=not a changelog topic) is not protected against undeserializable recods in the same way normal processing is with the LogAndContinueExceptionHandler.

[jira] [Resolved] (KAFKA-8200) TopologyTestDriver should offer an iterable signature of readOutput

2019-04-26 Thread Patrik Kleindl (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrik Kleindl resolved KAFKA-8200. --- Resolution: Won't Do Discarded in favor of  [https://cwiki.apache.org/confluence/display

Re: [DISCUSS] KIP-451: Make TopologyTestDriver output iterable

2019-04-26 Thread Patrik Kleindl
to discard KIP-451 in favor > of KIP-456. > > I'll also follow up on KIP-456 DISCUSS thread to get some input about > the overlap from their point of view. > > > -Matthias > > On 4/25/19 2:35 AM, Patrik Kleindl wrote: > > Hi > > > > As discussed, if the pref

Re: [DISCUSS] KIP-451: Make TopologyTestDriver output iterable

2019-04-25 Thread Patrik Kleindl
ink to > the current version of implementation and you can see if it fulfill also > your need. > > Jukka > > > la 20. huhtik. 2019 klo 1.11 Patrik Kleindl (pklei...@gmail.com) > kirjoitti: > > > Hi Matthias > > Seems I got a bit ahead of myself. > > With opt

Re: [DISCUSS] KIP-451: Make TopologyTestDriver output iterable

2019-04-19 Thread Patrik Kleindl
> Thoughts? > > In any way: whatever semantics we pick, the KIP should explain them. > Atm, this part is missing in the KIP. > > > -Matthias > > On 4/18/19 12:47 PM, Patrik Kleindl wrote: > > Hi John > > > > Thanks for your feedback > > It's C, it

[VOTE] KIP-451: Make TopologyTestDriver output iterable

2019-04-18 Thread Patrik Kleindl
Hello all, I would like to start a vote for KIP-451 which adds two methods for the TopologyTestDriver to iterate over the output. KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-451%3A+Make+TopologyTestDriver+output+iterable JIRA: https://issues.apache.org/jira/browse/KAFKA-8200 PR:

Re: [DISCUSS] KIP-451: Make TopologyTestDriver output iterable

2019-04-18 Thread Patrik Kleindl
; Specifically naming it "iterable" makes it awkward if we do want to tighten > the return type (e.g., to List) in the future. This is something we may > actually want to do, if there's an easy way to say, "assert that the output > equals [...some literal list...]". > &

Re: [DISCUSS] KIP-451: Make TopologyTestDriver output iterable

2019-04-17 Thread Patrik Kleindl
/KAFKA/KIP-456%3A+Helper+classes+to+make+it+simpler+to+write+test+logic+with+TopologyTestDriver will provide a much larger solution for the TopologyTestDriver, but is just starting the discussion. best regards Patrik On Thu, 11 Apr 2019 at 22:14, Patrik Kleindl wrote: > Hi Matthias > &g

Re: [DISCUSS] KIP-451: Make TopologyTestDriver output iterable

2019-04-11 Thread Patrik Kleindl
aybe > returning an `Iterator` would make more sense? Or a List? Note that the > order of emits matters, thus returning a generic `Collection` would not > seem to be appropriate. > > Can you elaborate on the advantages to use `Iterable` compared to the > other options? > >

Kafka KIP Wiki Page not editable with Google Chrome

2019-04-11 Thread Patrik Kleindl
Hi Does anyone else have a problem editing https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals or creating a KIP using Google Chrome (latest update, on MacOS)? The page hangs forever and only shows an error message. If I do the same in Firefox everything works like a

[DISCUSS] KIP-451: Make TopologyTestDriver output iterable

2019-04-11 Thread Patrik Kleindl
Hi everyone, I would like to start the discussion on this small enhancement of the TopologyTestDriver. https://cwiki.apache.org/confluence/display/KAFKA/KIP-451%3A+Make+TopologyTestDriver+output+iterable Pull request is available at https://github.com/apache/kafka/pull/6556 Any feedback is

Request KIP permissions

2019-04-11 Thread Patrik Kleindl
Hi Please add me (pkleindl) to the list to write a KIP Thanks in advance and best regards Patrik

[jira] [Created] (KAFKA-8024) UtilsTest.testFormatBytes fails with german locale

2019-03-01 Thread Patrik Kleindl (JIRA)
Patrik Kleindl created KAFKA-8024: - Summary: UtilsTest.testFormatBytes fails with german locale Key: KAFKA-8024 URL: https://issues.apache.org/jira/browse/KAFKA-8024 Project: Kafka Issue

[jira] [Created] (KAFKA-8023) Improve global state store restoration by using multiple update threads

2019-03-01 Thread Patrik Kleindl (JIRA)
Patrik Kleindl created KAFKA-8023: - Summary: Improve global state store restoration by using multiple update threads Key: KAFKA-8023 URL: https://issues.apache.org/jira/browse/KAFKA-8023 Project

[jira] [Created] (KAFKA-7996) KafkaStreams does not pass timeout when closing Producer

2019-02-25 Thread Patrik Kleindl (JIRA)
Patrik Kleindl created KAFKA-7996: - Summary: KafkaStreams does not pass timeout when closing Producer Key: KAFKA-7996 URL: https://issues.apache.org/jira/browse/KAFKA-7996 Project: Kafka

Re: [VOTE] KIP-258: Allow to Store Record Timestamps in RocksDB

2019-01-15 Thread Patrik Kleindl
+1 (non-binding) Thanks too Best regards Patrik > Am 16.01.2019 um 03:30 schrieb Bill Bejeck : > > Thanks for the KIP Matthias. > > +1 > > -Bill > > On Tue, Jan 15, 2019 at 7:33 PM Matthias J. Sax > wrote: > >> Hi, >> >> I would like to start the vote for KIP-258: >> >> >>

Re: [VOTE] - KIP-213 (new vote) - Simplified and revised.

2019-01-13 Thread Patrik Kleindl
+1 (non-binding) I have followed the discussion too and think this feature will be very helpful. Thanks Adam for staying on this. Best regards Patrik > Am 13.01.2019 um 19:55 schrieb Paul Whalen : > > +1 non binding. I haven't contributed at all to discussion but have > followed since Adam

Re: [VOTE] KIP-396: Add Commit/List Offsets Operations to AdminClient

2019-01-08 Thread Patrik Kleindl
+1 (non-binding) Thanks, sounds very helpful Best regards Patrik > Am 08.01.2019 um 18:10 schrieb Mickael Maison : > > Hi all, > > I'd like to start the vote on KIP-396: > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=97551484 > > Thanks

Re: [DISCUSS] KIP-258: Allow to Store Record Timestamps in RocksDB

2018-11-20 Thread Patrik Kleindl
Hi Adam Sounds great, I was already planning to ask around if anyone had tackled this. We have a use case very similar to what you described in KAFKA-4212, only with Global State Stores. I have tried a few things with the normal DSL but was not really successful. Schedule/Punctuate is not

[jira] [Created] (KAFKA-7660) Stream Metrics - Memory Analysis

2018-11-20 Thread Patrik Kleindl (JIRA)
Patrik Kleindl created KAFKA-7660: - Summary: Stream Metrics - Memory Analysis Key: KAFKA-7660 URL: https://issues.apache.org/jira/browse/KAFKA-7660 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-7332) Improve error message when trying to produce message without key for compacted topic

2018-08-23 Thread Patrik Kleindl (JIRA)
Patrik Kleindl created KAFKA-7332: - Summary: Improve error message when trying to produce message without key for compacted topic Key: KAFKA-7332 URL: https://issues.apache.org/jira/browse/KAFKA-7332

[jira] [Created] (KAFKA-7281) Fix documentation and error message regarding cleanup.policy=[compact,delete]

2018-08-13 Thread Patrik Kleindl (JIRA)
Patrik Kleindl created KAFKA-7281: - Summary: Fix documentation and error message regarding cleanup.policy=[compact,delete] Key: KAFKA-7281 URL: https://issues.apache.org/jira/browse/KAFKA-7281