Re: [VOTE] KIP-331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde

2018-07-05 Thread Richard Yu
Nice KIP! +1 (non-binding) -Richard On Friday, July 6, 2018, 9:10:43 AM GMT+8, Matthias J. Sax wrote: Thanks for the KIP! +1 (binding) -Matthias On 7/5/18 7:45 AM, Chia-Ping Tsai wrote: > hi all, > > I would like to start voting on "KIP-331 Add default implementation to >

Re: [VOTE] KIP-331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde

2018-07-05 Thread Matthias J. Sax
Thanks for the KIP! +1 (binding) -Matthias On 7/5/18 7:45 AM, Chia-Ping Tsai wrote: > hi all, > > I would like to start voting on "KIP-331 Add default implementation to > close() and configure() for Serializer, Deserializer and Serde" > >

Jenkins build is back to normal : kafka-trunk-jdk8 #2792

2018-07-05 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-326: Schedulable KTable as Graph source

2018-07-05 Thread John Roesler
Ok, I didn't get quite as far as I hoped, and several things are far from ready, but here's what I have so far: https://github.com/apache/kafka/pull/5337 The "unit" test works, and is a good example of how you should expect it to behave:

Re: [kafka-clients] [VOTE] 1.1.1 RC2

2018-07-05 Thread Ismael Juma
We need to decide if KAFKA-7136 is a blocker or not. At the moment, it's not clear to me. Ismael On Thu, 5 Jul 2018, 14:41 Dong Lin, wrote: > Thanks much for the information Ismael. It seems that the the > streams-quickstart files (link >

Re: [DISCUSS] KIP-307: Allow to define custom processor names with KStreams DSL

2018-07-05 Thread Florian Hussonnois
Hi, thank you very much for all you suggestions. I've started to update the KIP ( https://cwiki.apache.org/confluence/display/KAFKA/KIP-307%3A+Allow+to+define+custom+processor+names+with+KStreams+DSL ). Also, I propose to rename the Processed class into Described - this will be more meaningful

Re: [kafka-clients] [VOTE] 1.1.1 RC2

2018-07-05 Thread Dong Lin
Thanks much for the information Ismael. It seems that the the streams-quickstart files (link ) are uploaded on July 5 whereas the binary files (link

Jenkins build is back to normal : kafka-2.0-jdk8 #70

2018-07-05 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-0.10.2-jdk7 #225

2018-07-05 Thread Apache Jenkins Server
See -- [...truncated 1.32 MB...] org.apache.kafka.streams.processor.internals.StreamThreadTest > shouldNotViolateAtLeastOnceWhenExceptionOccursDuringCloseTopologyWhenSuspendingState

Build failed in Jenkins: kafka-0.10.1-jdk7 #139

2018-07-05 Thread Apache Jenkins Server
See -- [...truncated 589.36 KB...] org.apache.kafka.streams.processor.internals.StreamsMetadataStateTest > shouldReturnNullOnGetWithKeyWhenStoreDoesntExist PASSED

[jira] [Created] (KAFKA-7136) PushHttpMetricsReporter may deadlock when processing metrics changes

2018-07-05 Thread Rajini Sivaram (JIRA)
Rajini Sivaram created KAFKA-7136: - Summary: PushHttpMetricsReporter may deadlock when processing metrics changes Key: KAFKA-7136 URL: https://issues.apache.org/jira/browse/KAFKA-7136 Project: Kafka

Build failed in Jenkins: kafka-0.11.0-jdk7 #392

2018-07-05 Thread Apache Jenkins Server
See -- [...truncated 1.55 MB...] org.apache.kafka.streams.integration.EosIntegrationTest > shouldNotViolateEosIfOneTaskGetsFencedUsingIsolatedAppInstances STARTED

Build failed in Jenkins: kafka-1.0-jdk7 #216

2018-07-05 Thread Apache Jenkins Server
See -- [...truncated 376.16 KB...] kafka.server.epoch.LeaderEpochFileCacheTest > shouldRetainLatestEpochOnClearAllEarliest PASSED kafka.server.epoch.LeaderEpochFileCacheTest >

Build failed in Jenkins: kafka-trunk-jdk8 #2791

2018-07-05 Thread Apache Jenkins Server
See Changes: [github] MINOR: Avoid conflicting versions of org.apache.mina for MiniKdc deps -- [...truncated 871.62 KB...] kafka.utils.ShutdownableThreadTest >

Jenkins build is back to normal : kafka-trunk-jdk10 #276

2018-07-05 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-334 Include partitions in exceptions raised during consumer record deserialization/validation

2018-07-05 Thread Ismael Juma
Yes, the Scala consumers have been removed in 2.0.0, which simplifies some of this. The following commit was an initial step in unifying the exception handling: https://github.com/apache/kafka/commit/96bcfdfc7c9aac075635b2034e65e412a725672e But more can be done as you mentioned. Ismael On 5

Re: [kafka-clients] [VOTE] 1.1.1 RC2

2018-07-05 Thread Ismael Juma
Thanks Dong. There are a couple of quickstart links below: https://repository.apache.org/content/groups/staging/org/apache/kafka/ Ismael On Thu, Jul 5, 2018 at 10:32 AM Dong Lin wrote: > Hey everyone, > > Thanks for the vote! Sorry for late reply. I have been trying to understand > whether

Re: [kafka-clients] [VOTE] 1.1.1 RC2

2018-07-05 Thread Dong Lin
Hey everyone, Thanks for the vote! Sorry for late reply. I have been trying to understand whether streams-quickstart is required for release and how to fix the issue. I have limited availability to fix this issue in the past few days. It seems that all contents to be verified (e.g. source file,

[jira] [Created] (KAFKA-7135) Unable to mock schema registry while unit testing streams topology

2018-07-05 Thread Salazar (JIRA)
Salazar created KAFKA-7135: -- Summary: Unable to mock schema registry while unit testing streams topology Key: KAFKA-7135 URL: https://issues.apache.org/jira/browse/KAFKA-7135 Project: Kafka Issue

Re: [DISCUSS] KIP-334 Include partitions in exceptions raised during consumer record deserialization/validation

2018-07-05 Thread Stanislav Kozlovski
Hey Ismael, It is only slightly related - my PR would attach two new attributes and also touch upon deserialization exceptions. But this PR did provide me with some insight: Maybe the best approach would be to make `InvalidRecordException` a public exception instead of introducing a new one - I

Re: [VOTE] #2 KIP-248: Create New ConfigCommand That Uses The New AdminClient

2018-07-05 Thread Rajini Sivaram
Hi Magnus, Thanks for pointing that out. I haven't been keeping up-to-date with all the changes and I have no idea how we got here. I had requested the change to use SET/ADD/DELETE way back in February (

[DISCUSS] KIP-333 Add faster mode of rebalancing.

2018-07-05 Thread Richard Yu
Hi all, I would like to discuss the KIP that I had written recently. Here is the link:KIP-333: Add faster mode of rebalancing - Apache Kafka - Apache Software Foundation | | | | | | | | | | | KIP-333: Add faster mode of rebalancing - Apache Kafka - Apache Software... | | |

Re: [DISCUSS] KIP-334 Include partitions in exceptions raised during consumer record deserialization/validation

2018-07-05 Thread Ismael Juma
Thanks for the KIP, Stanislav. The following PR looks related: https://github.com/apache/kafka/pull/4093/files Ismael On Thu, Jul 5, 2018 at 8:44 AM Stanislav Kozlovski wrote: > Hey everybody, > > I just created a new KIP about exposing more information in exceptions > caused by consumer

[DISCUSS] KIP-334 Include partitions in exceptions raised during consumer record deserialization/validation

2018-07-05 Thread Stanislav Kozlovski
Hey everybody, I just created a new KIP about exposing more information in exceptions caused by consumer record deserialization/validation. Please have a look at it, it is a very short page. I am working under the assumption that all invalid record or deserialization exceptions in the consumer

[VOTE] KIP-331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde

2018-07-05 Thread Chia-Ping Tsai
hi all, I would like to start voting on "KIP-331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde"

Re: [DISCUSS] KIP-326: Schedulable KTable as Graph source

2018-07-05 Thread John Roesler
Hey Flávio, Thanks! I haven't got anything usable yet, but I'm working on it now. I'm hoping to push up my branch by the end of the day. I don't know if you've seen it but Streams actually already has something like this, in the form of caching on materialized stores. If you pass in a

Re: Builder Pattern for kafka-clients in 2.x ?

2018-07-05 Thread Thomas Becker
Personally, I like the idea of builders for the producer/consumer themselves, but I'm less enthusiastic about one for ProducerRecord. Mostly because I think the following is overly verbose/reads poorly: producer.send(ProducerRecord.builder() .topic("mytopic") .key("Key")

[DISCUSS] KIP-333 Consider a faster form of rebalancing

2018-07-05 Thread Richard Yu
Hi all, I would like to discuss KIP-333 (which proposes a faster mode of rebalancing). Here is the link for the KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-333%3A+Add+faster+mode+of+rebalancing Thanks, Richard Yu

[DISCUSS] KIP-333 Consider adding faster form of rebalancing

2018-07-05 Thread Richard Yu
Hi all, I would like to discuss the KIP that I had written recently. Here is the link:KIP-333: Add faster mode of rebalancing - Apache Kafka - Apache Software Foundation | | | | | | | | | | | KIP-333: Add faster mode of rebalancing - Apache Kafka - Apache Software... | | |

RE: [kafka-clients] [VOTE] 1.1.1 RC2

2018-07-05 Thread Skrzypek, Jonathan
Hi, Will this RC go ahead or should a RC3 be put together ? -Original Message- From: Matthias J. Sax [mailto:matth...@confluent.io] Sent: 30 June 2018 06:13 To: Rajini Sivaram; Users Cc: Dong Lin; dev; kafka-clients Subject: Re: [kafka-clients] [VOTE] 1.1.1 RC2 Hi Dong, it seems that

[jira] [Created] (KAFKA-7134) KafkaLog4jAppender - Appender exceptions are propagated to caller

2018-07-05 Thread venkata praveen (JIRA)
venkata praveen created KAFKA-7134: -- Summary: KafkaLog4jAppender - Appender exceptions are propagated to caller Key: KAFKA-7134 URL: https://issues.apache.org/jira/browse/KAFKA-7134 Project: Kafka