Build failed in Jenkins: kafka-trunk-jdk10 #208

2018-06-13 Thread Apache Jenkins Server
See Changes: [github] MINOR: Replace test usages of ClientUtils.fetchTopicMetadata with -- [...truncated 1.58 MB...] kafka.zk.KafkaZkClientTest > testAclManagementMethods

Build failed in Jenkins: kafka-trunk-jdk8 #2732

2018-06-13 Thread Apache Jenkins Server
See Changes: [github] KAFKA-7050; Decrease default consumer request timeout to 30s (#5203) [github] MINOR: Replace test usages of ClientUtils.fetchTopicMetadata with -- [

Re: [DISCUSS] KIP-291: Have separate queues for control requests and data requests

2018-06-13 Thread Lucas Wang
Hi Ted, Thanks for taking a look at this KIP. Let's say today the setting of "queued.max.requests" in cluster A is 1000, while the setting in cluster B is 100,000. The 100 times difference might have indicated that machines in cluster B have larger memory. By reusing the "queued.max.requests", th

[jira] [Resolved] (KAFKA-3355) GetOffsetShell command doesn't work with SASL enabled Kafka

2018-06-13 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-3355. Resolution: Duplicate Fix Version/s: (was: 2.1.0) This will be done as part of KAFKA-523

[jira] [Resolved] (KAFKA-5234) GetOffsetShell: retrieve offsets for multiple topics with single request

2018-06-13 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-5234. Resolution: Duplicate Let's consolidate GetOffsetShell improvements under KAFKA-5235. > GetOffsetS

Build failed in Jenkins: kafka-2.0-jdk8 #25

2018-06-13 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-7050; Decrease default consumer request timeout to 30s (#5203) -- [...truncated 481.82 KB...] kafka.javaapi.message.ByteBufferMessageSetTest > test

Jenkins build is back to normal : kafka-2.0-jdk8 #24

2018-06-13 Thread Apache Jenkins Server
See

Re: Are defaults serde in Kafka streams doing more harm then good ?

2018-06-13 Thread Stephane Maarek
Thanks Matthias and Guozhang 1) regarding having json protobuf or avro across the entire topology this makes sense. I still wish the builder could take a 'defaultSerde' for value and keys to make types explicit throughout the topology vs a class as string in a properties. That might also help with

Build failed in Jenkins: kafka-trunk-jdk10 #207

2018-06-13 Thread Apache Jenkins Server
See Changes: [github] KAFKA-7050; Decrease default consumer request timeout to 30s (#5203) -- [...truncated 2.01 MB...] org.apache.kafka.streams.kstream.internals.KStreamG

Build failed in Jenkins: kafka-1.1-jdk7 #144

2018-06-13 Thread Apache Jenkins Server
See Changes: [matthias] KAFKA-6749: Fixed TopologyTestDriver to process stream processing [ismael] MINOR: Upgrade Jackson to 2.9.6 [matthias] KAFKA-6860: Fix NPE in Kafka Streams with EOS enabled (#5187)

Re: [DISCUSS] KIP-110: Add Codec for ZStandard Compression (Updated)

2018-06-13 Thread Dongjin Lee
Ismael, Oh, I forgot all of you are on working frenzy for 2.0! No problem, take your time. I am also working at another issue now. Thank you for letting me know. Best, Dongjin On Wed, Jun 13, 2018, 11:44 PM Ismael Juma wrote: > Sorry for the delay Dongjin. Everyone is busy finalising 2.0.0. Th

Build failed in Jenkins: kafka-1.0-jdk7 #201

2018-06-13 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Upgrade Jackson to 2.9.6 -- [...truncated 373.70 KB...] kafka.server.epoch.LeaderEpochFileCacheTest > shouldRetainLatestEpochOnClearAllEarliest

[jira] [Resolved] (KAFKA-7050) Decrease consumer request timeout to 30s

2018-06-13 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-7050. Resolution: Fixed > Decrease consumer request timeout to 30s >

Build failed in Jenkins: kafka-2.0-jdk8 #23

2018-06-13 Thread Apache Jenkins Server
See Changes: [matthias] MINOR: code cleanup follow up for KAFKA-6906 (#5196) [matthias] KAFKA-6749: Fixed TopologyTestDriver to process stream processing [ismael] MINOR: Upgrade Jackson to 2.9.6 --

Re: [DISCUSS] KIP-291: Have separate queues for control requests and data requests

2018-06-13 Thread Ted Yu
Lucas: Under Rejected Alternatives, #2, can you elaborate a bit more on why the separate config has bigger impact ? Thanks On Wed, Jun 13, 2018 at 2:00 PM, Dong Lin wrote: > Hey Luca, > > Thanks for the KIP. Looks good overall. Some comments below: > > - We usually specify the full mbean for th

Re: [DISCUSS] KIP-291: Have separate queues for control requests and data requests

2018-06-13 Thread Lucas Wang
Thanks for the comments, Dong. I've updated the KIP and addressed your 3 comments. Please take another look when you get a chance. Lucas On Wed, Jun 13, 2018 at 2:00 PM, Dong Lin wrote: > Hey Luca, > > Thanks for the KIP. Looks good overall. Some comments below: > > - We usually specify the fu

Jenkins build is back to normal : kafka-trunk-jdk8 #2730

2018-06-13 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-291: Have separate queues for control requests and data requests

2018-06-13 Thread Dong Lin
Hey Luca, Thanks for the KIP. Looks good overall. Some comments below: - We usually specify the full mbean for the new metrics in the KIP. Can you specify it in the Public Interface section similar to KIP-237

[DISCUSS] KIP-291: Have separate queues for control requests and data requests

2018-06-13 Thread Lucas Wang
Hi Kafka experts, I created KIP-291 to add a separate queue for controller requests: https://cwiki.apache.org/confluence/display/KAFKA/KIP-291%3A+Have+separate+queues+for+control+requests+and+data+requests Can you please take a look and let me know your feedback? Thanks a lot for your time! Rega

[jira] [Created] (KAFKA-7056) Connect's new numeric converters should be in a different package

2018-06-13 Thread Randall Hauch (JIRA)
Randall Hauch created KAFKA-7056: Summary: Connect's new numeric converters should be in a different package Key: KAFKA-7056 URL: https://issues.apache.org/jira/browse/KAFKA-7056 Project: Kafka

Re: [DISCUSS] KIP-312: Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties

2018-06-13 Thread Guozhang Wang
Thanks for the explanation Bill. Makes sense to me. On Tue, Jun 12, 2018 at 9:21 AM, Bill Bejeck wrote: > > Since there're only two values for the optional optimization config > > introduced by KAFKA-6935, I wonder the overloaded build method (with > Properties > > instance) would make the confi

Re: Are defaults serde in Kafka streams doing more harm then good ?

2018-06-13 Thread Guozhang Wang
Hello Stéphane, Good question :) And there have been some discussions about the default serdes in the past in the community, my two cents about this: 1) When a user tries out Streams for the first time she is likely to use some primitive typed data as her first POC app, in which case the data typ

Re: Are defaults serde in Kafka streams doing more harm then good ?

2018-06-13 Thread Matthias J. Sax
The idea of default Serde is to support generic format like Avro or Json throughout the whole topology. If everything is in Avro/Json (or similar) users don't nee to overwrite any operator level Serde. -Matthias On 6/12/18 6:32 PM, Stephane Maarek wrote: > Hi > > Coming from a user perspective,

Re: Wiki Access

2018-06-13 Thread Matthias J. Sax
Done. On 6/12/18 6:51 PM, Nishanth Pradeep wrote: > Hello, > > Could you give me access so I can create a KIP. I have been tasked with an > issue that needs a KIP. > > WIKI ID: nprad > > Let me know if you need more information. > > Thank You!

Re: Perms to create KIP

2018-06-13 Thread Guozhang Wang
Hi Mike, It's done. Cheers, Guozhang On Wed, Jun 13, 2018 at 7:02 AM, Mike Freyberger wrote: > Can I please have permission to create a KIP? > WikiID: mfreyberger > Email: mfreyber...@appnexus.com > -- -- Guozhang

Re: [DISCUSS] KIP-290: Support for wildcard suffixed ACLs

2018-06-13 Thread Andy Coates
Hi All, Just a note to say the KIP documentation has been updated inline with the current implementation. https://cwiki.apache.org/confluence/display/KAFKA/KIP-290%3A+Support+for+Prefixed+ACLs Thanks, Andy On 25 May 2018 at 17:44, Andy Coates wrote: > > Since Resource is a concrete class now

Re: [DISCUSS] KIP-110: Add Codec for ZStandard Compression (Updated)

2018-06-13 Thread Ismael Juma
Sorry for the delay Dongjin. Everyone is busy finalising 2.0.0. This KIP seems like a great candidate for 2.1.0 and hopefully there will be more of a discussion next week. :) Ismael On Wed, 13 Jun 2018, 05:17 Dongjin Lee, wrote: > Hello. I just updated my draft implementation: > > 1. Rebased to

[jira] [Created] (KAFKA-7055) Kafka Streams Processor API allows you to add sinks and processors without parent

2018-06-13 Thread Nikki Thean (JIRA)
Nikki Thean created KAFKA-7055: -- Summary: Kafka Streams Processor API allows you to add sinks and processors without parent Key: KAFKA-7055 URL: https://issues.apache.org/jira/browse/KAFKA-7055 Project:

Perms to create KIP

2018-06-13 Thread Mike Freyberger
Can I please have permission to create a KIP? WikiID: mfreyberger Email: mfreyber...@appnexus.com

Re: [DISCUSS] KIP-110: Add Codec for ZStandard Compression (Updated)

2018-06-13 Thread Dongjin Lee
Hello. I just updated my draft implementation: 1. Rebased to latest trunk (commit 5145d6b) 2. Apply ZStd 1.3.4 You can check out the implementation from here . If you experience any problem running it, don't hesitate to give me a mention. Best, Dongjin

Build failed in Jenkins: kafka-trunk-jdk8 #2729

2018-06-13 Thread Apache Jenkins Server
See Changes: [me] KAFKA-7031: Connect API shouldn't depend on Jersey (KIP-285) [me] KAFKA-7009: Suppress the Reflections log warning messages in system [github] MINOR: Remove unnecessary old consumer usage in t

Jenkins build is back to normal : kafka-trunk-jdk10 #204

2018-06-13 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-0.11.0-jdk7 #378

2018-06-13 Thread Apache Jenkins Server
See Changes: [me] KAFKA-7009: Suppress the Reflections log warning messages in system -- [...truncated 2.45 MB...] org.apache.kafka.streams.integration.EosIntegrationTest

Build failed in Jenkins: kafka-trunk-jdk10 #203

2018-06-13 Thread Apache Jenkins Server
See Changes: [me] KAFKA-7043: Modified plugin isolation whitelist with recently added -- [...truncated 1.71 MB...] kafka.consumer.ZookeeperConsumerConnectorTest > classMe

Build failed in Jenkins: kafka-0.11.0-jdk7 #377

2018-06-13 Thread Apache Jenkins Server
See Changes: [matthias] KAFKA-6906: Fixed to commit transactions if data is produced via wall -- [...truncated 903.99 KB...] kafka.producer.ProducerTest > testSendToNewTo

[jira] [Created] (KAFKA-7054) Kafka describe command should throw topic doesn't exist exception.

2018-06-13 Thread Manohar Vanam (JIRA)
Manohar Vanam created KAFKA-7054: Summary: Kafka describe command should throw topic doesn't exist exception. Key: KAFKA-7054 URL: https://issues.apache.org/jira/browse/KAFKA-7054 Project: Kafka

Build failed in Jenkins: kafka-0.10.2-jdk7 #212

2018-06-13 Thread Apache Jenkins Server
See Changes: [me] KAFKA-7009: Suppress the Reflections log warning messages in system -- [...truncated 1.31 MB...] org.apache.kafka.streams.processor.internals.StreamThrea

Jenkins build is back to normal : kafka-0.10.1-jdk7 #136

2018-06-13 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-7053) Spring Kafka SSL producers throwing TimeoutExceptions

2018-06-13 Thread Guido Josquin (JIRA)
Guido Josquin created KAFKA-7053: Summary: Spring Kafka SSL producers throwing TimeoutExceptions Key: KAFKA-7053 URL: https://issues.apache.org/jira/browse/KAFKA-7053 Project: Kafka Issue Typ

[jira] [Created] (KAFKA-7052) ExtractField SMT throws NPE - needs clearer error message

2018-06-13 Thread Robin Moffatt (JIRA)
Robin Moffatt created KAFKA-7052: Summary: ExtractField SMT throws NPE - needs clearer error message Key: KAFKA-7052 URL: https://issues.apache.org/jira/browse/KAFKA-7052 Project: Kafka Issue