Re: Permission to create KIP

2018-07-31 Thread Ratish Ravindran
https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals When tried to click on Create KIP , got [image: Screen Shot 2018-08-01 at 10.25.35 AM.png] Thanks, Ratish On Wed, Aug

Build failed in Jenkins: kafka-2.0-jdk8 #96

2018-07-31 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-7192: Wipe out if EOS is turned on and checkpoint file does not [wangguoz] KAFKA-7192 Follow-up: update checkpoint to the reset beginning offset

Build failed in Jenkins: kafka-2.0-jdk8 #95

2018-07-31 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H32 (ubuntu xenial) in workspace >

Request for Create KIP permission

2018-07-31 Thread Xiongqi Wu
Hi, This is Xiongqi (Wesley) Wu from Linkedin Kafka dev team. I want to request permission to Create KIP for the log compaction project we are currently working on here at Linkedin. My wiki id is : xiongqiwu --Xiongqi (Wesley) Wu

Re: Request for contributor permissions

2018-07-31 Thread Matthias J. Sax
Added you to the list on contributors in Jira. Also granted write access to the wiki for user `simonc6r` -- "Simon Clark" returned two users -- hope I picked the right one. -Matthias On 7/31/18 3:15 AM, Simon Clark wrote: > JIRA ID: simonc6r > Cwiki ID: Simon Clark > > Thanks in advance! >

Re: Permission to create KIP

2018-07-31 Thread Matthias J. Sax
What is your Wiki ID? -Matthias On 7/30/18 8:55 PM, Ratish Ravindran wrote: > Hi, > > I am trying to create a KIP, but I don't access to do so. Can anyone > provide me with the access ? > > Thanks, > Ratish > signature.asc Description: OpenPGP digital signature

Re: [Vote] KIP-321: Update TopologyDescription to better represent Source and Sink Nodes

2018-07-31 Thread Ewen Cheslack-Postava
Generally +1 (binding) It would be helpful to just provide the full, updated interfaces in the KIP and mark things as new with comments if needed. I had to go back and read the discussion thread to make sure I was understanding the intent correctly. Damian -- if we make that Optional, shouldn't

Re: [DISCUSS] KIP-345: Reduce multiple consumer rebalances by specifying member id

2018-07-31 Thread John Roesler
Hi Boyang, Overall, this seems like a good addition to the consumer. I agree with the others that we should attempt to validate the uniqueness of member.id usage. FWIW, Jason's idea of using a configured logical id + assigned unique id seems to be suitably flexible and free of assumptions, as

Build failed in Jenkins: kafka-trunk-jdk8 #2849

2018-07-31 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-7027: Add overloaded build method to StreamsBuilder (#5437) -- [...truncated 429.08 KB...] kafka.utils.SchedulerTest >

Jenkins build is back to normal : kafka-trunk-jdk10 #345

2018-07-31 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-7224) KIP-328: Add spill-to-disk for Suppression

2018-07-31 Thread John Roesler (JIRA)
John Roesler created KAFKA-7224: --- Summary: KIP-328: Add spill-to-disk for Suppression Key: KAFKA-7224 URL: https://issues.apache.org/jira/browse/KAFKA-7224 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-7223) KIP-328: Add in-memory Suppression

2018-07-31 Thread John Roesler (JIRA)
John Roesler created KAFKA-7223: --- Summary: KIP-328: Add in-memory Suppression Key: KAFKA-7223 URL: https://issues.apache.org/jira/browse/KAFKA-7223 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-7222) KIP-328: Add Window Grace Period (and deprecate Window Retention)

2018-07-31 Thread John Roesler (JIRA)
John Roesler created KAFKA-7222: --- Summary: KIP-328: Add Window Grace Period (and deprecate Window Retention) Key: KAFKA-7222 URL: https://issues.apache.org/jira/browse/KAFKA-7222 Project: Kafka

Re: [DISCUSS] KIP-346 - Limit blast radius of log compaction failure

2018-07-31 Thread Ray Chiang
I had one question that I was trying to do some investigation before I asked, but I'm having some issues with my JMX browser right now. * For the uncleanable-partitions-count metric, is that going to be per-logDir entry? * For max.uncleanable.partitions, is the intention to have -1 be

Build failed in Jenkins: kafka-trunk-jdk8 #2848

2018-07-31 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H32 (ubuntu xenial) in workspace

Re: [DISCUSS] KIP-346 - Limit blast radius of log compaction failure

2018-07-31 Thread Stanislav Kozlovski
Hey group, I am planning on starting a voting thread tomorrow. Please do reply if you feel there is anything left to discuss. Best, Stanislav On Fri, Jul 27, 2018 at 11:05 PM Stanislav Kozlovski wrote: > Hey, Ray > > Thanks for pointing that out, it's fixed now > > Best, > Stanislav > > On

Re: [DISCUSS] KIP-320: Allow fetchers to detect and handle log truncation

2018-07-31 Thread Dong Lin
Hey Jason, Thanks for your reply. I will comment below. Regarding 1, we probably can not simply rename both to `LeaderEpoch` because we already have a LeaderEpoch field in OffsetsForLeaderEpoch. Regarding 5, I am not strong on this. I agree with the two benefits of having two error codes: 1)

[jira] [Resolved] (KAFKA-7221) Add Build method to StreamsBuilder accepting Properties

2018-07-31 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck resolved KAFKA-7221. Resolution: Fixed Duplicated by KAFKA-7027 > Add Build method to StreamsBuilder accepting

[jira] [Created] (KAFKA-7221) Add Build method to StreamsBuilder accepting Properties

2018-07-31 Thread Bill Bejeck (JIRA)
Bill Bejeck created KAFKA-7221: -- Summary: Add Build method to StreamsBuilder accepting Properties Key: KAFKA-7221 URL: https://issues.apache.org/jira/browse/KAFKA-7221 Project: Kafka Issue

[jira] [Created] (KAFKA-7220) Kafka could use RollingFileAppender instead of DailyRollingFileAppender

2018-07-31 Thread Swathi Mocharla (JIRA)
Swathi Mocharla created KAFKA-7220: -- Summary: Kafka could use RollingFileAppender instead of DailyRollingFileAppender Key: KAFKA-7220 URL: https://issues.apache.org/jira/browse/KAFKA-7220 Project:

Re: [DISCUSSION] KIP-336: Consolidate ExtendedSerializer/Serializer and ExtendedDeserializer/Deserializer

2018-07-31 Thread Chia-Ping Tsai
Bumping up! On 2018/07/09 08:50:07, Viktor Somogyi wrote: > Hi folks, > > I've published KIP-336 which is about consolidating the > Serializer/Deserializer interfaces. > > Basically the story here is when ExtendedSerializer and > ExtendedDeserializer were added we still supported Java 7 and

Request for contributor permissions

2018-07-31 Thread Simon Clark
JIRA ID: simonc6r Cwiki ID: Simon Clark Thanks in advance!

Re: [DISCUSS] KIP-334 Include partitions in exceptions raised during consumer record deserialization/validation

2018-07-31 Thread Stanislav Kozlovski
Hey Jason, Just to make sure I understood you right - you propose not exposing any new exception types but rather the interface itself only? So a sample code dealing with this would be something like: try { // ... } catch (KafkaException e) { if (e instanceof UnconsumableRecordException)

[DISCUSS] KIP-348 Eliminate null from SourceTask#poll()

2018-07-31 Thread Chia-Ping Tsai
hi all, Please take a look at the KIP-348[1] if you have free cycel. It bring a little change to the usage of SourceTask#poll() [1] https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=89065853=true#KIP-348EliminatenullfromSourceTask#poll()-Status Cheers, Chia-Ping

[jira] [Created] (KAFKA-7219) Add topic/partition level metrics.

2018-07-31 Thread Satish Duggana (JIRA)
Satish Duggana created KAFKA-7219: - Summary: Add topic/partition level metrics. Key: KAFKA-7219 URL: https://issues.apache.org/jira/browse/KAFKA-7219 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-7218) Log thread names & ids when KafkaConsumer throws ConcurrentModificationException

2018-07-31 Thread Kevin Lu (JIRA)
Kevin Lu created KAFKA-7218: --- Summary: Log thread names & ids when KafkaConsumer throws ConcurrentModificationException Key: KAFKA-7218 URL: https://issues.apache.org/jira/browse/KAFKA-7218 Project: Kafka

Re: [Vote] KIP-321: Update TopologyDescription to better represent Source and Sink Nodes

2018-07-31 Thread Damian Guy
Hi Nishanth, I have one nit on the KIP. I think the topicNameExtractor method should return Optional rather than null. Sorry I'm late here. Thanks, Damian On Tue, 31 Jul 2018 at 01:14 Nishanth Pradeep wrote: > We need one more binding vote. > > Binding Votes: > >- Matthias J. Sax >-