[jira] [Commented] (KAFKA-10575) StateRestoreListener#onRestoreEnd should always be triggered

[ https://issues.apache.org/jira/browse/KAFKA-10575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231123#comment-17231123 ] Richard Yu commented on KAFKA-10575: Thanks for letting me know! I was already looking at

[jira] [Commented] (KAFKA-10575) StateRestoreListener#onRestoreEnd should always be triggered

[ https://issues.apache.org/jira/browse/KAFKA-10575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17228890#comment-17228890 ] Richard Yu commented on KAFKA-10575: [~guozhang] I'm interested in picking this one up. May I try my

[jira] [Comment Edited] (KAFKA-8770) Either switch to or add an option for emit-on-change

[ https://issues.apache.org/jira/browse/KAFKA-8770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17136786#comment-17136786 ] Richard Yu edited comment on KAFKA-8770 at 6/16/20, 4:25 PM: - [~gyammine] 

[jira] [Commented] (KAFKA-8770) Either switch to or add an option for emit-on-change

[ https://issues.apache.org/jira/browse/KAFKA-8770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17136786#comment-17136786 ] Richard Yu commented on KAFKA-8770: --- [~gyammine] Thanks for the comment! I apologize for the hiatus

[jira] [Commented] (KAFKA-9808) Refactor State Store Hierarchy

[ https://issues.apache.org/jira/browse/KAFKA-9808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17074752#comment-17074752 ] Richard Yu commented on KAFKA-9808: --- My assumption is that to make this refactoring more doable, we

[jira] [Updated] (KAFKA-9808) Refactor State Store Hierarchy

[ https://issues.apache.org/jira/browse/KAFKA-9808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated KAFKA-9808: -- Attachment: Current State Store Hierarchy.pdf > Refactor State Store Hierarchy >

[jira] [Created] (KAFKA-9808) Refactor State Store Hierarchy

Richard Yu created KAFKA-9808: - Summary: Refactor State Store Hierarchy Key: KAFKA-9808 URL: https://issues.apache.org/jira/browse/KAFKA-9808 Project: Kafka Issue Type: Improvement

[jira] [Commented] (KAFKA-9347) Detect deleted log directory before becoming leader

[ https://issues.apache.org/jira/browse/KAFKA-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070549#comment-17070549 ] Richard Yu commented on KAFKA-9347: --- [~hachikuji] Can I pick this one up? > Detect deleted log

[jira] [Commented] (KAFKA-9733) Consider addition of leader quorum in replication model

[ https://issues.apache.org/jira/browse/KAFKA-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064328#comment-17064328 ] Richard Yu commented on KAFKA-9733: --- [~bchen225242] Do you know how much use this has for Kafka? The

[jira] [Updated] (KAFKA-9733) Consider addition of leader quorum in replication model

[ https://issues.apache.org/jira/browse/KAFKA-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated KAFKA-9733: -- Description: Kafka's current replication model (with its single leader and several followers) is

[jira] [Updated] (KAFKA-9733) Consider addition of leader quorum in replication model

[ https://issues.apache.org/jira/browse/KAFKA-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated KAFKA-9733: -- Description: Kafka's current replication model (with its single leader and several followers) is

[jira] [Updated] (KAFKA-9733) Consider addition of leader quorum in replication model

[ https://issues.apache.org/jira/browse/KAFKA-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated KAFKA-9733: -- Description: Kafka's current replication model (with its single leader and several followers) is

[jira] [Updated] (KAFKA-9733) Consider addition of leader quorum in replication model

[ https://issues.apache.org/jira/browse/KAFKA-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated KAFKA-9733: -- Description: Kafka's current replication model (with its single leader and several followers) is

[jira] [Updated] (KAFKA-9733) Consider addition of leader quorum in replication model

[ https://issues.apache.org/jira/browse/KAFKA-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated KAFKA-9733: -- Description: Kafka's current replication model (with its single leader and several followers) is

[jira] [Updated] (KAFKA-9733) Consider addition of leader quorum in replication model

[ https://issues.apache.org/jira/browse/KAFKA-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated KAFKA-9733: -- Description: Kafka's current replication model (with its single leader and several followers) is

[jira] [Updated] (KAFKA-9733) Consider addition of leader quorum in replication model

[ https://issues.apache.org/jira/browse/KAFKA-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated KAFKA-9733: -- Summary: Consider addition of leader quorum in replication model (was: Consider addition of leader

[jira] [Updated] (KAFKA-9733) Consider addition of leader partition quorum

[ https://issues.apache.org/jira/browse/KAFKA-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated KAFKA-9733: -- Description: Note: Description still not finished. Still not sure if this is needed. Kafka's current

[jira] [Updated] (KAFKA-9733) Consider addition of leader partition quorum

[ https://issues.apache.org/jira/browse/KAFKA-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated KAFKA-9733: -- Summary: Consider addition of leader partition quorum (was: Consider addition to Kafka's replication

[jira] [Updated] (KAFKA-9733) Consider addition to Kafka's replication model

[ https://issues.apache.org/jira/browse/KAFKA-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated KAFKA-9733: -- Description: Note: Description still not finished. Still not sure if this is needed. This feature I'm

[jira] [Updated] (KAFKA-9733) Consider addition to Kafka's replication model

[ https://issues.apache.org/jira/browse/KAFKA-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated KAFKA-9733: -- Description: Note: Description still not finished. This feature I'm proposing might not offer too

[jira] [Created] (KAFKA-9733) Consider addition to Kafka's replication model

Richard Yu created KAFKA-9733: - Summary: Consider addition to Kafka's replication model Key: KAFKA-9733 URL: https://issues.apache.org/jira/browse/KAFKA-9733 Project: Kafka Issue Type: New

[jira] [Comment Edited] (KAFKA-8770) Either switch to or add an option for emit-on-change

[ https://issues.apache.org/jira/browse/KAFKA-8770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17013370#comment-17013370 ] Richard Yu edited comment on KAFKA-8770 at 1/11/20 4:23 AM: I have created a

[jira] [Commented] (KAFKA-8770) Either switch to or add an option for emit-on-change

[ https://issues.apache.org/jira/browse/KAFKA-8770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17013370#comment-17013370 ] Richard Yu commented on KAFKA-8770: --- I have created a draft KIP for this JIRA. [~xmar]  [~mjsax]

[jira] [Comment Edited] (KAFKA-8770) Either switch to or add an option for emit-on-change

[ https://issues.apache.org/jira/browse/KAFKA-8770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17013230#comment-17013230 ] Richard Yu edited comment on KAFKA-8770 at 1/10/20 10:09 PM: - [~vvcephei] 

[jira] [Commented] (KAFKA-8770) Either switch to or add an option for emit-on-change

[ https://issues.apache.org/jira/browse/KAFKA-8770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17013230#comment-17013230 ] Richard Yu commented on KAFKA-8770: --- [~vvcephei] Actually, I did think of something which might be very

[jira] [Commented] (KAFKA-8770) Either switch to or add an option for emit-on-change

[ https://issues.apache.org/jira/browse/KAFKA-8770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17007860#comment-17007860 ] Richard Yu commented on KAFKA-8770: --- [~vvcephei] It seems that loading all the prior results would be

[jira] [Issue Comment Deleted] (KAFKA-9285) Implement failed message topic to account for processing lag during failure

[ https://issues.apache.org/jira/browse/KAFKA-9285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated KAFKA-9285: -- Comment: was deleted (was: It looks like I didn't do my research. Looks like this is already fixed by

[jira] [Resolved] (KAFKA-9285) Implement failed message topic to account for processing lag during failure

[ https://issues.apache.org/jira/browse/KAFKA-9285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu resolved KAFKA-9285. --- Resolution: Fixed Already resolved by Kafka Connect. > Implement failed message topic to account

[jira] [Commented] (KAFKA-9285) Implement failed message topic to account for processing lag during failure

[ https://issues.apache.org/jira/browse/KAFKA-9285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990705#comment-16990705 ] Richard Yu commented on KAFKA-9285: --- It looks like I didn't do my research. Looks like this is already

[jira] [Updated] (KAFKA-9285) Implement failed message topic to account for processing lag during failure

[ https://issues.apache.org/jira/browse/KAFKA-9285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated KAFKA-9285: -- Labels: kip (was: ) > Implement failed message topic to account for processing lag during failure >

[jira] [Assigned] (KAFKA-9285) Implement failed message topic to account for processing lag during failure

[ https://issues.apache.org/jira/browse/KAFKA-9285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu reassigned KAFKA-9285: - Assignee: Richard Yu > Implement failed message topic to account for processing lag during

[jira] [Updated] (KAFKA-9285) Implement failed message topic to account for processing lag during failure

[ https://issues.apache.org/jira/browse/KAFKA-9285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated KAFKA-9285: -- Description: Presently, in current Kafka failure schematics, when a consumer crashes, the user is

[jira] [Commented] (KAFKA-9285) Implement failed message topic to account for processing lag during failure

[ https://issues.apache.org/jira/browse/KAFKA-9285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990303#comment-16990303 ] Richard Yu commented on KAFKA-9285: --- cc [~bchen225242] You might be interested in this. > Implement

[jira] [Created] (KAFKA-9285) Implement failed message topic to account for processing lag during failure

Richard Yu created KAFKA-9285: - Summary: Implement failed message topic to account for processing lag during failure Key: KAFKA-9285 URL: https://issues.apache.org/jira/browse/KAFKA-9285 Project: Kafka

[jira] [Commented] (KAFKA-8769) Consider computing stream time independently per key

[ https://issues.apache.org/jira/browse/KAFKA-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985408#comment-16985408 ] Richard Yu commented on KAFKA-8769: --- [~vvcephei] [~mjsax] I'm not sure if you read the KIP, but on it,

[jira] [Commented] (KAFKA-8769) Consider computing stream time independently per key

[ https://issues.apache.org/jira/browse/KAFKA-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971888#comment-16971888 ] Richard Yu commented on KAFKA-8769: --- [~vvcephei] [~mjsax] [~bbejeck] and anyone else who wishes to have

[jira] [Commented] (KAFKA-8769) Consider computing stream time independently per key

[ https://issues.apache.org/jira/browse/KAFKA-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967926#comment-16967926 ] Richard Yu commented on KAFKA-8769: --- [~vvcephei] Do you have any ideas on advancing stream time? It

[jira] [Commented] (KAFKA-8769) Consider computing stream time independently per key

[ https://issues.apache.org/jira/browse/KAFKA-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965404#comment-16965404 ] Richard Yu commented on KAFKA-8769: --- Adding on to how KIP-539 is different from KIP-424. KIP-424's sole

[jira] [Commented] (KAFKA-8769) Consider computing stream time independently per key

[ https://issues.apache.org/jira/browse/KAFKA-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965402#comment-16965402 ] Richard Yu commented on KAFKA-8769: --- Hi [~mjsax]  I wasn't aware of the suppress-contract really, so

[jira] [Comment Edited] (KAFKA-8769) Consider computing stream time independently per key

[ https://issues.apache.org/jira/browse/KAFKA-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961615#comment-16961615 ] Richard Yu edited comment on KAFKA-8769 at 10/29/19 2:39 AM: - [~vvcephei] 

[jira] [Commented] (KAFKA-8769) Consider computing stream time independently per key

[ https://issues.apache.org/jira/browse/KAFKA-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961615#comment-16961615 ] Richard Yu commented on KAFKA-8769: --- Bumping the KIP. Want to see if we can get the KIP in. > Consider

[jira] [Commented] (KAFKA-8522) Tombstones can survive forever

[ https://issues.apache.org/jira/browse/KAFKA-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959308#comment-16959308 ] Richard Yu commented on KAFKA-8522: --- Found where the tombstones are inserted. That really just answered

[jira] [Comment Edited] (KAFKA-8522) Tombstones can survive forever

[ https://issues.apache.org/jira/browse/KAFKA-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958388#comment-16958388 ] Richard Yu edited comment on KAFKA-8522 at 10/23/19 11:59 PM: -- Hi [~junrao]

[jira] [Commented] (KAFKA-8522) Tombstones can survive forever

[ https://issues.apache.org/jira/browse/KAFKA-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958388#comment-16958388 ] Richard Yu commented on KAFKA-8522: --- Hi [~junrao] [~hachikuji] Just have a question involving

[jira] [Commented] (KAFKA-8769) Consider computing stream time independently per key

[ https://issues.apache.org/jira/browse/KAFKA-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958182#comment-16958182 ] Richard Yu commented on KAFKA-8769: --- Hi all, I have updated the KIP to include an extra feature as

[jira] [Issue Comment Deleted] (KAFKA-8769) Consider computing stream time independently per key

[ https://issues.apache.org/jira/browse/KAFKA-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated KAFKA-8769: -- Comment: was deleted (was: [~vvcephei] Just a thought. Would the low traffic problem be made

[jira] [Commented] (KAFKA-8769) Consider computing stream time independently per key

[ https://issues.apache.org/jira/browse/KAFKA-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955611#comment-16955611 ] Richard Yu commented on KAFKA-8769: --- Alright, so I made a KIP for the low traffic problem here:

[jira] [Commented] (KAFKA-8769) Consider computing stream time independently per key

[ https://issues.apache.org/jira/browse/KAFKA-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955053#comment-16955053 ] Richard Yu commented on KAFKA-8769: --- [~vvcephei] Just a thought. Would the low traffic problem be made

[jira] [Updated] (KAFKA-8769) Consider computing stream time independently per key

[ https://issues.apache.org/jira/browse/KAFKA-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated KAFKA-8769: -- Labels: needs-discussion needs-kip (was: ) > Consider computing stream time independently per key >

[jira] [Commented] (KAFKA-8522) Tombstones can survive forever

[ https://issues.apache.org/jira/browse/KAFKA-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919901#comment-16919901 ] Richard Yu commented on KAFKA-8522: --- Oh, alright. I will see how things go and create a KIP then. >

[jira] [Comment Edited] (KAFKA-8522) Tombstones can survive forever

[ https://issues.apache.org/jira/browse/KAFKA-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918980#comment-16918980 ] Richard Yu edited comment on KAFKA-8522 at 8/29/19 10:06 PM: - [~junrao] I

[jira] [Commented] (KAFKA-8522) Tombstones can survive forever

[ https://issues.apache.org/jira/browse/KAFKA-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918985#comment-16918985 ] Richard Yu commented on KAFKA-8522: --- I've some thoughts to get around this. (the best approach I can

[jira] [Comment Edited] (KAFKA-8522) Tombstones can survive forever

[ https://issues.apache.org/jira/browse/KAFKA-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918980#comment-16918980 ] Richard Yu edited comment on KAFKA-8522 at 8/29/19 10:01 PM: - [~junrao] I

[jira] [Commented] (KAFKA-8522) Tombstones can survive forever

[ https://issues.apache.org/jira/browse/KAFKA-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918980#comment-16918980 ] Richard Yu commented on KAFKA-8522: --- @Jun Rao I think I've hit a caveat with your approach. The problem

[jira] [Commented] (KAFKA-8522) Tombstones can survive forever

[ https://issues.apache.org/jira/browse/KAFKA-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911942#comment-16911942 ] Richard Yu commented on KAFKA-8522: --- Alright, sounds good. > Tombstones can survive forever >

[jira] [Commented] (KAFKA-8522) Tombstones can survive forever

[ https://issues.apache.org/jira/browse/KAFKA-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909878#comment-16909878 ] Richard Yu commented on KAFKA-8522: --- So in summary, should I interpret your suggestion as creating

[jira] [Comment Edited] (KAFKA-8522) Tombstones can survive forever

[ https://issues.apache.org/jira/browse/KAFKA-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909876#comment-16909876 ] Richard Yu edited comment on KAFKA-8522 at 8/18/19 3:22 AM: The below code is

[jira] [Commented] (KAFKA-8522) Tombstones can survive forever

[ https://issues.apache.org/jira/browse/KAFKA-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909876#comment-16909876 ] Richard Yu commented on KAFKA-8522: --- The below code is located in LogManager.scala. I noticed that in

[jira] [Comment Edited] (KAFKA-8522) Tombstones can survive forever

[ https://issues.apache.org/jira/browse/KAFKA-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909866#comment-16909866 ] Richard Yu edited comment on KAFKA-8522 at 8/18/19 3:08 AM: [~junrao] Just

[jira] [Updated] (KAFKA-8770) Either switch to or add an option for emit-on-change

[ https://issues.apache.org/jira/browse/KAFKA-8770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated KAFKA-8770: -- Labels: needs-kip (was: ) > Either switch to or add an option for emit-on-change >

[jira] [Commented] (KAFKA-8522) Tombstones can survive forever

[ https://issues.apache.org/jira/browse/KAFKA-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909866#comment-16909866 ] Richard Yu commented on KAFKA-8522: --- [~junrao] Just want some clarifications on something. When

[jira] [Comment Edited] (KAFKA-8522) Tombstones can survive forever

[ https://issues.apache.org/jira/browse/KAFKA-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909866#comment-16909866 ] Richard Yu edited comment on KAFKA-8522 at 8/18/19 2:18 AM: [~junrao] Just

[jira] [Commented] (KAFKA-8806) Kafka.poll spends significant amount of time in KafkaConsumer.updateAssignmentMetadataIfNeeded

[ https://issues.apache.org/jira/browse/KAFKA-8806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909445#comment-16909445 ] Richard Yu commented on KAFKA-8806: --- [~vvcephei] Since you wrote this part of the code, your thoughts

[jira] [Comment Edited] (KAFKA-8769) Consider computing stream time independently per key

[ https://issues.apache.org/jira/browse/KAFKA-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906692#comment-16906692 ] Richard Yu edited comment on KAFKA-8769 at 8/13/19 10:50 PM: - Notably, a

[jira] [Commented] (KAFKA-8769) Consider computing stream time independently per key

[ https://issues.apache.org/jira/browse/KAFKA-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906692#comment-16906692 ] Richard Yu commented on KAFKA-8769: --- Notably, a problem with this approach is that keys which are

[jira] [Comment Edited] (KAFKA-8769) Consider computing stream time independently per key

[ https://issues.apache.org/jira/browse/KAFKA-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906674#comment-16906674 ] Richard Yu edited comment on KAFKA-8769 at 8/13/19 10:29 PM: - [~vvcephei] On

[jira] [Commented] (KAFKA-8769) Consider computing stream time independently per key

[ https://issues.apache.org/jira/browse/KAFKA-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906674#comment-16906674 ] Richard Yu commented on KAFKA-8769: --- [~vvcephei] On the issue regarding low traffic: would this

[jira] [Commented] (KAFKA-8522) Tombstones can survive forever

[ https://issues.apache.org/jira/browse/KAFKA-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905747#comment-16905747 ] Richard Yu commented on KAFKA-8522: --- [~jagsancio] any thoughts? > Tombstones can survive forever >

[jira] [Commented] (KAFKA-8522) Tombstones can survive forever

[ https://issues.apache.org/jira/browse/KAFKA-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905377#comment-16905377 ] Richard Yu commented on KAFKA-8522: --- [~junrao] A thought just occurred to me. Wouldn't we need to

[jira] [Commented] (KAFKA-8522) Tombstones can survive forever

[ https://issues.apache.org/jira/browse/KAFKA-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904814#comment-16904814 ] Richard Yu commented on KAFKA-8522: --- Okay, solved the above problem. Will start with reorganizing the

[jira] [Commented] (KAFKA-8522) Tombstones can survive forever

[ https://issues.apache.org/jira/browse/KAFKA-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902209#comment-16902209 ] Richard Yu commented on KAFKA-8522: --- [~junrao] You mentioned in a previous post that we should write to

[jira] [Commented] (KAFKA-4545) tombstone needs to be removed after delete.retention.ms has passed after it has been cleaned

[ https://issues.apache.org/jira/browse/KAFKA-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899331#comment-16899331 ] Richard Yu commented on KAFKA-4545: --- Sure, I will assign this issue to myself then. I will get around

[jira] [Updated] (KAFKA-4545) tombstone needs to be removed after delete.retention.ms has passed after it has been cleaned

[ https://issues.apache.org/jira/browse/KAFKA-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated KAFKA-4545: -- Labels: needs-kip (was: ) > tombstone needs to be removed after delete.retention.ms has passed after

[jira] [Assigned] (KAFKA-4545) tombstone needs to be removed after delete.retention.ms has passed after it has been cleaned

[ https://issues.apache.org/jira/browse/KAFKA-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu reassigned KAFKA-4545: - Assignee: Richard Yu (was: Jose Armando Garcia Sancio) > tombstone needs to be removed after

[jira] [Commented] (KAFKA-4545) tombstone needs to be removed after delete.retention.ms has passed after it has been cleaned

[ https://issues.apache.org/jira/browse/KAFKA-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16895651#comment-16895651 ] Richard Yu commented on KAFKA-4545: --- [~jagsancio]  Are you still working on this? Not too sure because

[jira] [Commented] (KAFKA-8522) Tombstones can survive forever

[ https://issues.apache.org/jira/browse/KAFKA-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16886516#comment-16886516 ] Richard Yu commented on KAFKA-8522: --- [~junrao] Would you mind if tackle this issue? > Tombstones can

[jira] [Comment Edited] (KAFKA-7711) Add a bounded flush() API to Kafka Producer

[ https://issues.apache.org/jira/browse/KAFKA-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885795#comment-16885795 ] Richard Yu edited comment on KAFKA-7711 at 7/16/19 3:01 AM: [~hachikuji] I

[jira] [Commented] (KAFKA-7711) Add a bounded flush() API to Kafka Producer

[ https://issues.apache.org/jira/browse/KAFKA-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885795#comment-16885795 ] Richard Yu commented on KAFKA-7711: --- [~hachikuji] I think I've seen this issue come up multiple times

[jira] [Commented] (KAFKA-8650) Streams does not work as expected with auto.offset.reset=none

[ https://issues.apache.org/jira/browse/KAFKA-8650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884826#comment-16884826 ] Richard Yu commented on KAFKA-8650: --- [~mjsax] Do you think this ticket is something that Kafka commuity

[jira] [Commented] (KAFKA-8658) A way to configure the jmx rmi port

[ https://issues.apache.org/jira/browse/KAFKA-8658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884810#comment-16884810 ] Richard Yu commented on KAFKA-8658: --- Alright, so here is the PR for this issue.

[jira] [Commented] (KAFKA-8369) Generate an immutable Map view for generated messages with a map key

[ https://issues.apache.org/jira/browse/KAFKA-8369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879987#comment-16879987 ] Richard Yu commented on KAFKA-8369: --- Hi [~hachikuji], I've done some research into this issue and

[jira] [Comment Edited] (KAFKA-8516) Consider allowing all replicas to have read/write permissions

[ https://issues.apache.org/jira/browse/KAFKA-8516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16860591#comment-16860591 ] Richard Yu edited comment on KAFKA-8516 at 6/11/19 6:16 AM: Well, this is

[jira] [Comment Edited] (KAFKA-8516) Consider allowing all replicas to have read/write permissions

[ https://issues.apache.org/jira/browse/KAFKA-8516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16860591#comment-16860591 ] Richard Yu edited comment on KAFKA-8516 at 6/11/19 6:15 AM: Well, this is

[jira] [Commented] (KAFKA-8516) Consider allowing all replicas to have read/write permissions

[ https://issues.apache.org/jira/browse/KAFKA-8516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16860591#comment-16860591 ] Richard Yu commented on KAFKA-8516: --- Well, this is when we start straying into an area called

[jira] [Updated] (KAFKA-8516) Consider allowing all replicas to have read/write permissions

[ https://issues.apache.org/jira/browse/KAFKA-8516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated KAFKA-8516: -- Description: Currently, in Kafka internals, a leader is responsible for all the read and write

[jira] [Updated] (KAFKA-8516) Consider allowing all replicas to have read/write permissions

[ https://issues.apache.org/jira/browse/KAFKA-8516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated KAFKA-8516: -- Description: Currently, in Kafka internals, a leader is responsible for all the read and write

[jira] [Commented] (KAFKA-8516) Consider allowing all replicas to have read/write permissions

[ https://issues.apache.org/jira/browse/KAFKA-8516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16860350#comment-16860350 ] Richard Yu commented on KAFKA-8516: --- Thanks for the heads up! Will add the link to issue. They are

[jira] [Updated] (KAFKA-8516) Consider allowing all replicas to have read/write permissions

[ https://issues.apache.org/jira/browse/KAFKA-8516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated KAFKA-8516: -- Description: Currently, in Kafka internals, a leader is responsible for all the read and write

[jira] [Created] (KAFKA-8516) Consider allowing all replicas to have read/write permissions

Richard Yu created KAFKA-8516: - Summary: Consider allowing all replicas to have read/write permissions Key: KAFKA-8516 URL: https://issues.apache.org/jira/browse/KAFKA-8516 Project: Kafka Issue

[jira] [Commented] (KAFKA-8421) Allow consumer.poll() to return data in the middle of rebalance

[ https://issues.apache.org/jira/browse/KAFKA-8421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857147#comment-16857147 ] Richard Yu commented on KAFKA-8421: --- I think that we could extend this issue to account for a poll()

[jira] [Comment Edited] (KAFKA-8421) Allow consumer.poll() to return data in the middle of rebalance

[ https://issues.apache.org/jira/browse/KAFKA-8421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857088#comment-16857088 ] Richard Yu edited comment on KAFKA-8421 at 6/5/19 11:13 PM: [~guozhang] There

[jira] [Comment Edited] (KAFKA-8421) Allow consumer.poll() to return data in the middle of rebalance

[ https://issues.apache.org/jira/browse/KAFKA-8421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857088#comment-16857088 ] Richard Yu edited comment on KAFKA-8421 at 6/5/19 9:32 PM: --- [~guozhang] There

[jira] [Comment Edited] (KAFKA-8421) Allow consumer.poll() to return data in the middle of rebalance

[ https://issues.apache.org/jira/browse/KAFKA-8421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857088#comment-16857088 ] Richard Yu edited comment on KAFKA-8421 at 6/5/19 9:32 PM: --- [~guozhang] There

[jira] [Commented] (KAFKA-8421) Allow consumer.poll() to return data in the middle of rebalance

[ https://issues.apache.org/jira/browse/KAFKA-8421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857088#comment-16857088 ] Richard Yu commented on KAFKA-8421: --- [~guozhang] There are a couple of simple approaches we could try

[jira] [Commented] (KAFKA-8438) Add API to allow user to define end behavior of consumer failure

[ https://issues.apache.org/jira/browse/KAFKA-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16856999#comment-16856999 ] Richard Yu commented on KAFKA-8438: --- Sure [~bchen225242] will look into it and see what else I could

[jira] [Commented] (KAFKA-8421) Allow consumer.poll() to return data in the middle of rebalance

[ https://issues.apache.org/jira/browse/KAFKA-8421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16853099#comment-16853099 ] Richard Yu commented on KAFKA-8421: --- A key issue here is when we stop sending the old records of a

[jira] [Commented] (KAFKA-8421) Allow consumer.poll() to return data in the middle of rebalance

[ https://issues.apache.org/jira/browse/KAFKA-8421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16852643#comment-16852643 ] Richard Yu commented on KAFKA-8421: --- Might try to take a hack at this one. It certainly is an

[jira] [Commented] (KAFKA-3539) KafkaProducer.send() may block even though it returns the Future

[ https://issues.apache.org/jira/browse/KAFKA-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16852428#comment-16852428 ] Richard Yu commented on KAFKA-3539: --- [~radai] I don't know if this problem is resolved or not. Issue

[jira] [Comment Edited] (KAFKA-8377) KTable#transformValue might lead to incorrect result in joins

[ https://issues.apache.org/jira/browse/KAFKA-8377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16851300#comment-16851300 ] Richard Yu edited comment on KAFKA-8377 at 5/30/19 10:45 PM: - cc [~mjsax] How

[jira] [Commented] (KAFKA-8328) Kafka smooth expansion

[ https://issues.apache.org/jira/browse/KAFKA-8328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16851303#comment-16851303 ] Richard Yu commented on KAFKA-8328: --- Hi [~LordChen] I believe for a change like this, since it involves

  1   2   3   4   >