[jira] [Commented] (KAFKA-10853) Replication protocol deficiencies with workloads requiring high durability guarantees

2021-03-26 Thread Kyle Ambroff-Kao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309621#comment-17309621 ] Kyle Ambroff-Kao commented on KAFKA-10853: -- We spent a lot of time discussing this internally

[jira] [Commented] (KAFKA-10853) Replication protocol deficiencies with workloads requiring high durability guarantees

2021-01-28 Thread Kyle Ambroff-Kao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17274114#comment-17274114 ] Kyle Ambroff-Kao commented on KAFKA-10853: -- I've been discussing this with my team at LinkedIn

[jira] [Commented] (KAFKA-10853) Replication protocol deficiencies with workloads requiring high durability guarantees

2020-12-16 Thread Kyle Ambroff-Kao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250598#comment-17250598 ] Kyle Ambroff-Kao commented on KAFKA-10853: -- Thanks for the reply Jun! {quote}As for your

[jira] [Comment Edited] (KAFKA-10853) Replication protocol deficiencies with workloads requiring high durability guarantees

2020-12-14 Thread Kyle Ambroff-Kao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249390#comment-17249390 ] Kyle Ambroff-Kao edited comment on KAFKA-10853 at 12/14/20, 11:20 PM:

[jira] [Commented] (KAFKA-10853) Replication protocol deficiencies with workloads requiring high durability guarantees

2020-12-14 Thread Kyle Ambroff-Kao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249390#comment-17249390 ] Kyle Ambroff-Kao commented on KAFKA-10853: -- In our deployments we have a few systems in place

[jira] [Comment Edited] (KAFKA-10853) Replication protocol deficiencies with workloads requiring high durability guarantees

2020-12-14 Thread Kyle Ambroff-Kao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249355#comment-17249355 ] Kyle Ambroff-Kao edited comment on KAFKA-10853 at 12/14/20, 10:42 PM:

[jira] [Comment Edited] (KAFKA-10853) Replication protocol deficiencies with workloads requiring high durability guarantees

2020-12-14 Thread Kyle Ambroff-Kao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249355#comment-17249355 ] Kyle Ambroff-Kao edited comment on KAFKA-10853 at 12/14/20, 10:28 PM:

[jira] [Updated] (KAFKA-10853) Replication protocol deficiencies with workloads requiring high durability guarantees

2020-12-14 Thread Kyle Ambroff-Kao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Ambroff-Kao updated KAFKA-10853: - Description: *tl;dr: The definition of ISR and the consistency model from the

[jira] [Commented] (KAFKA-10853) Replication protocol deficiencies with workloads requiring high durability guarantees

2020-12-14 Thread Kyle Ambroff-Kao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249355#comment-17249355 ] Kyle Ambroff-Kao commented on KAFKA-10853: -- Today the leader tracks a couple of different

[jira] [Updated] (KAFKA-10853) Replication protocol deficiencies with workloads requiring high durability guarantees

2020-12-14 Thread Kyle Ambroff-Kao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Ambroff-Kao updated KAFKA-10853: - Description: *tl;dr: The definition of ISR and the consistency model from the

[jira] [Updated] (KAFKA-10853) Replication protocol deficiencies with workloads requiring high durability guarantees

2020-12-14 Thread Kyle Ambroff-Kao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Ambroff-Kao updated KAFKA-10853: - Description: *tl;dr: The definition of ISR and the consistency model from the

[jira] [Created] (KAFKA-10853) Replication protocol deficiencies with workloads requiring high durability guarantees

2020-12-14 Thread Kyle Ambroff-Kao (Jira)
Kyle Ambroff-Kao created KAFKA-10853: Summary: Replication protocol deficiencies with workloads requiring high durability guarantees Key: KAFKA-10853 URL: https://issues.apache.org/jira/browse/KAFKA-10853

[jira] [Commented] (KAFKA-6468) Replication high watermark checkpoint file read for every LeaderAndIsrRequest

2020-05-05 Thread Kyle Ambroff-Kao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17100047#comment-17100047 ] Kyle Ambroff-Kao commented on KAFKA-6468: - Linking as a duplicate of KAFKA-8333, which has a

[jira] [Resolved] (KAFKA-6468) Replication high watermark checkpoint file read for every LeaderAndIsrRequest

2020-05-05 Thread Kyle Ambroff-Kao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Ambroff-Kao resolved KAFKA-6468. - Resolution: Fixed > Replication high watermark checkpoint file read for every

[jira] [Commented] (KAFKA-6569) Reflection in OffsetIndex and TimeIndex construction

2018-02-18 Thread Kyle Ambroff-Kao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368701#comment-16368701 ] Kyle Ambroff-Kao commented on KAFKA-6569: - The logger name doesn't change for anything written

[jira] [Commented] (KAFKA-6569) Reflection in OffsetIndex and TimeIndex construction

2018-02-18 Thread Kyle Ambroff-Kao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368693#comment-16368693 ] Kyle Ambroff-Kao commented on KAFKA-6569: - Submitted a PR for the patch we deployed internally.

[jira] [Created] (KAFKA-6569) Reflection in OffsetIndex and TimeIndex construction

2018-02-16 Thread Kyle Ambroff-Kao (JIRA)
Kyle Ambroff-Kao created KAFKA-6569: --- Summary: Reflection in OffsetIndex and TimeIndex construction Key: KAFKA-6569 URL: https://issues.apache.org/jira/browse/KAFKA-6569 Project: Kafka

[jira] [Commented] (KAFKA-6469) ISR change notification queue can prevent controller from making progress

2018-02-07 Thread Kyle Ambroff-Kao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16355829#comment-16355829 ] Kyle Ambroff-Kao commented on KAFKA-6469: - [~junrao] The number of children of

[jira] [Commented] (KAFKA-6469) ISR change notification queue can prevent controller from making progress

2018-02-07 Thread Kyle Ambroff-Kao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16355828#comment-16355828 ] Kyle Ambroff-Kao commented on KAFKA-6469: - Heh, yeah James, we don't typically run clusters like

[jira] [Updated] (KAFKA-6469) ISR change notification queue can prevent controller from making progress

2018-01-22 Thread Kyle Ambroff-Kao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Ambroff-Kao updated KAFKA-6469: Description: When the writes /isr_change_notification in ZooKeeper (which is effectively a

[jira] [Assigned] (KAFKA-6468) Replication high watermark checkpoint file read for every LeaderAndIsrRequest

2018-01-22 Thread Kyle Ambroff-Kao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Ambroff-Kao reassigned KAFKA-6468: --- Assignee: Kyle Ambroff-Kao > Replication high watermark checkpoint file read for

[jira] [Assigned] (KAFKA-6469) ISR change notification queue can prevent controller from making progress

2018-01-22 Thread Kyle Ambroff-Kao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Ambroff-Kao reassigned KAFKA-6469: --- Assignee: Kyle Ambroff-Kao > ISR change notification queue can prevent controller

[jira] [Updated] (KAFKA-6469) ISR change notification queue can prevent controller from making progress

2018-01-22 Thread Kyle Ambroff-Kao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Ambroff-Kao updated KAFKA-6469: Description: When the writes /isr_change_notification in ZooKeeper (which is effectively a

[jira] [Commented] (KAFKA-6469) ISR change notification queue can prevent controller from making progress

2018-01-22 Thread Kyle Ambroff-Kao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335368#comment-16335368 ] Kyle Ambroff-Kao commented on KAFKA-6469: - It's worth noting that there are other possible

[jira] [Updated] (KAFKA-6469) ISR change notification queue can prevent controller from making progress

2018-01-22 Thread Kyle Ambroff-Kao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Ambroff-Kao updated KAFKA-6469: Description: When the writes /isr_change_notification in ZooKeeper (which is effectively a

[jira] [Updated] (KAFKA-6469) ISR change notification queue can prevent controller from making progress

2018-01-22 Thread Kyle Ambroff-Kao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Ambroff-Kao updated KAFKA-6469: Summary: ISR change notification queue can prevent controller from making progress (was:

[jira] [Commented] (KAFKA-6469) ISR change notification queue has a maximum size

2018-01-22 Thread Kyle Ambroff-Kao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335351#comment-16335351 ] Kyle Ambroff-Kao commented on KAFKA-6469: - I'm going to work on a patch for this. > ISR change

[jira] [Commented] (KAFKA-6468) Replication high watermark checkpoint file read for every LeaderAndIsrRequest

2018-01-22 Thread Kyle Ambroff-Kao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335350#comment-16335350 ] Kyle Ambroff-Kao commented on KAFKA-6468: - I'll have a patch ready for this shortly. >

[jira] [Created] (KAFKA-6469) ISR change notification queue has a maximum size

2018-01-22 Thread Kyle Ambroff-Kao (JIRA)
Kyle Ambroff-Kao created KAFKA-6469: --- Summary: ISR change notification queue has a maximum size Key: KAFKA-6469 URL: https://issues.apache.org/jira/browse/KAFKA-6469 Project: Kafka Issue

[jira] [Created] (KAFKA-6468) Replication high watermark checkpoint file read for every LeaderAndIsrRequest

2018-01-22 Thread Kyle Ambroff-Kao (JIRA)
Kyle Ambroff-Kao created KAFKA-6468: --- Summary: Replication high watermark checkpoint file read for every LeaderAndIsrRequest Key: KAFKA-6468 URL: https://issues.apache.org/jira/browse/KAFKA-6468