[jira] [Commented] (IGNITE-19578) Decrease count of lease messages to meta storage
[ https://issues.apache.org/jira/browse/IGNITE-19578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17727080#comment-17727080 ] Alexander Lapin commented on IGNITE-19578: -- PD was disabled by removing from within IgniteImpl. See https://github.com/apache/ignite-3/pull/2113 for the details. > Decrease count of lease messages to meta storage > > > Key: IGNITE-19578 > URL: https://issues.apache.org/jira/browse/IGNITE-19578 > Project: Ignite > Issue Type: Improvement >Reporter: Denis Chudov >Priority: Major > Labels: ignite-3 > Time Spent: 20m > Remaining Estimate: 0h > > *Motivation* > Huge number of lease messages cause serious load on meta storage, which > impacts the performance of a cluster overall. Each lease message contains > prefix + group name as a key, and the value contains leaseholder name, left > and right timestamp and couple of boolean flags. > Many leases share the same leaseholder. Also, many leases share the same > right border, as batch of leases are renewed on every iteration of lease > updater and get the same right border. > So, the compacted data structure for all leases could be a map > {code:java} > right border -> set of leaseholders -> set of leases which contain only group > name, left border and flags.{code} > It is important that this data structure is applicable to meta storage > representation, in-memory representation of leases should remain the same. > *Definition of done* > Count of meta storage invokes from lease updater is significantly reduced. > *Implementation notes* > The key should be prefix + right border. On each iteration the corresponding > right border should be removed and new one put, so on each iteration there > will be done just one meta storage invoke. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (IGNITE-19578) Decrease count of lease messages to meta storage
[ https://issues.apache.org/jira/browse/IGNITE-19578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17731490#comment-17731490 ] Denis Chudov commented on IGNITE-19578: --- For now this ticket is blocked by https://issues.apache.org/jira/browse/IGNITE-19700 > Decrease count of lease messages to meta storage > > > Key: IGNITE-19578 > URL: https://issues.apache.org/jira/browse/IGNITE-19578 > Project: Ignite > Issue Type: Improvement >Reporter: Denis Chudov >Assignee: Denis Chudov >Priority: Major > Labels: ignite-3 > Time Spent: 20m > Remaining Estimate: 0h > > *Motivation* > Huge number of lease messages cause serious load on meta storage, which > impacts the performance of a cluster overall. Each lease message contains > prefix + group name as a key, and the value contains leaseholder name, left > and right timestamp and couple of boolean flags. > Many leases share the same leaseholder. Also, many leases share the same > right border, as batch of leases are renewed on every iteration of lease > updater and get the same right border. > So, the compacted data structure for all leases could be a map > {code:java} > right border -> set of leaseholders -> set of leases which contain only group > name, left border and flags.{code} > It is important that this data structure is applicable to meta storage > representation, in-memory representation of leases should remain the same. > *Definition of done* > Count of meta storage invokes from lease updater is significantly reduced. > *Implementation notes* > The key should be prefix + right border. On each iteration the corresponding > right border should be removed and new one put, so on each iteration there > will be done just one meta storage invoke. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (IGNITE-19578) Decrease count of lease messages to meta storage
[ https://issues.apache.org/jira/browse/IGNITE-19578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17740574#comment-17740574 ] Vladislav Pyatkov commented on IGNITE-19578: LGTM > Decrease count of lease messages to meta storage > > > Key: IGNITE-19578 > URL: https://issues.apache.org/jira/browse/IGNITE-19578 > Project: Ignite > Issue Type: Improvement >Reporter: Denis Chudov >Assignee: Denis Chudov >Priority: Major > Labels: ignite-3 > Time Spent: 2h 10m > Remaining Estimate: 0h > > *Motivation* > Huge number of lease messages cause serious load on meta storage, which > impacts the performance of a cluster overall. Leases can be sent as single > message to meta storage and then the size of this message can be reduced as > described in IGNITE-19819. > *Definition of done* > Count of meta storage invokes from lease updater is significantly reduced. > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (IGNITE-19578) Decrease count of lease messages to meta storage
[ https://issues.apache.org/jira/browse/IGNITE-19578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17740576#comment-17740576 ] Vladislav Pyatkov commented on IGNITE-19578: Thank you for the contribution Merged 8586df07f81460c5e89846fa2fc7cb3eaaa3b6b6 > Decrease count of lease messages to meta storage > > > Key: IGNITE-19578 > URL: https://issues.apache.org/jira/browse/IGNITE-19578 > Project: Ignite > Issue Type: Improvement >Reporter: Denis Chudov >Assignee: Denis Chudov >Priority: Major > Labels: ignite-3 > Time Spent: 2h 20m > Remaining Estimate: 0h > > *Motivation* > Huge number of lease messages cause serious load on meta storage, which > impacts the performance of a cluster overall. Leases can be sent as single > message to meta storage and then the size of this message can be reduced as > described in IGNITE-19819. > *Definition of done* > Count of meta storage invokes from lease updater is significantly reduced. > -- This message was sent by Atlassian Jira (v8.20.10#820010)