[jira] [Commented] (IGNITE-19578) Decrease count of lease messages to meta storage
[
https://issues.apache.org/jira/browse/IGNITE-19578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17727080#comment-17727080
]
Alexander Lapin commented on IGNITE-19578:
--
PD was disabled by removing from within IgniteImpl. See
https://github.com/apache/ignite-3/pull/2113 for the details.
> Decrease count of lease messages to meta storage
>
>
> Key: IGNITE-19578
> URL: https://issues.apache.org/jira/browse/IGNITE-19578
> Project: Ignite
> Issue Type: Improvement
>Reporter: Denis Chudov
>Priority: Major
> Labels: ignite-3
> Time Spent: 20m
> Remaining Estimate: 0h
>
> *Motivation*
> Huge number of lease messages cause serious load on meta storage, which
> impacts the performance of a cluster overall. Each lease message contains
> prefix + group name as a key, and the value contains leaseholder name, left
> and right timestamp and couple of boolean flags.
> Many leases share the same leaseholder. Also, many leases share the same
> right border, as batch of leases are renewed on every iteration of lease
> updater and get the same right border.
> So, the compacted data structure for all leases could be a map
> {code:java}
> right border -> set of leaseholders -> set of leases which contain only group
> name, left border and flags.{code}
> It is important that this data structure is applicable to meta storage
> representation, in-memory representation of leases should remain the same.
> *Definition of done*
> Count of meta storage invokes from lease updater is significantly reduced.
> *Implementation notes*
> The key should be prefix + right border. On each iteration the corresponding
> right border should be removed and new one put, so on each iteration there
> will be done just one meta storage invoke.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (IGNITE-19578) Decrease count of lease messages to meta storage
[
https://issues.apache.org/jira/browse/IGNITE-19578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17731490#comment-17731490
]
Denis Chudov commented on IGNITE-19578:
---
For now this ticket is blocked by
https://issues.apache.org/jira/browse/IGNITE-19700
> Decrease count of lease messages to meta storage
>
>
> Key: IGNITE-19578
> URL: https://issues.apache.org/jira/browse/IGNITE-19578
> Project: Ignite
> Issue Type: Improvement
>Reporter: Denis Chudov
>Assignee: Denis Chudov
>Priority: Major
> Labels: ignite-3
> Time Spent: 20m
> Remaining Estimate: 0h
>
> *Motivation*
> Huge number of lease messages cause serious load on meta storage, which
> impacts the performance of a cluster overall. Each lease message contains
> prefix + group name as a key, and the value contains leaseholder name, left
> and right timestamp and couple of boolean flags.
> Many leases share the same leaseholder. Also, many leases share the same
> right border, as batch of leases are renewed on every iteration of lease
> updater and get the same right border.
> So, the compacted data structure for all leases could be a map
> {code:java}
> right border -> set of leaseholders -> set of leases which contain only group
> name, left border and flags.{code}
> It is important that this data structure is applicable to meta storage
> representation, in-memory representation of leases should remain the same.
> *Definition of done*
> Count of meta storage invokes from lease updater is significantly reduced.
> *Implementation notes*
> The key should be prefix + right border. On each iteration the corresponding
> right border should be removed and new one put, so on each iteration there
> will be done just one meta storage invoke.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (IGNITE-19578) Decrease count of lease messages to meta storage
[ https://issues.apache.org/jira/browse/IGNITE-19578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17740574#comment-17740574 ] Vladislav Pyatkov commented on IGNITE-19578: LGTM > Decrease count of lease messages to meta storage > > > Key: IGNITE-19578 > URL: https://issues.apache.org/jira/browse/IGNITE-19578 > Project: Ignite > Issue Type: Improvement >Reporter: Denis Chudov >Assignee: Denis Chudov >Priority: Major > Labels: ignite-3 > Time Spent: 2h 10m > Remaining Estimate: 0h > > *Motivation* > Huge number of lease messages cause serious load on meta storage, which > impacts the performance of a cluster overall. Leases can be sent as single > message to meta storage and then the size of this message can be reduced as > described in IGNITE-19819. > *Definition of done* > Count of meta storage invokes from lease updater is significantly reduced. > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (IGNITE-19578) Decrease count of lease messages to meta storage
[ https://issues.apache.org/jira/browse/IGNITE-19578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17740576#comment-17740576 ] Vladislav Pyatkov commented on IGNITE-19578: Thank you for the contribution Merged 8586df07f81460c5e89846fa2fc7cb3eaaa3b6b6 > Decrease count of lease messages to meta storage > > > Key: IGNITE-19578 > URL: https://issues.apache.org/jira/browse/IGNITE-19578 > Project: Ignite > Issue Type: Improvement >Reporter: Denis Chudov >Assignee: Denis Chudov >Priority: Major > Labels: ignite-3 > Time Spent: 2h 20m > Remaining Estimate: 0h > > *Motivation* > Huge number of lease messages cause serious load on meta storage, which > impacts the performance of a cluster overall. Leases can be sent as single > message to meta storage and then the size of this message can be reduced as > described in IGNITE-19819. > *Definition of done* > Count of meta storage invokes from lease updater is significantly reduced. > -- This message was sent by Atlassian Jira (v8.20.10#820010)
