[jira] [Updated] (HIVE-21912) Implement BlacklistingLlapMetricsListener
[ https://issues.apache.org/jira/browse/HIVE-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary updated HIVE-21912: -- Summary: Implement BlacklistingLlapMetricsListener (was: Implement DisablingDaemonStatisticsHandler) > Implement BlacklistingLlapMetricsListener > - > > Key: HIVE-21912 > URL: https://issues.apache.org/jira/browse/HIVE-21912 > Project: Hive > Issue Type: Sub-task > Components: llap, Tez >Reporter: Peter Vary >Assignee: Peter Vary >Priority: Major > Labels: pull-request-available > Attachments: HIVE-21912.patch, HIVE-21912.wip-2.patch, > HIVE-21912.wip.patch > > Time Spent: 10m > Remaining Estimate: 0h > > We should implement a DaemonStatisticsHandler which: > * If a node average response time is bigger than 150% (configurable) of the > other nodes > * If the other nodes has enough empty executors to handle the requests > Then disables the limping node. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21912) Implement BlacklistingLlapMetricsListener
[ https://issues.apache.org/jira/browse/HIVE-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary updated HIVE-21912: -- Attachment: HIVE-21912.2.patch > Implement BlacklistingLlapMetricsListener > - > > Key: HIVE-21912 > URL: https://issues.apache.org/jira/browse/HIVE-21912 > Project: Hive > Issue Type: Sub-task > Components: llap, Tez >Reporter: Peter Vary >Assignee: Peter Vary >Priority: Major > Labels: pull-request-available > Attachments: HIVE-21912.2.patch, HIVE-21912.patch, > HIVE-21912.wip-2.patch, HIVE-21912.wip.patch > > Time Spent: 6h > Remaining Estimate: 0h > > We should implement a DaemonStatisticsHandler which: > * If a node average response time is bigger than 150% (configurable) of the > other nodes > * If the other nodes has enough empty executors to handle the requests > Then disables the limping node. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21912) Implement BlacklistingLlapMetricsListener
[ https://issues.apache.org/jira/browse/HIVE-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary updated HIVE-21912: -- Attachment: HIVE-21912.3.patch > Implement BlacklistingLlapMetricsListener > - > > Key: HIVE-21912 > URL: https://issues.apache.org/jira/browse/HIVE-21912 > Project: Hive > Issue Type: Sub-task > Components: llap, Tez >Reporter: Peter Vary >Assignee: Peter Vary >Priority: Major > Labels: pull-request-available > Attachments: HIVE-21912.2.patch, HIVE-21912.3.patch, > HIVE-21912.patch, HIVE-21912.wip-2.patch, HIVE-21912.wip.patch > > Time Spent: 6h > Remaining Estimate: 0h > > We should implement a DaemonStatisticsHandler which: > * If a node average response time is bigger than 150% (configurable) of the > other nodes > * If the other nodes has enough empty executors to handle the requests > Then disables the limping node. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21912) Implement BlacklistingLlapMetricsListener
[ https://issues.apache.org/jira/browse/HIVE-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary updated HIVE-21912: -- Attachment: HIVE-21912.4.patch > Implement BlacklistingLlapMetricsListener > - > > Key: HIVE-21912 > URL: https://issues.apache.org/jira/browse/HIVE-21912 > Project: Hive > Issue Type: Sub-task > Components: llap, Tez >Reporter: Peter Vary >Assignee: Peter Vary >Priority: Major > Labels: pull-request-available > Attachments: HIVE-21912.2.patch, HIVE-21912.3.patch, > HIVE-21912.4.patch, HIVE-21912.patch, HIVE-21912.wip-2.patch, > HIVE-21912.wip.patch > > Time Spent: 6h > Remaining Estimate: 0h > > We should implement a DaemonStatisticsHandler which: > * If a node average response time is bigger than 150% (configurable) of the > other nodes > * If the other nodes has enough empty executors to handle the requests > Then disables the limping node. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21912) Implement BlacklistingLlapMetricsListener
[ https://issues.apache.org/jira/browse/HIVE-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary updated HIVE-21912: -- Attachment: HIVE-21912.5.patch > Implement BlacklistingLlapMetricsListener > - > > Key: HIVE-21912 > URL: https://issues.apache.org/jira/browse/HIVE-21912 > Project: Hive > Issue Type: Sub-task > Components: llap, Tez >Reporter: Peter Vary >Assignee: Peter Vary >Priority: Major > Labels: pull-request-available > Attachments: HIVE-21912.2.patch, HIVE-21912.3.patch, > HIVE-21912.4.patch, HIVE-21912.5.patch, HIVE-21912.patch, > HIVE-21912.wip-2.patch, HIVE-21912.wip.patch > > Time Spent: 6h > Remaining Estimate: 0h > > We should implement a DaemonStatisticsHandler which: > * If a node average response time is bigger than 150% (configurable) of the > other nodes > * If the other nodes has enough empty executors to handle the requests > Then disables the limping node. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-21912) Implement BlacklistingLlapMetricsListener
[ https://issues.apache.org/jira/browse/HIVE-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary updated HIVE-21912: -- Attachment: HIVE-21912.6.patch > Implement BlacklistingLlapMetricsListener > - > > Key: HIVE-21912 > URL: https://issues.apache.org/jira/browse/HIVE-21912 > Project: Hive > Issue Type: Sub-task > Components: llap, Tez >Reporter: Peter Vary >Assignee: Peter Vary >Priority: Major > Labels: pull-request-available > Attachments: HIVE-21912.2.patch, HIVE-21912.3.patch, > HIVE-21912.4.patch, HIVE-21912.5.patch, HIVE-21912.6.patch, HIVE-21912.patch, > HIVE-21912.wip-2.patch, HIVE-21912.wip.patch > > Time Spent: 6h > Remaining Estimate: 0h > > We should implement a DaemonStatisticsHandler which: > * If a node average response time is bigger than 150% (configurable) of the > other nodes > * If the other nodes has enough empty executors to handle the requests > Then disables the limping node. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (HIVE-21912) Implement BlacklistingLlapMetricsListener
[ https://issues.apache.org/jira/browse/HIVE-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary updated HIVE-21912: -- Attachment: HIVE-21912.7.patch > Implement BlacklistingLlapMetricsListener > - > > Key: HIVE-21912 > URL: https://issues.apache.org/jira/browse/HIVE-21912 > Project: Hive > Issue Type: Sub-task > Components: llap, Tez >Reporter: Peter Vary >Assignee: Peter Vary >Priority: Major > Labels: pull-request-available > Attachments: HIVE-21912.2.patch, HIVE-21912.3.patch, > HIVE-21912.4.patch, HIVE-21912.5.patch, HIVE-21912.6.patch, > HIVE-21912.7.patch, HIVE-21912.patch, HIVE-21912.wip-2.patch, > HIVE-21912.wip.patch > > Time Spent: 6h > Remaining Estimate: 0h > > We should implement a DaemonStatisticsHandler which: > * If a node average response time is bigger than 150% (configurable) of the > other nodes > * If the other nodes has enough empty executors to handle the requests > Then disables the limping node. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (HIVE-21912) Implement BlacklistingLlapMetricsListener
[ https://issues.apache.org/jira/browse/HIVE-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary updated HIVE-21912: -- Attachment: (was: HIVE-21912.7.patch) > Implement BlacklistingLlapMetricsListener > - > > Key: HIVE-21912 > URL: https://issues.apache.org/jira/browse/HIVE-21912 > Project: Hive > Issue Type: Sub-task > Components: llap, Tez >Reporter: Peter Vary >Assignee: Peter Vary >Priority: Major > Labels: pull-request-available > Attachments: HIVE-21912.2.patch, HIVE-21912.3.patch, > HIVE-21912.4.patch, HIVE-21912.5.patch, HIVE-21912.6.patch, > HIVE-21912.7.patch, HIVE-21912.patch, HIVE-21912.wip-2.patch, > HIVE-21912.wip.patch > > Time Spent: 6h > Remaining Estimate: 0h > > We should implement a DaemonStatisticsHandler which: > * If a node average response time is bigger than 150% (configurable) of the > other nodes > * If the other nodes has enough empty executors to handle the requests > Then disables the limping node. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (HIVE-21912) Implement BlacklistingLlapMetricsListener
[ https://issues.apache.org/jira/browse/HIVE-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary updated HIVE-21912: -- Attachment: HIVE-21912.7.patch > Implement BlacklistingLlapMetricsListener > - > > Key: HIVE-21912 > URL: https://issues.apache.org/jira/browse/HIVE-21912 > Project: Hive > Issue Type: Sub-task > Components: llap, Tez >Reporter: Peter Vary >Assignee: Peter Vary >Priority: Major > Labels: pull-request-available > Attachments: HIVE-21912.2.patch, HIVE-21912.3.patch, > HIVE-21912.4.patch, HIVE-21912.5.patch, HIVE-21912.6.patch, > HIVE-21912.7.patch, HIVE-21912.patch, HIVE-21912.wip-2.patch, > HIVE-21912.wip.patch > > Time Spent: 6h > Remaining Estimate: 0h > > We should implement a DaemonStatisticsHandler which: > * If a node average response time is bigger than 150% (configurable) of the > other nodes > * If the other nodes has enough empty executors to handle the requests > Then disables the limping node. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (HIVE-21912) Implement BlacklistingLlapMetricsListener
[ https://issues.apache.org/jira/browse/HIVE-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary updated HIVE-21912: -- Attachment: HIVE-21912.8.patch > Implement BlacklistingLlapMetricsListener > - > > Key: HIVE-21912 > URL: https://issues.apache.org/jira/browse/HIVE-21912 > Project: Hive > Issue Type: Sub-task > Components: llap, Tez >Reporter: Peter Vary >Assignee: Peter Vary >Priority: Major > Labels: pull-request-available > Attachments: HIVE-21912.2.patch, HIVE-21912.3.patch, > HIVE-21912.4.patch, HIVE-21912.5.patch, HIVE-21912.6.patch, > HIVE-21912.7.patch, HIVE-21912.8.patch, HIVE-21912.patch, > HIVE-21912.wip-2.patch, HIVE-21912.wip.patch > > Time Spent: 6h > Remaining Estimate: 0h > > We should implement a DaemonStatisticsHandler which: > * If a node average response time is bigger than 150% (configurable) of the > other nodes > * If the other nodes has enough empty executors to handle the requests > Then disables the limping node. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (HIVE-21912) Implement BlacklistingLlapMetricsListener
[ https://issues.apache.org/jira/browse/HIVE-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary updated HIVE-21912: -- Attachment: HIVE-21912.9.patch > Implement BlacklistingLlapMetricsListener > - > > Key: HIVE-21912 > URL: https://issues.apache.org/jira/browse/HIVE-21912 > Project: Hive > Issue Type: Sub-task > Components: llap, Tez >Reporter: Peter Vary >Assignee: Peter Vary >Priority: Major > Labels: pull-request-available > Attachments: HIVE-21912.2.patch, HIVE-21912.3.patch, > HIVE-21912.4.patch, HIVE-21912.5.patch, HIVE-21912.6.patch, > HIVE-21912.7.patch, HIVE-21912.8.patch, HIVE-21912.9.patch, HIVE-21912.patch, > HIVE-21912.wip-2.patch, HIVE-21912.wip.patch > > Time Spent: 6h > Remaining Estimate: 0h > > We should implement a DaemonStatisticsHandler which: > * If a node average response time is bigger than 150% (configurable) of the > other nodes > * If the other nodes has enough empty executors to handle the requests > Then disables the limping node. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (HIVE-21912) Implement BlacklistingLlapMetricsListener
[ https://issues.apache.org/jira/browse/HIVE-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary updated HIVE-21912: -- Attachment: HIVE-21912.10.patch > Implement BlacklistingLlapMetricsListener > - > > Key: HIVE-21912 > URL: https://issues.apache.org/jira/browse/HIVE-21912 > Project: Hive > Issue Type: Sub-task > Components: llap, Tez >Reporter: Peter Vary >Assignee: Peter Vary >Priority: Major > Labels: pull-request-available > Attachments: HIVE-21912.10.patch, HIVE-21912.2.patch, > HIVE-21912.3.patch, HIVE-21912.4.patch, HIVE-21912.5.patch, > HIVE-21912.6.patch, HIVE-21912.7.patch, HIVE-21912.8.patch, > HIVE-21912.9.patch, HIVE-21912.patch, HIVE-21912.wip-2.patch, > HIVE-21912.wip.patch > > Time Spent: 6h > Remaining Estimate: 0h > > We should implement a DaemonStatisticsHandler which: > * If a node average response time is bigger than 150% (configurable) of the > other nodes > * If the other nodes has enough empty executors to handle the requests > Then disables the limping node. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (HIVE-21912) Implement BlacklistingLlapMetricsListener
[ https://issues.apache.org/jira/browse/HIVE-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary updated HIVE-21912: -- Attachment: HIVE-21912.11.patch > Implement BlacklistingLlapMetricsListener > - > > Key: HIVE-21912 > URL: https://issues.apache.org/jira/browse/HIVE-21912 > Project: Hive > Issue Type: Sub-task > Components: llap, Tez >Reporter: Peter Vary >Assignee: Peter Vary >Priority: Major > Labels: pull-request-available > Attachments: HIVE-21912.10.patch, HIVE-21912.11.patch, > HIVE-21912.2.patch, HIVE-21912.3.patch, HIVE-21912.4.patch, > HIVE-21912.5.patch, HIVE-21912.6.patch, HIVE-21912.7.patch, > HIVE-21912.8.patch, HIVE-21912.9.patch, HIVE-21912.patch, > HIVE-21912.wip-2.patch, HIVE-21912.wip.patch > > Time Spent: 6h > Remaining Estimate: 0h > > We should implement a DaemonStatisticsHandler which: > * If a node average response time is bigger than 150% (configurable) of the > other nodes > * If the other nodes has enough empty executors to handle the requests > Then disables the limping node. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (HIVE-21912) Implement BlacklistingLlapMetricsListener
[ https://issues.apache.org/jira/browse/HIVE-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary updated HIVE-21912: -- Resolution: Fixed Fix Version/s: 4.0.0 Status: Resolved (was: Patch Available) Pushed to master. Thanks [~odraese] and [~szita] for the review! > Implement BlacklistingLlapMetricsListener > - > > Key: HIVE-21912 > URL: https://issues.apache.org/jira/browse/HIVE-21912 > Project: Hive > Issue Type: Sub-task > Components: llap, Tez >Reporter: Peter Vary >Assignee: Peter Vary >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > Attachments: HIVE-21912.10.patch, HIVE-21912.11.patch, > HIVE-21912.2.patch, HIVE-21912.3.patch, HIVE-21912.4.patch, > HIVE-21912.5.patch, HIVE-21912.6.patch, HIVE-21912.7.patch, > HIVE-21912.8.patch, HIVE-21912.9.patch, HIVE-21912.patch, > HIVE-21912.wip-2.patch, HIVE-21912.wip.patch > > Time Spent: 6h > Remaining Estimate: 0h > > We should implement a DaemonStatisticsHandler which: > * If a node average response time is bigger than 150% (configurable) of the > other nodes > * If the other nodes has enough empty executors to handle the requests > Then disables the limping node. -- This message was sent by Atlassian JIRA (v7.6.14#76016)